-- Logs begin at Sat 2022-04-02 20:01:18 UTC, end at Sat 2022-04-02 22:19:58 UTC. -- Apr 02 20:40:57.094542 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 02 20:40:57.103738 ncdv-master-1 devstack@n-api.service[120906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 2 20:40:57 2022] *** Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: nodename: ncdv-master-1 Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: machine: x86_64 Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: clock source: unix Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: pcre jit disabled Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: detected number of CPU cores: 4 Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: current working directory: / Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: detected binary path: /usr/bin/uwsgi-core Apr 02 20:40:57.105292 ncdv-master-1 devstack@n-api.service[120906]: your processes number limit is 47680 Apr 02 20:40:57.105934 ncdv-master-1 devstack@n-api.service[120906]: your memory page size is 4096 bytes Apr 02 20:40:57.105934 ncdv-master-1 devstack@n-api.service[120906]: detected max file descriptor number: 2048 Apr 02 20:40:57.105934 ncdv-master-1 devstack@n-api.service[120906]: lock engine: pthread robust mutexes Apr 02 20:40:57.105934 ncdv-master-1 devstack@n-api.service[120906]: thunder lock: enabled Apr 02 20:40:57.105934 ncdv-master-1 devstack@n-api.service[120906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 02 20:40:57.105934 ncdv-master-1 devstack@n-api.service[120906]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 02 20:40:57.154635 ncdv-master-1 devstack@n-api.service[120906]: Python main interpreter initialized at 0x55ed107ca9c0 Apr 02 20:40:57.154635 ncdv-master-1 devstack@n-api.service[120906]: python threads support enabled Apr 02 20:40:57.154635 ncdv-master-1 devstack@n-api.service[120906]: your server socket listen backlog is limited to 100 connections Apr 02 20:40:57.154635 ncdv-master-1 devstack@n-api.service[120906]: your mercy for graceful operations on workers is 90 seconds Apr 02 20:40:57.155016 ncdv-master-1 devstack@n-api.service[120906]: mapped 403077 bytes (393 KB) for 2 cores Apr 02 20:40:57.155098 ncdv-master-1 devstack@n-api.service[120906]: *** Operational MODE: preforking *** Apr 02 20:40:57.155286 ncdv-master-1 devstack@n-api.service[120906]: *** uWSGI is running in multiple interpreter mode *** Apr 02 20:40:57.155286 ncdv-master-1 devstack@n-api.service[120906]: spawned uWSGI master process (pid: 120906) Apr 02 20:40:57.155482 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 02 20:40:57.157676 ncdv-master-1 devstack@n-api.service[120906]: spawned uWSGI worker 1 (pid: 120907, cores: 1) Apr 02 20:40:57.157676 ncdv-master-1 devstack@n-api.service[120906]: spawned uWSGI worker 2 (pid: 120908, cores: 1) Apr 02 20:40:57.157676 ncdv-master-1 devstack@n-api.service[120906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 02 20:40:58.403980 ncdv-master-1 devstack@n-api.service[120907]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 02 20:40:58.415371 ncdv-master-1 devstack@n-api.service[120908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 02 20:40:59.264914 ncdv-master-1 devstack@n-api.service[120907]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:40:59.264914 ncdv-master-1 devstack@n-api.service[120907]: from cryptography.utils import int_from_bytes Apr 02 20:40:59.265256 ncdv-master-1 devstack@n-api.service[120907]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:40:59.265256 ncdv-master-1 devstack@n-api.service[120907]: from cryptography.utils import int_from_bytes Apr 02 20:40:59.293540 ncdv-master-1 devstack@n-api.service[120908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:40:59.293540 ncdv-master-1 devstack@n-api.service[120908]: from cryptography.utils import int_from_bytes Apr 02 20:40:59.294069 ncdv-master-1 devstack@n-api.service[120908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:40:59.294069 ncdv-master-1 devstack@n-api.service[120908]: from cryptography.utils import int_from_bytes Apr 02 20:41:01.914367 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 02 20:41:01.914931 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 02 20:41:01.915133 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 02 20:41:01.915244 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 02 20:41:01.915602 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 02 20:41:01.915689 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 02 20:41:01.915768 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 02 20:41:01.915989 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 02 20:41:01.916092 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.916353 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 02 20:41:01.916443 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.916633 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 02 20:41:01.916756 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.917021 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.917172 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.917953 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918045 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918265 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918353 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918589 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918678 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918909 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.918997 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.919218 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.919304 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.919485 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.919579 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.919800 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.919923 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.920125 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.920230 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.920412 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.920523 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.920751 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.920837 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921064 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921164 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921382 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921485 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921686 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921779 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.921999 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.922095 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.922304 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.922397 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.922608 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.922800 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.922935 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.923960 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924095 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924209 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924304 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924408 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924514 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924607 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924689 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924780 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924877 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.924966 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925055 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925134 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925274 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925426 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925588 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925698 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925908 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.925995 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.926220 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.926357 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.926543 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.926673 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.926853 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.926986 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.927249 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.927343 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.927567 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.927692 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.927881 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.928002 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.928196 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.928310 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.928638 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.928753 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.928953 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929040 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929257 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929342 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929579 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929672 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929892 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.929983 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.930205 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.930299 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.930522 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.930615 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.930826 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.930922 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.931132 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.931225 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.931437 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.931530 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.931739 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.931831 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932038 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932131 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932338 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932424 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932610 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932763 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.932962 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933059 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933282 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933382 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933543 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933663 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933853 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.933954 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.934141 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.934230 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.934389 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.934522 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.934686 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.934779 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935004 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935101 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935264 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935380 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935583 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935683 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935890 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.935978 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.936193 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.936294 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.936516 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.936606 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.936820 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.936915 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.937124 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.937224 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.937426 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.937520 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.937731 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.937818 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938040 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938136 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938348 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938435 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938649 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938735 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.938963 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939058 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939283 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939369 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939590 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939686 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939895 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.939990 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.940230 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.940318 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.940555 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.940644 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.940867 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.940971 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.941182 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.941278 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.941500 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.941594 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.941806 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.941901 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.942108 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.942206 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.942413 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.942518 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.942728 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.942829 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943038 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943139 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943337 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943442 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943642 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943749 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943886 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.943974 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.944188 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.944298 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.944510 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.944601 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.944817 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.944916 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.945119 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.945218 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.945423 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.945518 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.945723 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.945830 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946023 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946120 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946325 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946415 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946625 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946710 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.946924 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947011 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947226 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947313 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947525 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947621 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947830 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.947921 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.948131 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.948219 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.948499 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.948590 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.948791 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.948887 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.949097 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.949183 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.949397 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.949490 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.949700 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.949796 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950002 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950099 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950304 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950391 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950616 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950703 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.950915 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951059 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951216 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951312 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951531 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951622 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951832 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.951919 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.952134 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.952221 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.952466 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.952559 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.952770 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.952859 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953075 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953169 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953389 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953530 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953698 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953832 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.953988 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954088 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954299 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954392 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954596 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954682 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954899 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.954993 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.955199 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.955286 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.955500 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.955588 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.955804 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.955913 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.956103 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.956196 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.956402 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.956508 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.956729 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.956829 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957022 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957108 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957325 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957411 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957631 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957719 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.957930 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958019 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958232 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958318 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958534 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958630 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958849 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.958937 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.959153 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.959238 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.959459 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.959844 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.960041 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:41:01.960129 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.960381 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.960526 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.960734 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.960826 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.961070 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.961209 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.961384 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.961481 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.961694 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.961781 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962008 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962096 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962334 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962434 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962644 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962740 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.962957 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.963045 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.963272 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.963388 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.963586 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.963686 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.963900 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.964532 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.964761 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.964857 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.965078 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.965175 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.965395 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.965482 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.965711 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.965806 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966021 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966118 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966338 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966425 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966660 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966756 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.966977 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.967072 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.967283 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.967376 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.967610 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.967704 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.967932 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968020 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968243 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968331 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968585 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968687 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968905 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.968993 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.969214 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.969308 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.969521 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.969610 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.969830 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.969917 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.970149 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.970250 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.970474 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.970568 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.970782 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.970868 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.971102 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.971198 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.971412 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.971515 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.971719 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.971807 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972029 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972125 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972338 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972425 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972672 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972762 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.972986 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.973088 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.973300 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.973393 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.973612 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.973738 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.973920 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974070 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974234 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974322 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974542 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974630 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974850 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.974940 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.975158 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.975246 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.975459 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.975546 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.975760 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.975849 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.976060 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.976155 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.976366 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.976474 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.976689 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.976779 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977004 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977093 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977328 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977421 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977629 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977723 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.977945 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978039 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978246 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978342 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978556 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978644 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978866 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.978961 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.979175 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.979270 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.979477 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.979570 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.980327 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.980425 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.980663 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.980766 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.980973 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981062 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981293 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981380 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981602 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981701 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981904 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.981998 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.982223 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.982309 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.982524 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.982613 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.982824 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.982911 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.983134 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.983221 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.983438 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.983525 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.983743 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.983877 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.984048 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.984134 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.984357 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.984446 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.984699 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.984797 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985008 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985096 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985318 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985405 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985642 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985730 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.985956 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986056 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986256 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986351 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986576 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986673 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986895 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.986991 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.987202 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.987298 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.987501 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.987588 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.987809 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.987909 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.988110 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.988197 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.988410 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.988548 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.988733 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.988832 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989040 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989144 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989339 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989427 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989638 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989734 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.989939 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990035 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990240 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990326 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990536 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990631 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990841 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.990927 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.991145 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.991239 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.991444 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.991531 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.991743 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.991836 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992043 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992137 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992350 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992437 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992675 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992764 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.992980 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.993081 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.993322 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.993409 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.993629 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.993716 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.993946 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994041 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994258 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994346 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994572 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994659 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994880 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.994981 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.995213 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.995322 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.995520 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.995607 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.995828 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.995926 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.996144 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.996277 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.996489 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.996580 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.996791 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.996893 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.997098 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.997184 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.997412 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.997505 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.997717 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.997805 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998029 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998123 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998330 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998416 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998643 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998731 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.998960 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999046 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999265 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999352 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999583 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999673 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999899 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:01.999987 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.000208 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.000295 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.000541 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.000634 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.000856 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.000956 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.001164 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.001284 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.001473 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.001613 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.001783 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.001869 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.002095 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.002192 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.002400 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.002486 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.002709 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.002802 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003015 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003116 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003328 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003416 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003630 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003716 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.003943 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004154 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004247 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004367 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004560 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004650 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004890 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.004988 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.005191 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.005306 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.005507 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.005638 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.005817 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.005905 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.006136 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.006224 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.006445 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.006597 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.006747 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.006882 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007047 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007203 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007361 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007501 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007647 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007788 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.007922 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008055 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008232 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008381 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008549 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008682 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008853 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.008952 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.009155 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.009274 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.009462 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.009556 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.009763 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.009850 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.010063 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.010161 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.010363 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.010452 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.010675 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.010761 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011015 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011111 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011318 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011407 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011630 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011717 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.011945 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012040 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012249 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012344 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012571 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012663 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012891 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.012981 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.013195 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.013290 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.013497 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.013584 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.013799 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.013895 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.014100 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.014188 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.014403 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.014489 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.014708 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.014847 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015012 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015149 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015327 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015468 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015648 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015786 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.015948 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.016083 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.016257 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.016408 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.016617 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.016761 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.016898 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017041 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017183 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017333 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017469 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017605 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017776 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.017913 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018084 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018239 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018375 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018516 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018687 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018826 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.018995 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.019138 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.019306 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.019445 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.019609 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.019740 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.019917 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020050 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020222 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020353 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020547 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020683 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020856 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.020990 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.021163 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.021295 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.021466 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.021720 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.021866 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.022053 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.022189 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.022367 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.022623 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.022760 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.022956 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.023100 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.023272 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.023408 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.023591 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.023736 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.023922 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.024056 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.024227 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.024370 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.024562 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.024662 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.024871 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025011 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025175 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025311 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025478 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025628 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025785 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.025921 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.026086 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.026219 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.026387 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027051 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027184 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027328 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027495 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027634 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027796 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.027928 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.028096 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.028306 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.028445 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.028636 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.028769 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.028914 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029048 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029199 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029336 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029478 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029611 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029745 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.029877 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030022 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030157 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030291 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030467 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030604 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030757 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.030891 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031057 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031206 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031348 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031485 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031664 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031800 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.031965 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.032095 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.032267 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.032404 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.032631 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.032779 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.032923 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033065 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033256 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033393 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033540 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033674 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033861 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.033998 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.034161 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.034306 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.034460 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.034609 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.034741 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.034872 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035049 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035191 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035355 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035488 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035653 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035786 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.035959 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.036103 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.036265 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.036398 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.036586 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.036719 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.036890 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037036 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037179 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037264 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037480 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037568 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037777 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.037866 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038077 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038163 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038379 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038466 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038679 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038781 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.038975 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039100 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039280 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039375 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039580 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039668 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039877 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.039963 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.040182 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.040269 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.040497 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.040589 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.040801 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.040889 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.041104 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.041200 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.041402 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.041493 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.041702 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.041793 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.042005 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.042154 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.042871 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.042967 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.043174 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.043263 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.043487 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.043583 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.043793 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.043881 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.044096 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.044183 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.044394 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.044511 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.044737 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.044826 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045038 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045126 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045344 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045476 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045647 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045741 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.045947 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046035 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046251 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046339 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046554 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046641 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046861 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.046949 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.047166 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.047318 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.047457 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.047598 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.047756 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.047892 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048056 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048193 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048355 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048560 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048704 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048858 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.048995 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049127 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049261 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049397 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049538 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049681 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049838 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.049981 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.050142 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.050278 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.050441 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.050598 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.050733 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.050872 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051031 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051167 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051351 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051495 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051656 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051792 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.051958 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.052100 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.052296 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.052385 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.052620 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.052708 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.052947 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053033 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053258 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053348 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053566 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053655 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053877 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.053964 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.054176 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.054265 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.054484 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.054571 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.054788 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.054875 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055089 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055220 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055389 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055503 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055707 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055833 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.055998 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.056074 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.056305 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.056417 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.056645 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.056825 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.057086 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.057175 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.057440 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.057821 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.057959 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.058158 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.058273 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.058574 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.058661 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.058941 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.059093 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.059288 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.059437 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.059602 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.059694 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.059954 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.060074 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.060357 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.060528 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.060767 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.060875 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.061195 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.061301 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.061550 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.061732 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.061912 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062058 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062229 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062390 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062530 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062667 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062849 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.062995 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.063179 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.063337 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.063477 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.063635 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.063782 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.063929 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064069 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064215 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064354 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064532 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064678 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064817 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.064973 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.065113 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.065318 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.065476 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.065627 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.065766 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.065918 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.066058 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.066196 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.066333 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.066593 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.066730 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.066879 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067023 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067188 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067324 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067497 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067640 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067791 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.067932 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.068104 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.068247 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.068404 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.068569 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.068747 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.068883 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.069053 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.069196 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.069441 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.069584 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.069755 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.069854 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070058 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070148 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070359 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070460 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070666 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070755 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.070968 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.071065 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.071275 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.071370 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.071575 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.071663 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.071882 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072013 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072183 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072284 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072505 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072605 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072825 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.072952 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.073130 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.073225 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.073510 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.073608 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.073919 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.074021 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.074328 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.074429 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.074637 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.074739 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.074947 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.075052 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.075266 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.075362 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.075584 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.075688 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.075904 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076010 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076206 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076319 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076539 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076661 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076848 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.076945 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.077170 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.077275 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.077511 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.077605 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.077802 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.077899 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.078114 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.078210 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.078416 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.078510 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.078732 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.078823 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079040 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079138 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079348 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079434 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079669 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079769 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.079978 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.080073 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.080300 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.080387 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.080704 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.080793 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081022 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081110 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081342 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081430 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081645 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081733 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.081951 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082040 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082259 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082347 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082562 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082650 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082864 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.082953 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.083168 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.083254 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.083471 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.083565 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.083779 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.083866 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.084083 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.084168 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.084387 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.084770 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.084978 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085082 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085279 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085368 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085582 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085673 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085885 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.085980 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.086206 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.086295 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.086510 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.086607 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.086824 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.086911 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.087135 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.087235 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.087436 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.087535 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.087754 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.087847 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.088059 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.088145 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.088358 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.088446 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.088684 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.088772 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.089498 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.089636 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.089986 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.090092 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.090292 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.090380 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.090613 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.090700 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.090932 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091019 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091257 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091344 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091566 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091662 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091897 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.091986 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.092208 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.092301 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.092548 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.092651 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.092863 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.092951 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.093186 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.093279 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.093490 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.093585 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.093790 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.093886 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094098 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094185 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094398 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094500 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094698 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094784 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.094999 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095085 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095302 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095395 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095602 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095687 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095904 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.095994 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.096202 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.096291 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.096523 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.096656 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.096829 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.096916 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.097143 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.097231 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.097447 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.097541 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.097745 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.097874 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098045 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098135 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098343 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098430 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098648 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098742 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.098952 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099039 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099282 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099369 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099585 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099679 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099901 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.099994 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.100224 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.100311 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.100555 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.100665 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.100879 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.100967 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.101194 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.101279 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.101503 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.101598 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.101816 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.101903 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.102130 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.102215 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.102439 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.102530 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.102750 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.102843 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103061 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103155 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103368 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103456 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103680 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103767 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.103989 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.104074 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.104301 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.104387 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.105217 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.105406 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.105544 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.105734 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106047 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106136 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106361 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106449 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106673 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106769 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.106984 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.107079 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.107296 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.107383 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.107608 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.107707 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.107915 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108001 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108222 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108310 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108554 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108662 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108867 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.108954 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.109180 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.109275 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.109499 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.109593 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.109818 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.109904 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.110133 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.110221 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.110443 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.110532 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.110756 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.110849 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.111069 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.111156 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.111382 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.111469 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.111697 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.111784 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112014 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112113 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112325 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112413 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112660 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112758 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.112974 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113074 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113286 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113371 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113591 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113676 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113903 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.113989 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.114210 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.114304 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.114518 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.114605 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.114825 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.114913 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.115135 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.115221 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.115444 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.115589 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.115756 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.115843 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.116069 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.116156 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.116389 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.116533 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.116726 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.116861 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117035 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117123 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117348 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117449 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117661 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117864 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.117960 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.118176 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.118484 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.118582 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.118801 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.118888 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.119116 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.119209 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.119431 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.119528 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.119743 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.119831 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.120059 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.120154 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.120383 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.120562 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.120710 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.120797 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121017 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121115 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121409 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121518 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121609 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121690 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.121919 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122008 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122226 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122314 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122522 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122611 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122837 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.122925 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.123137 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.123225 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.123455 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.123664 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.123754 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.124012 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.124286 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.124376 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.124659 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.124749 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.124983 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.125082 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.125295 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.125391 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.125600 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.125688 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.125921 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126021 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126226 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126317 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126530 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126618 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126843 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.126976 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.127148 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.127235 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.127447 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.127534 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.127748 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.127837 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128055 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128176 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128361 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128481 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128687 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128778 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.128997 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129087 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129298 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129386 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129608 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129728 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129908 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.129996 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.130210 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.130307 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.130511 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.130600 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.130816 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.130910 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.131114 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.131213 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.131420 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.131508 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.131720 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.131808 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132019 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132116 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132322 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132416 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132644 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132732 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.132951 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133056 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133251 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133339 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133558 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133645 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133857 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.133945 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.134163 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.134258 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.134464 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.134550 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.134773 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.134868 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.135117 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.135205 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.135418 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.135511 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.135730 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.135826 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.136062 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.136152 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.136380 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.136492 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.136712 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.136802 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137018 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137115 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137331 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137417 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137644 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137743 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.137988 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.138169 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.138304 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.138499 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.138812 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.138898 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.139142 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.139237 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.139462 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.139557 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.139761 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.139855 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.140064 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.140151 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.140365 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.140481 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.140714 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.140815 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141024 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141113 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141336 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141425 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141644 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141739 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.141951 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142039 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142257 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142351 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142563 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142652 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142868 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.142964 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.143174 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.143263 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.143481 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.143575 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.143785 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.143884 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.144091 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.144179 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.144396 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.144549 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.144729 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.144830 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145038 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145133 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145353 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145504 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145665 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145762 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.145979 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146067 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146291 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146421 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146597 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146687 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146903 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.146990 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.147206 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.147293 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.147510 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.147610 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.147814 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.147901 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.148126 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.148214 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.148432 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.148539 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.148756 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.148845 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.149082 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.149180 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.149391 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.149480 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.149766 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.149857 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.150085 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.150182 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.150393 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.150492 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.150711 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.150799 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.151030 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.151125 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.151336 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.151917 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.152171 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.152260 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.152511 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.152617 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.152829 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.152941 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.153143 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.153230 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.153474 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.153563 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.153792 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.153880 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.154095 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.154189 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.154397 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.154486 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.154698 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.154793 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155005 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155095 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155318 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155418 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155623 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155717 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.155921 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156018 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156221 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156310 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156547 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156687 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156847 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.156996 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.157133 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.157224 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.157434 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.157578 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.157716 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.157861 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158027 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158159 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158328 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158470 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158629 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158791 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.158924 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159059 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159205 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159342 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159485 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159617 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159788 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.159925 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.160088 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.160229 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.160381 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.160590 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.160723 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.160859 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161005 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161139 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161281 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161418 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161552 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161684 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.161875 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162014 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162160 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162294 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162496 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162633 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162813 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.162967 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.163124 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.163258 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.163428 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.163518 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.163734 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.163832 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.164052 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.164154 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.164360 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.164515 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.164703 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.164867 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165008 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165098 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165326 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165413 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165632 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165736 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.165938 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166027 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166244 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166339 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166551 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166648 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166858 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.166947 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.167213 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.167319 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.167541 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.167690 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.167862 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168001 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168163 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168295 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168506 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168646 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168821 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.168910 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.169139 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.169238 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.169453 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.169549 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.169763 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.169860 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.170081 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.170183 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.170387 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.170481 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.170694 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.170783 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171010 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171111 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171317 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171414 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171622 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171711 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.171931 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172021 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172244 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172330 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172585 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172673 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172904 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.172993 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.173222 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.173309 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.173543 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.173632 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.173864 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.173953 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.174184 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.174272 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.174522 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.174610 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.174836 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.174924 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.175145 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.175278 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.175454 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.175616 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.175756 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.175932 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.176027 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 02 20:41:02.176246 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.176581 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:41:02.176828 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 02 20:41:02.199917 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.200876 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_db.sqlalchemy.engines [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.262577 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.context [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=120907) load_cells /opt/stack/nova/nova/context.py:464}} Apr 02 20:41:02.263647 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.context [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=120908) load_cells /opt/stack/nova/nova/context.py:464}} Apr 02 20:41:02.266762 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_concurrency.lockutils [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:41:02.267823 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:41:02.268349 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_concurrency.lockutils [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:41:02.269159 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_concurrency.lockutils [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:41:02.269456 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:41:02.270247 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:41:02.271093 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_concurrency.lockutils [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:41:02.272192 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:41:02.281276 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.284447 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.285175 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_db.sqlalchemy.engines [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.287560 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_db.sqlalchemy.engines [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.448079 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_db.sqlalchemy.engines [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.450904 ncdv-master-1 devstack@n-api.service[120907]: DEBUG oslo_db.sqlalchemy.engines [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:41:02.898768 ncdv-master-1 devstack@n-api.service[120907]: WARNING keystonemiddleware.auth_token [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:41:02.903150 ncdv-master-1 devstack@n-api.service[120908]: WARNING keystonemiddleware.auth_token [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:41:02.905868 ncdv-master-1 devstack@n-api.service[120907]: WARNING keystonemiddleware.auth_token [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:41:02.909695 ncdv-master-1 devstack@n-api.service[120908]: WARNING keystonemiddleware.auth_token [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:41:03.128476 ncdv-master-1 devstack@n-api.service[120907]: WARNING keystonemiddleware.auth_token [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:41:03.133171 ncdv-master-1 devstack@n-api.service[120908]: WARNING keystonemiddleware.auth_token [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:41:03.133593 ncdv-master-1 devstack@n-api.service[120907]: WARNING keystonemiddleware.auth_token [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:41:03.138965 ncdv-master-1 devstack@n-api.service[120908]: WARNING keystonemiddleware.auth_token [None req-294d45fa-06b6-44d1-b49f-d4af38dd9075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:41:03.139345 ncdv-master-1 devstack@n-api.service[120907]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed107ca9c0 pid: 120907 (default app) Apr 02 20:41:03.141418 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:41:03.142564 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Apr 02 20:41:03.142978 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Sat Apr 2 20:41:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:41:03.144049 ncdv-master-1 devstack@n-api.service[120908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed107ca9c0 pid: 120908 (default app) Apr 02 20:42:24.466923 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:24.467923 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 02 20:42:24.468324 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:24.886759 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-7600f147-d59a-491b-b6e6-63aafef169a2 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:24.915499 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-7600f147-d59a-491b-b6e6-63aafef169a2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.439865 Apr 02 20:42:24.916153 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:42:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:27.334532 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:27.335530 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-fbe8bb38-4c67-4d10-ad03-57b8fc16abc5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Apr 02 20:42:27.336154 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:27.397603 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-839d61a2-f256-46ee-8e23-ada53dc8ed98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:27.417027 ncdv-master-1 devstack@n-api.service[120908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:42:27.417027 ncdv-master-1 devstack@n-api.service[120908]: warnings.warn(msg) Apr 02 20:42:27.447014 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-839d61a2-f256-46ee-8e23-ada53dc8ed98 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104306 Apr 02 20:42:27.447571 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:27.666928 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-e12c99c6-f2a0-494d-9941-7884d572b355 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:27.669461 ncdv-master-1 devstack@n-api.service[120907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:42:27.669461 ncdv-master-1 devstack@n-api.service[120907]: warnings.warn(msg) Apr 02 20:42:27.718549 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-e12c99c6-f2a0-494d-9941-7884d572b355 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262602 Apr 02 20:42:27.719571 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Apr 2 20:42:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:30.128552 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-839d61a2-f256-46ee-8e23-ada53dc8ed98 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:30.129566 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-839d61a2-f256-46ee-8e23-ada53dc8ed98 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Apr 02 20:42:30.129960 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:30.240935 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-20e26c84-2695-411e-8475-02d3a11e2d67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "swap": 0, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:30.258908 ncdv-master-1 devstack@n-api.service[120907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:42:30.258908 ncdv-master-1 devstack@n-api.service[120907]: warnings.warn(msg) Apr 02 20:42:30.278464 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-20e26c84-2695-411e-8475-02d3a11e2d67 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142024 Apr 02 20:42:30.279017 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:30.290878 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-21a3fb53-e5e1-4d2a-8a1d-747cf9bd78c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:30.292493 ncdv-master-1 devstack@n-api.service[120908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:42:30.292493 ncdv-master-1 devstack@n-api.service[120908]: warnings.warn(msg) Apr 02 20:42:30.325816 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-21a3fb53-e5e1-4d2a-8a1d-747cf9bd78c3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038636 Apr 02 20:42:30.326312 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Apr 2 20:42:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:32.855005 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-20e26c84-2695-411e-8475-02d3a11e2d67 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:32.856185 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-20e26c84-2695-411e-8475-02d3a11e2d67 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Apr 02 20:42:32.860478 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:32.932646 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-14e8d745-e8b2-45e6-8e6d-7fcb0e81f84d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:32.957119 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-14e8d745-e8b2-45e6-8e6d-7fcb0e81f84d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093344 Apr 02 20:42:32.971096 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-373f06c6-24d8-461f-aecd-9af796ba14d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:32.979752 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:33.001451 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-373f06c6-24d8-461f-aecd-9af796ba14d9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034333 Apr 02 20:42:33.014953 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Apr 2 20:42:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:35.740667 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-14e8d745-e8b2-45e6-8e6d-7fcb0e81f84d admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:35.742438 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-14e8d745-e8b2-45e6-8e6d-7fcb0e81f84d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002246 Apr 02 20:42:35.743736 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:42:35.825573 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-188cc25d-e63f-4b1b-b052-39ed0a89ea4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:35.852804 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-188cc25d-e63f-4b1b-b052-39ed0a89ea4b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101426 Apr 02 20:42:35.864341 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:35.870474 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-44c4f81b-6e2e-4cdd-a4fb-14c2c16d7d4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:35.902955 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-44c4f81b-6e2e-4cdd-a4fb-14c2c16d7d4e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036520 Apr 02 20:42:35.915388 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Apr 2 20:42:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:38.480147 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-188cc25d-e63f-4b1b-b052-39ed0a89ea4b admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:38.481599 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-188cc25d-e63f-4b1b-b052-39ed0a89ea4b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Apr 02 20:42:38.482161 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:38.545931 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-0c0ff6ca-6c37-462a-be1f-9d43d820eca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "id": "d4"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:38.565178 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-0c0ff6ca-6c37-462a-be1f-9d43d820eca0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076839 Apr 02 20:42:38.566576 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:38.578821 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-7b6d32ee-fbc5-47b5-8145-24fa98236b1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:38.606631 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-7b6d32ee-fbc5-47b5-8145-24fa98236b1e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031599 Apr 02 20:42:38.607861 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Apr 2 20:42:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:41.162352 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-0c0ff6ca-6c37-462a-be1f-9d43d820eca0 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:41.164013 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-0c0ff6ca-6c37-462a-be1f-9d43d820eca0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003735 Apr 02 20:42:41.166235 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:41 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:41.240881 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-a7f0349c-5624-461e-bf58-d4053e13a819 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:41.274120 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-a7f0349c-5624-461e-bf58-d4053e13a819 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.098682 Apr 02 20:42:41.275401 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:42:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:42:43.711383 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-0c0ff6ca-6c37-462a-be1f-9d43d820eca0 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:43.712396 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-0c0ff6ca-6c37-462a-be1f-9d43d820eca0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Apr 02 20:42:43.713043 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:42:43.777972 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-47e05517-dd75-46b9-ac99-b2e196b1a0d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:43.796389 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-47e05517-dd75-46b9-ac99-b2e196b1a0d1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077487 Apr 02 20:42:43.797561 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:43.809057 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-bc302e7d-a26f-4c35-a236-fbc084ed39b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:43.832943 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-bc302e7d-a26f-4c35-a236-fbc084ed39b9 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027705 Apr 02 20:42:43.834299 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Apr 2 20:42:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:42:46.549139 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-47e05517-dd75-46b9-ac99-b2e196b1a0d1 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:46.550150 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-47e05517-dd75-46b9-ac99-b2e196b1a0d1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Apr 02 20:42:46.550555 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:46.612282 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-009bfcb5-285c-489a-accf-7101291045a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:46.633598 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-009bfcb5-285c-489a-accf-7101291045a0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076407 Apr 02 20:42:46.634756 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:42:46.646765 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-62bf3108-3e51-4424-8154-8214821449b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:46.673786 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-62bf3108-3e51-4424-8154-8214821449b7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031118 Apr 02 20:42:46.674598 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Apr 2 20:42:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:49.139601 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-009bfcb5-285c-489a-accf-7101291045a0 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:49.141119 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-009bfcb5-285c-489a-accf-7101291045a0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Apr 02 20:42:49.141657 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:49.201577 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-5edbb938-a21c-4653-9fdc-290f8b30bf24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:49.221765 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-5edbb938-a21c-4653-9fdc-290f8b30bf24 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074154 Apr 02 20:42:49.223121 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:49.239563 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-740ccd7b-1685-40b7-9359-8de27a9c23a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:49.262771 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-740ccd7b-1685-40b7-9359-8de27a9c23a1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027643 Apr 02 20:42:49.263341 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Apr 2 20:42:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:51.770865 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-5edbb938-a21c-4653-9fdc-290f8b30bf24 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:51.771873 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-5edbb938-a21c-4653-9fdc-290f8b30bf24 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 02 20:42:51.772273 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:51.830625 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-eb8edbd2-fd6e-4067-ad35-141a1ee281ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:51.849634 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-eb8edbd2-fd6e-4067-ad35-141a1ee281ff admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071446 Apr 02 20:42:51.850188 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:51.862508 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-cd77b190-dfcf-49b6-9efb-2d0d2934391e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:51.885758 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-cd77b190-dfcf-49b6-9efb-2d0d2934391e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027094 Apr 02 20:42:51.886352 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Apr 2 20:42:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:42:54.292749 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-eb8edbd2-fd6e-4067-ad35-141a1ee281ff admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:42:54.293748 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-eb8edbd2-fd6e-4067-ad35-141a1ee281ff admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Apr 02 20:42:54.294147 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:42:54.353336 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-aa30dc99-0e36-4261-93da-de8ec4f0b1a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "id": "5", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:54.370876 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-aa30dc99-0e36-4261-93da-de8ec4f0b1a0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070726 Apr 02 20:42:54.371435 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Apr 2 20:42:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:42:54.384933 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-42cf3325-cb84-4be0-8034-b82092449e69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:42:54.409388 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-42cf3325-cb84-4be0-8034-b82092449e69 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029842 Apr 02 20:42:54.409966 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Apr 2 20:42:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:43:21.473089 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-aa30dc99-0e36-4261-93da-de8ec4f0b1a0 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:21.474109 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-aa30dc99-0e36-4261-93da-de8ec4f0b1a0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Apr 02 20:43:21.474513 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:21.531338 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-16ebd4a4-6d63-41e0-b782-05fb7b5244ba admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:21.548198 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-16ebd4a4-6d63-41e0-b782-05fb7b5244ba admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066982 Apr 02 20:43:21.548759 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:43:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:43:23.021006 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-aa30dc99-0e36-4261-93da-de8ec4f0b1a0 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:23.022051 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-aa30dc99-0e36-4261-93da-de8ec4f0b1a0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 02 20:43:23.022497 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:23.254200 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-cff149da-aa78-4f32-aa41-2821d572a888 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:23.259642 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.wsgi [None req-cff149da-aa78-4f32-aa41-2821d572a888 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 02 20:43:23.260205 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-cff149da-aa78-4f32-aa41-2821d572a888 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:43:23.261032 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-cff149da-aa78-4f32-aa41-2821d572a888 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058016 Apr 02 20:43:23.261545 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:43:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:23.270750 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-e224a9df-b229-4626-8b9d-d6ef1308fdb1 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:23.291631 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-e224a9df-b229-4626-8b9d-d6ef1308fdb1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024490 Apr 02 20:43:23.292176 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:43:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:43:23.301805 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-2ff998c4-9555-4475-8820-81ca6eeb91f3 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:23.322959 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-2ff998c4-9555-4475-8820-81ca6eeb91f3 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024678 Apr 02 20:43:23.323496 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:43:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:43:23.333082 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-61e7a7db-1b69-4a8f-a25c-4e5e543b765d admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:23.338425 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.wsgi [None req-61e7a7db-1b69-4a8f-a25c-4e5e543b765d admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 02 20:43:23.338984 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-61e7a7db-1b69-4a8f-a25c-4e5e543b765d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:43:23.339761 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-61e7a7db-1b69-4a8f-a25c-4e5e543b765d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010597 Apr 02 20:43:23.340246 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:43:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:24.683370 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-2ff998c4-9555-4475-8820-81ca6eeb91f3 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:24.684394 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-2ff998c4-9555-4475-8820-81ca6eeb91f3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Apr 02 20:43:24.684809 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:24.882055 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-29422663-ed1a-4f80-b702-3a08965efd1b admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:24.887207 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.wsgi [None req-29422663-ed1a-4f80-b702-3a08965efd1b admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 02 20:43:24.887761 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-29422663-ed1a-4f80-b702-3a08965efd1b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:43:24.888580 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-29422663-ed1a-4f80-b702-3a08965efd1b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058926 Apr 02 20:43:24.889089 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:43:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:24.898122 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-a489d023-a3a7-43f8-954b-501d2d954ab5 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:24.911196 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-a489d023-a3a7-43f8-954b-501d2d954ab5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016639 Apr 02 20:43:24.911723 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:43:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:43:24.921191 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-e8196654-3c59-45e4-ac29-cbd09f4c5497 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:24.934986 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-e8196654-3c59-45e4-ac29-cbd09f4c5497 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017249 Apr 02 20:43:24.935507 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:43:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:43:24.944115 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-4e326097-822a-4765-b7ed-d508ed387ca9 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:24.949125 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.wsgi [None req-4e326097-822a-4765-b7ed-d508ed387ca9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 02 20:43:24.949678 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-4e326097-822a-4765-b7ed-d508ed387ca9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:43:24.950446 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-4e326097-822a-4765-b7ed-d508ed387ca9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009783 Apr 02 20:43:24.950925 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:43:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:26.303957 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-e8196654-3c59-45e4-ac29-cbd09f4c5497 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:26.305012 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-e8196654-3c59-45e4-ac29-cbd09f4c5497 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Apr 02 20:43:26.305445 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:26.504829 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-695feedd-c694-443d-a2e5-503c0478bfed admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:26.510779 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.wsgi [None req-695feedd-c694-443d-a2e5-503c0478bfed admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 02 20:43:26.511334 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-695feedd-c694-443d-a2e5-503c0478bfed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:43:26.512119 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-695feedd-c694-443d-a2e5-503c0478bfed admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058755 Apr 02 20:43:26.512661 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:43:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:26.521895 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-11dc8dfe-86bb-474e-9cb9-ffd30e2725e2 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:26.535884 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-11dc8dfe-86bb-474e-9cb9-ffd30e2725e2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Apr 02 20:43:26.536404 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:43:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:43:26.545978 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:26.559729 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017633 Apr 02 20:43:26.560248 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:43:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:43:26.569057 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-24cefc02-25ee-4738-a5b8-c2c300069eca admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:26.574719 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.wsgi [None req-24cefc02-25ee-4738-a5b8-c2c300069eca admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 02 20:43:26.575275 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-24cefc02-25ee-4738-a5b8-c2c300069eca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:43:26.576055 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-24cefc02-25ee-4738-a5b8-c2c300069eca admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010503 Apr 02 20:43:26.576558 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:43:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:43:27.962121 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:27.963142 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Apr 02 20:43:27.963535 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:28.167253 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-7e2bb9db-6116-45b2-b374-c664c4f7da13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:43:28.184725 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-7e2bb9db-6116-45b2-b374-c664c4f7da13 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075247 Apr 02 20:43:28.185200 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Apr 2 20:43:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:43:29.532274 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:29.533308 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Apr 02 20:43:29.533705 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:29.731923 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-eff98af1-f1cc-4bfb-95f0-96af700cc82b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:43:29.748826 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-eff98af1-f1cc-4bfb-95f0-96af700cc82b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069527 Apr 02 20:43:29.749362 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Apr 2 20:43:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:43:31.091327 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:31.092315 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Apr 02 20:43:31.092762 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:31.302757 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-8d3edbd7-e2ec-4f3c-982a-3dcd076f2431 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:43:31.320264 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-8d3edbd7-e2ec-4f3c-982a-3dcd076f2431 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069640 Apr 02 20:43:31.320852 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Apr 2 20:43:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:43:32.653637 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:32.654633 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Apr 02 20:43:32.655024 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:32.849741 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-f52b082c-bdc8-4af6-9989-16e4f0c645cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:43:32.866461 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-f52b082c-bdc8-4af6-9989-16e4f0c645cd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067891 Apr 02 20:43:32.867000 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Apr 2 20:43:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:43:34.190188 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:34.191200 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 02 20:43:34.191593 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:43:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:43:34.388107 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-ab5a125c-edd9-478f-b714-4c0f42abc31d admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:43:34.408334 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-ab5a125c-edd9-478f-b714-4c0f42abc31d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071528 Apr 02 20:43:34.408905 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Sat Apr 2 20:43:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:44:26.755640 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:44:26.756673 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-40190aa7-f0e4-4c70-a733-b60c948358ef admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Apr 02 20:44:26.757072 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Sat Apr 2 20:44:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:44:26.814023 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-78b7e99a-1390-4faa-8707-4cfd243fa336 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:44:26.841954 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-78b7e99a-1390-4faa-8707-4cfd243fa336 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078831 Apr 02 20:44:26.842505 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:44:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:44:26.864942 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-c408e8aa-b508-4999-a82c-9cc06ae833fb admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:44:26.872840 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-c408e8aa-b508-4999-a82c-9cc06ae833fb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012572 Apr 02 20:44:26.873351 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Sat Apr 2 20:44:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:44:26.885111 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-95fbfc1b-e050-40e7-a2a4-1f010fc493a9 admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:44:26.892575 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-95fbfc1b-e050-40e7-a2a4-1f010fc493a9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011001 Apr 02 20:44:26.893090 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Sat Apr 2 20:44:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:44:26.903915 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-7977fbaa-7f5f-4b11-b8fe-f9edbcfded10 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:44:26.911670 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-7977fbaa-7f5f-4b11-b8fe-f9edbcfded10 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011140 Apr 02 20:44:26.912173 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Sat Apr 2 20:44:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:44:26.923027 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-50319650-a4f6-4967-93bc-d8cd947baa9e admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:44:26.930899 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-50319650-a4f6-4967-93bc-d8cd947baa9e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011306 Apr 02 20:44:26.931415 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Sat Apr 2 20:44:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:45:57.995517 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-74a645ab-5f90-4a29-bca3-ac6f9a67309f tempest-verify_tempest_config-1880021898 tempest-verify_tempest_config-1880021898-project] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:45:57.997518 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-74a645ab-5f90-4a29-bca3-ac6f9a67309f tempest-verify_tempest_config-1880021898 tempest-verify_tempest_config-1880021898-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104233 Apr 02 20:45:57.998052 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 20:45:57 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:49:52.558598 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-50319650-a4f6-4967-93bc-d8cd947baa9e admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:49:52.559667 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-50319650-a4f6-4967-93bc-d8cd947baa9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Apr 02 20:49:52.560062 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:49:52.814430 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-61038ad9-c07c-4b1c-ab36-713550c60bac admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:49:52.815588 ncdv-master-1 devstack@n-api.service[120908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:49:52.815588 ncdv-master-1 devstack@n-api.service[120908]: warnings.warn(msg) Apr 02 20:49:52.816851 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-61038ad9-c07c-4b1c-ab36-713550c60bac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:49:52.817293 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-61038ad9-c07c-4b1c-ab36-713550c60bac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:49:52.818132 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-61038ad9-c07c-4b1c-ab36-713550c60bac admin admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:49:52.818612 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-61038ad9-c07c-4b1c-ab36-713550c60bac admin admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:49:52.858100 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-61038ad9-c07c-4b1c-ab36-713550c60bac admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.155852 Apr 02 20:49:52.858647 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 35/71] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:49:52 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:49:54.184938 ncdv-master-1 devstack@n-api.service[120907]: DEBUG nova.api.openstack.wsgi [None req-50319650-a4f6-4967-93bc-d8cd947baa9e admin admin] Calling method '>' {{(pid=120907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:49:54.185950 ncdv-master-1 devstack@n-api.service[120907]: INFO nova.api.openstack.requestlog [None req-50319650-a4f6-4967-93bc-d8cd947baa9e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Apr 02 20:49:54.186354 ncdv-master-1 devstack@n-api.service[120907]: [pid: 120907|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Apr 2 20:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:49:54.380641 ncdv-master-1 devstack@n-api.service[120908]: DEBUG nova.api.openstack.wsgi [None req-672bef4a-23fd-4619-b810-9bdcf1bcef09 admin admin] Calling method '>' {{(pid=120908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:49:54.381816 ncdv-master-1 devstack@n-api.service[120908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:49:54.381816 ncdv-master-1 devstack@n-api.service[120908]: warnings.warn(msg) Apr 02 20:49:54.383050 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-672bef4a-23fd-4619-b810-9bdcf1bcef09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:49:54.383498 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-672bef4a-23fd-4619-b810-9bdcf1bcef09 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:49:54.384321 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-672bef4a-23fd-4619-b810-9bdcf1bcef09 admin admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:49:54.384786 ncdv-master-1 devstack@n-api.service[120908]: DEBUG oslo_concurrency.lockutils [None req-672bef4a-23fd-4619-b810-9bdcf1bcef09 admin admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:49:54.407152 ncdv-master-1 devstack@n-api.service[120908]: INFO nova.api.openstack.requestlog [None req-672bef4a-23fd-4619-b810-9bdcf1bcef09 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.077669 Apr 02 20:49:54.407632 ncdv-master-1 devstack@n-api.service[120908]: [pid: 120908|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:49:54 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:50:41.082483 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Apr 02 20:50:41.083372 ncdv-master-1 devstack@n-api.service[120906]: Sat Apr 2 20:50:41 2022 - graceful shutdown triggered... Apr 02 20:50:41.083886 ncdv-master-1 devstack@n-api.service[120907]: Gracefully killing worker 1 (pid: 120907)... Apr 02 20:50:41.084272 ncdv-master-1 devstack@n-api.service[120908]: Gracefully killing worker 2 (pid: 120908)... Apr 02 20:50:42.084396 ncdv-master-1 devstack@n-api.service[120906]: worker 1 buried after 1 seconds Apr 02 20:50:42.084396 ncdv-master-1 devstack@n-api.service[120906]: worker 2 buried after 1 seconds Apr 02 20:50:42.084396 ncdv-master-1 devstack@n-api.service[120906]: goodbye to uWSGI. Apr 02 20:50:42.086030 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Apr 02 20:50:42.086677 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Apr 02 20:50:42.089539 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 02 20:50:42.130867 ncdv-master-1 devstack@n-api.service[136506]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 2 20:50:42 2022] *** Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: nodename: ncdv-master-1 Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: machine: x86_64 Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: clock source: unix Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: pcre jit disabled Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: detected number of CPU cores: 4 Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: current working directory: / Apr 02 20:50:42.133083 ncdv-master-1 devstack@n-api.service[136506]: detected binary path: /usr/bin/uwsgi-core Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: your processes number limit is 47680 Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: your memory page size is 4096 bytes Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: detected max file descriptor number: 2048 Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: lock engine: pthread robust mutexes Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: thunder lock: enabled Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 02 20:50:42.133994 ncdv-master-1 devstack@n-api.service[136506]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 02 20:50:42.183860 ncdv-master-1 devstack@n-api.service[136506]: Python main interpreter initialized at 0x55b155b1b9c0 Apr 02 20:50:42.183860 ncdv-master-1 devstack@n-api.service[136506]: python threads support enabled Apr 02 20:50:42.183860 ncdv-master-1 devstack@n-api.service[136506]: your server socket listen backlog is limited to 100 connections Apr 02 20:50:42.183860 ncdv-master-1 devstack@n-api.service[136506]: your mercy for graceful operations on workers is 90 seconds Apr 02 20:50:42.184293 ncdv-master-1 devstack@n-api.service[136506]: mapped 403077 bytes (393 KB) for 2 cores Apr 02 20:50:42.184293 ncdv-master-1 devstack@n-api.service[136506]: *** Operational MODE: preforking *** Apr 02 20:50:42.184563 ncdv-master-1 devstack@n-api.service[136506]: *** uWSGI is running in multiple interpreter mode *** Apr 02 20:50:42.184563 ncdv-master-1 devstack@n-api.service[136506]: spawned uWSGI master process (pid: 136506) Apr 02 20:50:42.184777 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 02 20:50:42.185386 ncdv-master-1 devstack@n-api.service[136506]: spawned uWSGI worker 1 (pid: 136517, cores: 1) Apr 02 20:50:42.185947 ncdv-master-1 devstack@n-api.service[136506]: spawned uWSGI worker 2 (pid: 136518, cores: 1) Apr 02 20:50:42.186269 ncdv-master-1 devstack@n-api.service[136506]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 02 20:50:43.452246 ncdv-master-1 devstack@n-api.service[136517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 02 20:50:43.461677 ncdv-master-1 devstack@n-api.service[136518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 02 20:50:44.390008 ncdv-master-1 devstack@n-api.service[136517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:50:44.390008 ncdv-master-1 devstack@n-api.service[136517]: from cryptography.utils import int_from_bytes Apr 02 20:50:44.390357 ncdv-master-1 devstack@n-api.service[136517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:50:44.390357 ncdv-master-1 devstack@n-api.service[136517]: from cryptography.utils import int_from_bytes Apr 02 20:50:44.393747 ncdv-master-1 devstack@n-api.service[136518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:50:44.393747 ncdv-master-1 devstack@n-api.service[136518]: from cryptography.utils import int_from_bytes Apr 02 20:50:44.394074 ncdv-master-1 devstack@n-api.service[136518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 02 20:50:44.394074 ncdv-master-1 devstack@n-api.service[136518]: from cryptography.utils import int_from_bytes Apr 02 20:50:46.783931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 02 20:50:46.784831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 02 20:50:46.784831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 02 20:50:46.785117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 02 20:50:46.785388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 02 20:50:46.785784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.786122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.786455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.786786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.787128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.787451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.787787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.788122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.788629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.788804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.789090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.789442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.789776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.790110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.790436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.790811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.791092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.791425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.791745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.792270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.792964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.793289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.793616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.794101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.794871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.795215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.795557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.796386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.796532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 02 20:50:46.796924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.797015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 02 20:50:46.797108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.797194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 02 20:50:46.797290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.797394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 02 20:50:46.797491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.797577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 02 20:50:46.797672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.797888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.798009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.798196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.798318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.798624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.798754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.798960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.799066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.799296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.799419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.799633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.799762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.799955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.800062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.800307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.800496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.800658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.801022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.801574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.801687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.801763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.801893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.801999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.802291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.802430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.802657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.802745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.802975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.803143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.803302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.803403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.803565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.803777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.803877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.804117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.804218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.804440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.804570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.804806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.804906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.805126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.805232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.805389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.805644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.805760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.805976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.806079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.806290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.806396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.806610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.806712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.806956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.807057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.807274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.807375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.807592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.807698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.807913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.808989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.809226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.809311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.809560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.809667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.809904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.810237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.810510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.810684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.810950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.811049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.811273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.811628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.811729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.811962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.812176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.812278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.812584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.812678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.812930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.813043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.813266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.813365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.813586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.813688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.813911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.814989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.815151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.815259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.815463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.815565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.815783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.815885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.816112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.816212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.816428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.816592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.816763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.816865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.817986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.818928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.819135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.819230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.819465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.819571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.819784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.819885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.820100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.820521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.820706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.820843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.821977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.822124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.822283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.822430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.822611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.822761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.822940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.823079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.823331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.823442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.823587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.823714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.823913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.824038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.824320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.824412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.824602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.824697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.824917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.825022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.825296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.825439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.825663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.825767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.825976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.826079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.826294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.826433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.826665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.826790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.826930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.827051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.827259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.827392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.827577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.827697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.827891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.828987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.829184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.829304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.829496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.829622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.829822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.829939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.830137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.830257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.830454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.831708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.831808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.831908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.832007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.832099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.832241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.832337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.832430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.832543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.833571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.833697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.833809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.833918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.834017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.834120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.834206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.834289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.834382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.834467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.834550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.834641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.834736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.834868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.834967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.835058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.835150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.835243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.835243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.835406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.835498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.835590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.835683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.835773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.835900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.836035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.836228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.836331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.836566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.836690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.836888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.837023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.837220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.837322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.837536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.837643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.837852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.837961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.838178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.838282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.838491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.838594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.838806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.838917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.839130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.839226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.839466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.839575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.839752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.839864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.840078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.840175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.840406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.840519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.840730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.840876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.841042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.841681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.841893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.842013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.842210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.842342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.842524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.842642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.842836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.842954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.843203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.843331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.843562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.843706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.843830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.843949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.844149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.844541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.844541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.844820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.844950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.845086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.845222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.845324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.845417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 02 20:50:46.845502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.845741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.845835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.846072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.846176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.846397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.846502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.846724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.846816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.847048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.847157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.847367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.847460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.847688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.847781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.848980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.849081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.849294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.849393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.849613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.849711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.849939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.850997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.851228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.851321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.851549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.851726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.851866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.851966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.852179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.852270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.852591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.852710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.852851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.852943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.853167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.853275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.853503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.853623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.853823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.853926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.854140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.854240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.854477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.854606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.854792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.854926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.855107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.855233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.855446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.855541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.855769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.855895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.856091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.856217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.856413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.856562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.857468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.857840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.858073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.858233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.858434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.858587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.858852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.859929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.860078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.860235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.860378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.860576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.860724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.860877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.861217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.861540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.861868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.862189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.862511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.862837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.863166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.863485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.863806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.864127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.864472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.864793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.865096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.865223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.865447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.865767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.866075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.866214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.866392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.866612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.866743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.867058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.867186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.867414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.867570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.867802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.868086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.868215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.868422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.868672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.868818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.869092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.869221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.869418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.869626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.869767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.870056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.870194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.870381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.870618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.870757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.871031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.871170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.871363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.871590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.871730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.872010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.872149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.872359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.872632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.872766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.873026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.873165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.873357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.873596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.873729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.874038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.874169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.874374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.874737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.874983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.875116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.875377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.875671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.875954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.876095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.876303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.876640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.876775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.876948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.877157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.877297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.877453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.877584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.877902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.878044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.878234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.878531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.878665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.878871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.879036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.879188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.879487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.879620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.879840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.879997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.880183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.880475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.880611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.880849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.881049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.881180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.881494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.881633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.881814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.881997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.882135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.882439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.882577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.882756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.882952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.883085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.883390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.883530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.883713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.883933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.884075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.884339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.884632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.884779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.884998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.885293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.885444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.885596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.885917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.886219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.886380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.886559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.886708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.886890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.887040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.887220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.887384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.887547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.887690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.887839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.888687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.888851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.889967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.890118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.890260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.890411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.890554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.890704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.890865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.891882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.892033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.892183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.892333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.892515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.892673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.892835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.893037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.893197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.893349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.893498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.893693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.893841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.894015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.894165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.894321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.894500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.894650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.894853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.895012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.895277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.895469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.895622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.895906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.896225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.896372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.896565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.896731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.896884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.897036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.897187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.897341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.897617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.897766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.897960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.898129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.898379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.898536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.898799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.898957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.899099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.899240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.899380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.899555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.899729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.899886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.900029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.900217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.900373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.900554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.900713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.900891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.901041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.901256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.901414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.901601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.901758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.901921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.902970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.903127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.903417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.903620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.904268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.904433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.904661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.904814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.905002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.905150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.905298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.905549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.905712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.905855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.906175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.906451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.906600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.906803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.906972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.907125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.907266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.907419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.907570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.907713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.907866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.908053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.908203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.908367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.908584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.908740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.908910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.909167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.909329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.909472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.909620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.909771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.909921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.910071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.910320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.910477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.910619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.910801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.910951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.911143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.911306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.911472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.911631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.911788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.911946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.912097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.912247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.912421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.912613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.912765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.912908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.913995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.914142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.914893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.914893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.915206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.915444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.915631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.915631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.915923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.916088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.916244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.916392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.916599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.916753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.916895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.917997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.918140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.918280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.918428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.918570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.918721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.918893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.919359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.919531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.919676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.919819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.919974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.920118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.920279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.920423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.920598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.920743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.920969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.921153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.921153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.921439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.921580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.921730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.921881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.922916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.923065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.923250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.923400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.923550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.923692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.923865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.924975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.925126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.925283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.925433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.925707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.925897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.926048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.926346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.926576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.926728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.926961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.927122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.927273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.927423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.927615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.927767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.927917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.928067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.928285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.928441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.928646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.928801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.928944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.929094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.929275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.929453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.929689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.929907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.930054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.930231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.930390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.930543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.930686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.930862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.931966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.932109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.932286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.932545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.932697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.932840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.933919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.934069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.934212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.934352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.934535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.934693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.934947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.935111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.935285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.935445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.935597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.935884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.936035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.936224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.936572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.936737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.936889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.937048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.937203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.937346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.937506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.937696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.937850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.938890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.939042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.939338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.939496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.939659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.939924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.940081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.940232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.940383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.940550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.940706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.940859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.941952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.942107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.942250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.942393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.942575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.942734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.942886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.943995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.944171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.944328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.944550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.944702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.944903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.945066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.945468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.945613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.945790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.946105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.946335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.946486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.946747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.946896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.947053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.947299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.947458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.947619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.947769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.947943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.948095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.948283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.948446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.948720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.948872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.949153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.949312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.949477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.949634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.949779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.949945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.950196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.950346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.951022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.951168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.951351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.951503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.951724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.951871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.952012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.952163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.952307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.952576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.952739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.952883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.953816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.953986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.954131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.954298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.954453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.954604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.954604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.954886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.955925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.956077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.956239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.956383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.956559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.956559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.956855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.957863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.958922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.959958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.960100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.960383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.960571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.960729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.960879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.961905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.962058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.962214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.962366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.962517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.962779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.962943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.963094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.963356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.963515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.963687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.963838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.964955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.965106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.965256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.965503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.965653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.965836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.965988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.966792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.967138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.967450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.967601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.967789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.967947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.968135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.968296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.968507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.968706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.968861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.969975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.970120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.970269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.970532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.970683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.970833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.970987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.971139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.971283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.971434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.971597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.971741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.972000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.972198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.972198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.972537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.972705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.972878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.973028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.973194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.973344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.973530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.973693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.973853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.974005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.974156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.974385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.974623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.974860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.975112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.975325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.975483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.975635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.975868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.976990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.977131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.977344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.977495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.977683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.977841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.978947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.979090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.979271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.979427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.979580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.979894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.980044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.980220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.980375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.980686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.980848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.980992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.981133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.981321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.981487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.981640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.981851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.982125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.982277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.982458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.982609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.982784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.982954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.983098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.983247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.983422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.983572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.983748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.983905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.984077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.984228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.984403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.984592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.984750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.984903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.985127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.985286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.985441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.985584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.985734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.985922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.986081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.986384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.986533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.986713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.986865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.987040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.987367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.987648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.987799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.987999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.988150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.988347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.988536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.988731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.989040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.989199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.989351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.989493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.989679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.989839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.990009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.990161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.990304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.990468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.990625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.990893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.991055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.991241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.991393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.991563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.991725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.991877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.992040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.992216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.992372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.992577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.992736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.992914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.993066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.993224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.993375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.993553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.993703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.993872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.994017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.994260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.994409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.994591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.994741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.994918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.995069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.995259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.995411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.995703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.995852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.996036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.996195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.996348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.996590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.996751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.996937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.997096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.997363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.997688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.997901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.998061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.998257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.998408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.998632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.998782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.998954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.999111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.999269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.999422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.999591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.999750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:46.999901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.000188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.000445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.000652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.000813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.001980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.002123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.002275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.002426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.002579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.002730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.002895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.003968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.004118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.004271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.004414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.004711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.004884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.005933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.006102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.006788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.006954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.007973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.008126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.008270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.008412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.008586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.008731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.008874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.009938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.010183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.010342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.010486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.010634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.010786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.011010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.011161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.011467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.011616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.011797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.012043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.012200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.012351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.012541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.012703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.012856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.013537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.013684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.013832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.013975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.014126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.014280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.014436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.014588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.014738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.014932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.015090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.015243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.015400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.015552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.015868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.016037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.016183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.016340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.016794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.017148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.017376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.017535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.017737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.018931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.019111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.019269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.019414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.019555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.019790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.020169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.020319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.020506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.020669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.020822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.020980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.021132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.021284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.021440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.021591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.021735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.021888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.022071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.022315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.022475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.022619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.022761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.022916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.023061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.023239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.023386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.023552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.023706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.023858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.024920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.025966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.026188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.026344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.026500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.026652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.026803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.026946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.027087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.027283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.027561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.027721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.027912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.028072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.028246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.028406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.029210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.029640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.029804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.030091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.030314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.030480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.030637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.030780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.030930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.031074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.031267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.031424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.031575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.031719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.031869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.032047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.032203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.032375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.032638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.032803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.032959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.033114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.033490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.033650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.033803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.034301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.034524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.034689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.034842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.034995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.035148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.035304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.035304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.035584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.035727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.035869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.036015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.036193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.036579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.036745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.036891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.037982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.038914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.039204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.039420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.039565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.039709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.039850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.040922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.041961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.042112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.042263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.042407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.042407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.042797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.042963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.043116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.043280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.043433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.043578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.043732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.043877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.044018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.044189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.044347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.044591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.044758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.044910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.045945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.046094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.046238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.046394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.046629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.046781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.046931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.047075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.047235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.047393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.047536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.047680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.047680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.048946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.049995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.050154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.050311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.050462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.050610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.050767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.050999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.051163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.051313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.051462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.051462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.051754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.051914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.052064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.052213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.052360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.052571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.052742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.053961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.054109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.054258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.054406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.054562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.054721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.054870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 02 20:50:47.055021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.055021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.055324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.055613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.055935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.056249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.056663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.056908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.057222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.057664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.057988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.058311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.058628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.058951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.059284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.059606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.060001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.060338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.060681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.060998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.061326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.061647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.061981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.062306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.062630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.063120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.063299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.063860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.064204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.064651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.064900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.065243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.065563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.065876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.066191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.066526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.066854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.067172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.067522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.067841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.068159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.068499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.068823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.069144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.069463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.069865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.070446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.070861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.071203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.072141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.072141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.072568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.072739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.073067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.073490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.073837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.074523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.074523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.076349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.076349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.076349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.076349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.079688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.081406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.081406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.081839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_db.sqlalchemy.engines [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.082061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.083269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.083269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.083269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.083269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.084081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.084081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.084081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.084554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.084731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.085074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.085572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.085895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.086219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.086616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.087074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.087346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.087662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.088028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.088348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.088693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.089005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.089319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.089630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.089976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.090319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.090646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.090979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.091915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.092250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.092599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.092935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.093267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.093602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.093912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.094317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.094569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.094890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.095211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.095532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.095852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.096171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.096529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.096868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.097191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.097526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.097854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.098188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.098581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.098834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.099172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.099492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.099811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.100134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.100486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.100789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.101499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.101845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.102187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.102525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.102861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.103201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.103608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.103961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.104322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.104685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.105013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.105336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.105651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 02 20:50:47.105905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 02 20:50:47.130942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_db.sqlalchemy.engines [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.146462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.context [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=136517) load_cells /opt/stack/nova/nova/context.py:464}} Apr 02 20:50:47.150756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:50:47.152392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:50:47.153244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:50:47.155911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:50:47.167269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_db.sqlalchemy.engines [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.168902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_db.sqlalchemy.engines [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.203214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.context [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=136518) load_cells /opt/stack/nova/nova/context.py:464}} Apr 02 20:50:47.207465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:50:47.209133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:50:47.209939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:50:47.211918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:50:47.227518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_db.sqlalchemy.engines [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.229521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_db.sqlalchemy.engines [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.335129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_db.sqlalchemy.engines [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.397620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_db.sqlalchemy.engines [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 02 20:50:47.773557 ncdv-master-1 devstack@n-api.service[136517]: WARNING keystonemiddleware.auth_token [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:50:47.780273 ncdv-master-1 devstack@n-api.service[136517]: WARNING keystonemiddleware.auth_token [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:50:47.834401 ncdv-master-1 devstack@n-api.service[136518]: WARNING keystonemiddleware.auth_token [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:50:47.840988 ncdv-master-1 devstack@n-api.service[136518]: WARNING keystonemiddleware.auth_token [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:50:48.006650 ncdv-master-1 devstack@n-api.service[136517]: WARNING keystonemiddleware.auth_token [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:50:48.011870 ncdv-master-1 devstack@n-api.service[136517]: WARNING keystonemiddleware.auth_token [None req-8026196b-1fb2-49fd-a407-b53427cde504 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:50:48.017357 ncdv-master-1 devstack@n-api.service[136517]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b155b1b9c0 pid: 136517 (default app) Apr 02 20:50:48.072979 ncdv-master-1 devstack@n-api.service[136518]: WARNING keystonemiddleware.auth_token [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 02 20:50:48.078169 ncdv-master-1 devstack@n-api.service[136518]: WARNING keystonemiddleware.auth_token [None req-4c7b00b0-fd6f-4b83-9050-e34733156a56 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 02 20:50:48.083638 ncdv-master-1 devstack@n-api.service[136518]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b155b1b9c0 pid: 136518 (default app) Apr 02 20:51:33.056785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cfc5d7f-95fe-40e6-bacf-efd00a1cc812 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:33.059866 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:33.059866 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:33.061507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cfc5d7f-95fe-40e6-bacf-efd00a1cc812 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:33.062055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cfc5d7f-95fe-40e6-bacf-efd00a1cc812 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:33.062951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cfc5d7f-95fe-40e6-bacf-efd00a1cc812 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:33.063460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cfc5d7f-95fe-40e6-bacf-efd00a1cc812 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:33.112186 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cfc5d7f-95fe-40e6-bacf-efd00a1cc812 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.297613 Apr 02 20:51:33.131559 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:51:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:33.401407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19071049-58df-4b8a-8a6d-7e365db54f9b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-876648588"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:33.436022 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:33.436022 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:33.444058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-19071049-58df-4b8a-8a6d-7e365db54f9b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid 67974653-2abc-41b5-baff-8928062a9ae1 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:33.588055 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19071049-58df-4b8a-8a6d-7e365db54f9b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.464885 Apr 02 20:51:33.594577 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:33.869979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '.version_select at 0x7f54d7060160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:33.872433 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:33.872433 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:33.886038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=136517) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 02 20:51:33.887667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:33.888371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:33.919834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:33.920407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:33.939690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:33.940150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:33.952022 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f83788d0-399c-4e69-814c-0859b20506d5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.657336 Apr 02 20:51:33.953873 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 20:51:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:51:33.964644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5bf9a6c-b53e-4ec1-896b-d95470fdb45c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:33.966155 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:33.966155 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:34.029055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5bf9a6c-b53e-4ec1-896b-d95470fdb45c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:34.029521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5bf9a6c-b53e-4ec1-896b-d95470fdb45c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:34.713121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06c22dda-3c4c-478c-bd3c-04e391666447 tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:34.718067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06c22dda-3c4c-478c-bd3c-04e391666447 tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:34.718843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06c22dda-3c4c-478c-bd3c-04e391666447 tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:34.722606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06c22dda-3c4c-478c-bd3c-04e391666447 tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:34.724965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06c22dda-3c4c-478c-bd3c-04e391666447 tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:34.844612 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06c22dda-3c4c-478c-bd3c-04e391666447 tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.236969 Apr 02 20:51:34.852773 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Apr 2 20:51:33 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:34.988793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5bf9a6c-b53e-4ec1-896b-d95470fdb45c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.030394 Apr 02 20:51:34.989399 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3/5] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:51:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:35.163110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Calling method '.version_select at 0x7f54d581b3a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:35.164639 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:35.164639 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:35.175713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=136518) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 02 20:51:35.177381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.178045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.214956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.215866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.249509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.250758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.285854 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cacf957-f4d2-4ce4-8950-aeb7670f593c tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.431886 Apr 02 20:51:35.287410 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3/6] 10.222.0.18 () {60 vars in 1207 bytes} [Sat Apr 2 20:51:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:51:35.292555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ad6f8bd-1f1f-464c-aadf-8d30339f778b tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:35.294216 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:35.294216 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:35.295650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad6f8bd-1f1f-464c-aadf-8d30339f778b tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.296326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad6f8bd-1f1f-464c-aadf-8d30339f778b tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.297520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad6f8bd-1f1f-464c-aadf-8d30339f778b tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.298467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad6f8bd-1f1f-464c-aadf-8d30339f778b tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.327842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ad6f8bd-1f1f-464c-aadf-8d30339f778b tempest-AZAdminV2TestJSON-220618878 tempest-AZAdminV2TestJSON-220618878-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.038861 Apr 02 20:51:35.329295 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 20:51:35 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:35.334014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeded9da-2e55-4b36-8280-82cb263ee02a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:35.335967 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:35.335967 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:35.345323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeded9da-2e55-4b36-8280-82cb263ee02a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.346122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeded9da-2e55-4b36-8280-82cb263ee02a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.406314 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-eeded9da-2e55-4b36-8280-82cb263ee02a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Apr 02 20:51:35.407023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeded9da-2e55-4b36-8280-82cb263ee02a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:35.407960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eeded9da-2e55-4b36-8280-82cb263ee02a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.077501 Apr 02 20:51:35.410888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e70b6747-c510-4ec5-b280-89086689a018 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2143302191", "ram": 512, "vcpus": 1, "disk": 10, "id": 2104950860, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:35.413031 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 5/8] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:51:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Apr 02 20:51:35.419369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03ea0ebd-e36c-4c9c-9b75-7513ae0bc177 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:35.421104 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:35.421104 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:35.430923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03ea0ebd-e36c-4c9c-9b75-7513ae0bc177 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:35.431547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03ea0ebd-e36c-4c9c-9b75-7513ae0bc177 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:35.485112 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:35.485112 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:35.529464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e70b6747-c510-4ec5-b280-89086689a018 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.538170 Apr 02 20:51:35.539218 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 4/9] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:34 2022] POST /compute/v2.1/flavors => generated 416 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:35.546828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91642df8-5336-47fb-8aa7-77936310a474 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:35.549827 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:35.549827 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:35.614903 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91642df8-5336-47fb-8aa7-77936310a474 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074246 Apr 02 20:51:35.618771 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 5/10] 10.222.0.18 () {60 vars in 1223 bytes} [Sat Apr 2 20:51:35 2022] POST /compute/v2.1/flavors/2104950860/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:35.958338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2de9ce16-6199-41c0-bf79-5d80b4fa89c6 tempest-FlavorsExtraSpecsTestJSON-784652267 tempest-FlavorsExtraSpecsTestJSON-784652267-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:35.994954 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2de9ce16-6199-41c0-bf79-5d80b4fa89c6 tempest-FlavorsExtraSpecsTestJSON-784652267 tempest-FlavorsExtraSpecsTestJSON-784652267-project] 10.222.0.18 "GET /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.370054 Apr 02 20:51:35.999155 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 20:51:35 2022] GET /compute/v2.1/flavors/2104950860/os-extra_specs => generated 66 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.010820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d2165c9-d332-496a-b033-c4f9161061ae tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.087236 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d2165c9-d332-496a-b033-c4f9161061ae tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081745 Apr 02 20:51:36.088991 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 7/12] 10.222.0.18 () {60 vars in 1223 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/flavors/2104950860/os-extra_specs => generated 66 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 20:51:36.105843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ce83c613-5a23-4ae6-a351-67dcbc8961df tempest-FlavorsExtraSpecsTestJSON-784652267 tempest-FlavorsExtraSpecsTestJSON-784652267-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.118798 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ce83c613-5a23-4ae6-a351-67dcbc8961df tempest-FlavorsExtraSpecsTestJSON-784652267 tempest-FlavorsExtraSpecsTestJSON-784652267-project] 10.222.0.18 "GET /compute/v2.1/flavors/2104950860/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018422 Apr 02 20:51:36.119358 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 20:51:36 2022] GET /compute/v2.1/flavors/2104950860/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.130234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a428936c-f1e2-4440-adcb-0e93638f19a6 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.142062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03ea0ebd-e36c-4c9c-9b75-7513ae0bc177 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.727155 Apr 02 20:51:36.146159 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 6/14] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:51:35 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:51:36.163603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b04ab92-ce48-4f13-99c6-8c4c98976a3d tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.164669 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.164669 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:36.171857 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a428936c-f1e2-4440-adcb-0e93638f19a6 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045531 Apr 02 20:51:36.173418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 9/15] 10.222.0.18 () {60 vars in 1223 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/flavors/2104950860/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.183978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-474771a4-c66b-4dca-bab6-b2a27467af8e tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.195963 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-474771a4-c66b-4dca-bab6-b2a27467af8e tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018231 Apr 02 20:51:36.197207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 10/16] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 20:51:36 2022] GET /compute/v2.1/flavors/2104950860/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.204420 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b04ab92-ce48-4f13-99c6-8c4c98976a3d tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.050651 Apr 02 20:51:36.206882 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 7/17] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:36 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:51:36.218689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc3b648a-ec70-4f79-abf0-24b106222627 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1357932630"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.218884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d6aefb97-7a8c-4dad-896d-ad8516fb309d tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.220234 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.220234 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:36.221346 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.221346 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:36.222728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-fc3b648a-ec70-4f79-abf0-24b106222627 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid f70eedc6-d1ef-4df0-9fc9-de46999e3a28 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:36.267991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc3b648a-ec70-4f79-abf0-24b106222627 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056639 Apr 02 20:51:36.269091 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 8/18] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:36.277701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43b4baee-df50-449b-8788-b08e85042844 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1023348712", "name": "tempest-test_aggregate-1644615146"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.279531 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d6aefb97-7a8c-4dad-896d-ad8516fb309d tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/2104950860/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.073921 Apr 02 20:51:36.284209 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 11/19] 10.222.0.18 () {60 vars in 1264 bytes} [Sat Apr 2 20:51:36 2022] PUT /compute/v2.1/flavors/2104950860/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.320292 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.320292 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:36.320292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-43b4baee-df50-449b-8788-b08e85042844 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid 9c117217-8460-4f96-955f-895595848da0 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:36.389274 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43b4baee-df50-449b-8788-b08e85042844 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.118598 Apr 02 20:51:36.395576 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 9/20] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:36.404282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d138f6fc-ebed-44a1-a7f8-c9f36df85714 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.473670 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d138f6fc-ebed-44a1-a7f8-c9f36df85714 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.075722 Apr 02 20:51:36.478370 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 10/21] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 20:51:36 2022] GET /compute/v2.1/flavors/2104950860/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.486943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72ba8da2-bbc5-4c89-81d7-fe9c3c6f84fb tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.487975 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.487975 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:36.516028 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72ba8da2-bbc5-4c89-81d7-fe9c3c6f84fb tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.039037 Apr 02 20:51:36.516681 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 11/22] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:51:36 2022] GET /compute/v2.1/os-aggregates => generated 517 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:36.531759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2de658b-8bf4-42f3-8fee-659642f95ef1 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.532606 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.532606 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:36.631186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2de658b-8bf4-42f3-8fee-659642f95ef1 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2104950860/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.113217 Apr 02 20:51:36.633027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 20:51:36 2022] DELETE /compute/v2.1/flavors/2104950860/os-extra_specs/hw:numa_nodes => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:51:36.644292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0f395d63-7626-40fc-8730-617ca0ad44ce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.648002 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.648002 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:36.669434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f395d63-7626-40fc-8730-617ca0ad44ce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:36.670038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f395d63-7626-40fc-8730-617ca0ad44ce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:36.715791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13d21f3f-36c5-4aa7-b264-644caa636841 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.717153 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.717153 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:36.718522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13d21f3f-36c5-4aa7-b264-644caa636841 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'f3407b4401294ecb8b01a81ef19dd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f55ac7e48c4634ba63ef1bec31a1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:36.719208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13d21f3f-36c5-4aa7-b264-644caa636841 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:36.720057 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13d21f3f-36c5-4aa7-b264-644caa636841 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.434150 Apr 02 20:51:36.724887 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 12/24] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 440 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:36.752689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-218a8903-dc7a-4042-80be-71b454d716d2 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.753715 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.753715 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:36.824632 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-218a8903-dc7a-4042-80be-71b454d716d2 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2104950860/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.093267 Apr 02 20:51:36.828975 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 20:51:36 2022] DELETE /compute/v2.1/flavors/2104950860/os-extra_specs/hw:cpu_policy => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:51:36.857935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6eaf8a4-eb69-4ccc-a022-cc468e8463f8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.861027 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.861027 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:36.903262 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0f395d63-7626-40fc-8730-617ca0ad44ce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.267080 Apr 02 20:51:36.904420 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 13/26] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:36.920226 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6eaf8a4-eb69-4ccc-a022-cc468e8463f8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.092408 Apr 02 20:51:36.921339 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:36 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:51:36.930727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b134bfcb-6b28-4b6d-aa8c-b376214fc75b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2072511449"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:36.932198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a50fe2da-72b4-4043-a68d-0d120c7ed749 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.933578 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.933578 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:36.934778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.aggregate [None req-b134bfcb-6b28-4b6d-aa8c-b376214fc75b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid ac2b0a78-8829-4100-96f1-665028b80871 for aggregate {{(pid=136517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:36.951456 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a50fe2da-72b4-4043-a68d-0d120c7ed749 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/2104950860/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.045846 Apr 02 20:51:36.960091 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 14/28] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Apr 2 20:51:36 2022] GET /compute/v2.1/flavors/2104950860/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:36.971873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-64c3e61b-269b-4266-9b2c-a968e0ed8208 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:36.973738 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:36.973738 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.004625 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b134bfcb-6b28-4b6d-aa8c-b376214fc75b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077345 Apr 02 20:51:37.009814 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 15/29] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:51:37.020684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1185145329"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.024382 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.024382 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:37.053215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:37.053857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-64c3e61b-269b-4266-9b2c-a968e0ed8208 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2104950860" status: 202 len: 0 microversion: 2.1 time: 0.091303 Apr 02 20:51:37.056495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:51:36 2022] DELETE /compute/v2.1/flavors/2104950860 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:37.056630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:37.064949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-58cabe66-d2fa-4207-aa6d-fe3c5b622023 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.076970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:37.077424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:37.106860 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-58cabe66-d2fa-4207-aa6d-fe3c5b622023 tempest-FlavorsExtraSpecsTestJSON-1477687851 tempest-FlavorsExtraSpecsTestJSON-1477687851-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047750 Apr 02 20:51:37.109316 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 16/31] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:37.119791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1185145329 could not be found. Apr 02 20:51:37.120683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1185145329 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.123525 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08813e6f-eed4-47a1-9f4d-fb3745d8801c tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.107520 Apr 02 20:51:37.124698 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:51:37.135744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-833084a7-7802-4111-8ddd-df9462557ea9 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.137263 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.137263 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.201373 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-833084a7-7802-4111-8ddd-df9462557ea9 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.071992 Apr 02 20:51:37.202405 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 02 20:51:37.212550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ed13758-23f5-4fc6-b0c4-5589a4849730 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.214056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ed13758-23f5-4fc6-b0c4-5589a4849730 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.215654 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ed13758-23f5-4fc6-b0c4-5589a4849730 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.007204 Apr 02 20:51:37.220868 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 18/34] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:51:37.226671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb7be59c-eb3d-4053-8bc4-1a7a14de72ba tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.228745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb7be59c-eb3d-4053-8bc4-1a7a14de72ba tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.230150 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb7be59c-eb3d-4053-8bc4-1a7a14de72ba tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.007630 Apr 02 20:51:37.235689 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 19/35] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:51:37.246673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87846a93-74a8-40c7-9580-787d2f6bea7d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-454159506"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.248855 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.248855 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.250042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87846a93-74a8-40c7-9580-787d2f6bea7d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'f3407b4401294ecb8b01a81ef19dd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f55ac7e48c4634ba63ef1bec31a1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:37.250583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87846a93-74a8-40c7-9580-787d2f6bea7d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.252487 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87846a93-74a8-40c7-9580-787d2f6bea7d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014468 Apr 02 20:51:37.253729 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 20/36] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:37.268031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a1cee5e6-7850-42fd-bdbf-9f81a1485f55 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1738995782"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.272592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-a1cee5e6-7850-42fd-bdbf-9f81a1485f55 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid 33c83778-db22-49c0-b58a-905026909fc5 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:37.311578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a1cee5e6-7850-42fd-bdbf-9f81a1485f55 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048850 Apr 02 20:51:37.313134 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 21/37] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:37.329292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98bede33-d510-4260-ac1e-bfdbb62d2c71 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1738995782"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.330702 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.330702 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.334985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-98bede33-d510-4260-ac1e-bfdbb62d2c71 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid 9110baf3-c7b8-4734-9beb-82e06e680698 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:37.361309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-98bede33-d510-4260-ac1e-bfdbb62d2c71 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1738995782 already exists. Apr 02 20:51:37.366893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98bede33-d510-4260-ac1e-bfdbb62d2c71 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1738995782 already exists. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.367835 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98bede33-d510-4260-ac1e-bfdbb62d2c71 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.047184 Apr 02 20:51:37.368532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 22/38] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:51:37.380654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6f4bffb-ce34-4ce4-8425-6dd9fbb50b93 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.381289 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.381289 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.429500 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b6f4bffb-ce34-4ce4-8425-6dd9fbb50b93 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.055486 Apr 02 20:51:37.434008 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 23/39] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 02 20:51:37.442767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1761a3e3-d7f2-450d-8810-3efb5a29afc8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2029289308"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.446003 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.446003 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.446964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-1761a3e3-d7f2-450d-8810-3efb5a29afc8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid d012b965-6b5b-4558-b853-095e51b47808 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:37.499871 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1761a3e3-d7f2-450d-8810-3efb5a29afc8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062323 Apr 02 20:51:37.501478 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 24/40] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:37.514606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25cbb4ec-970c-4b09-be07-5075d80379df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.515627 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.515627 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.517294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-25cbb4ec-970c-4b09-be07-5075d80379df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'f3407b4401294ecb8b01a81ef19dd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f55ac7e48c4634ba63ef1bec31a1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:37.519742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25cbb4ec-970c-4b09-be07-5075d80379df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.520760 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25cbb4ec-970c-4b09-be07-5075d80379df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.012006 Apr 02 20:51:37.523649 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 25/41] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:37.535856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4f7efe7-6eec-42f1-ad90-a98b08e971c4 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.581952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4f7efe7-6eec-42f1-ad90-a98b08e971c4 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.054182 Apr 02 20:51:37.583353 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 26/42] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:51:37.592639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d58d4597-61fa-49d7-8a2b-f0beefa66718 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.600013 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.600013 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.618544 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d58d4597-61fa-49d7-8a2b-f0beefa66718 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 02 20:51:37.619155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d58d4597-61fa-49d7-8a2b-f0beefa66718 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.619997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d58d4597-61fa-49d7-8a2b-f0beefa66718 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031681 Apr 02 20:51:37.633459 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 27/43] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:51:37.638839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b1c9ce5-864a-4ad7-bace-487d4989a839 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-284286649"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.642395 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.642395 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.646345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-7b1c9ce5-864a-4ad7-bace-487d4989a839 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid feb2c1f7-152b-4a50-acc4-70a0bc3f4062 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:51:37.690669 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b1c9ce5-864a-4ad7-bace-487d4989a839 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.054887 Apr 02 20:51:37.691657 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 28/44] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:37.705201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ed2b41b-3a44-4a08-8c42-69c243af0a01 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.710668 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.710668 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.711688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ed2b41b-3a44-4a08-8c42-69c243af0a01 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'f3407b4401294ecb8b01a81ef19dd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f55ac7e48c4634ba63ef1bec31a1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:37.712428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ed2b41b-3a44-4a08-8c42-69c243af0a01 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:37.713290 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ed2b41b-3a44-4a08-8c42-69c243af0a01 tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.015555 Apr 02 20:51:37.716941 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 29/45] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 20:51:37 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:51:37.723835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fcd94811-0694-4a56-a58d-7794879a9e40 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:37.724636 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:37.724636 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:37.945193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-200243544", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "availability_zone": "tempest-test_az-1023348712"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:37.974723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:37.976318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:37.978678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:37.982171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:38.101684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fcd94811-0694-4a56-a58d-7794879a9e40 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.381912 Apr 02 20:51:38.102783 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 30/46] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 02 20:51:38.113389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c4ab1cc-a835-488e-9882-2e52cf6ec2eb tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:38.115171 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:38.115171 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:38.132838 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-3c4ab1cc-a835-488e-9882-2e52cf6ec2eb tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 02 20:51:38.133451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c4ab1cc-a835-488e-9882-2e52cf6ec2eb tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:38.140898 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c4ab1cc-a835-488e-9882-2e52cf6ec2eb tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031804 Apr 02 20:51:38.142367 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 31/47] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:38 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:51:38.151525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b40a384-5b6f-4838-8e43-3b892e3f613d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:38.152622 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:38.152622 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:38.153693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b40a384-5b6f-4838-8e43-3b892e3f613d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'f3407b4401294ecb8b01a81ef19dd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f55ac7e48c4634ba63ef1bec31a1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:38.154662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b40a384-5b6f-4838-8e43-3b892e3f613d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:38.155629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b40a384-5b6f-4838-8e43-3b892e3f613d tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.008016 Apr 02 20:51:38.157243 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 32/48] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:51:38 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:38.515202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-112678de-0b0c-4fcd-a831-a48b284a4a2a tempest-AZAdminNegativeTestJSON-2140999365 tempest-AZAdminNegativeTestJSON-2140999365-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:38.516907 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:38.516907 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:38.518141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-112678de-0b0c-4fcd-a831-a48b284a4a2a tempest-AZAdminNegativeTestJSON-2140999365 tempest-AZAdminNegativeTestJSON-2140999365-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '85115da6a8a843c48e4b8a58e3b9c52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '384de584a4f0454689b4e93a98080f19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:38.519151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-112678de-0b0c-4fcd-a831-a48b284a4a2a tempest-AZAdminNegativeTestJSON-2140999365 tempest-AZAdminNegativeTestJSON-2140999365-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:38.520674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-112678de-0b0c-4fcd-a831-a48b284a4a2a tempest-AZAdminNegativeTestJSON-2140999365 tempest-AZAdminNegativeTestJSON-2140999365-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.297603 Apr 02 20:51:38.523245 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 33/49] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 20:51:38 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:38.587394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:51:39.171822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:51:39.172502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:51:39.173206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:51:39.173813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:51:39.174420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:51:39.198449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:39.199626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:39.200755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:39.201339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:39.266524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Getting quotas for project b9fb7e0a29fc4b53825f8910b80bc992. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:51:39.280587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Getting quotas for user 61c0b07ac66748afbf2c5671b1adaf08 and project b9fb7e0a29fc4b53825f8910b80bc992. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:51:39.299180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:51:39.302664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:51:39.403752 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c4b17f4-008a-4721-992c-865be3e4e80b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214214 Apr 02 20:51:39.404422 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 17/50] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:51:39.414234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-006c63a8-22bf-4fea-a39a-9a972224eadb tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:39.414978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-006c63a8-22bf-4fea-a39a-9a972224eadb tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:40.382284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-006c63a8-22bf-4fea-a39a-9a972224eadb tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:40.408808 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-006c63a8-22bf-4fea-a39a-9a972224eadb tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1242 microversion: 2.1 time: 0.998092 Apr 02 20:51:40.409421 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 34/51] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:39 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1242 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:51:41.434800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:41.438035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:41.460715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:41.461342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:41.462268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:41.462989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:41.938051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:41.970114 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8bab9de8-f96d-440b-8b0a-1f764d3d54b3 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1290 microversion: 2.1 time: 0.545237 Apr 02 20:51:41.983696 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 18/52] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:41 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1290 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:42.989333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:42.990058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:43.004933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:43.006049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:43.007160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:43.008591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:43.435226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:43.470120 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1296 microversion: 2.1 time: 0.483581 Apr 02 20:51:43.472430 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 35/53] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:42 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1296 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:44.487436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:44.488062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:44.503636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:44.504163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:44.505050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:44.505500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:45.019938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:45.042227 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-422e432c-e405-45bb-af67-0ffdf4157712 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.556917 Apr 02 20:51:45.044667 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 19/54] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:44 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:45.076128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:45.077121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd92df2d-195a-4da4-b00b-28fbe3ad002f tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001444 Apr 02 20:51:45.077477 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 36/55] 10.222.0.18 () {56 vars in 885 bytes} [Sat Apr 2 20:51:45 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 02 20:51:46.059306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:46.060068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:46.074629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:46.075492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:46.076550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:46.077174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:46.808073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:46.821762 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23ff205d-e127-4e65-a151-dfe105742381 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.764453 Apr 02 20:51:46.824121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 20/56] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:46 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:47.847194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:47.847841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ddb2626-2c22-45b3-a2f5-2b4282a924bc tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1526328039", "ram": 512, "vcpus": 1, "disk": 10, "id": 776422875, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:47.849735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:47.852215 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:47.852215 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:47.888834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:47.891912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:47.898393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:47.904058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:47.944066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ddb2626-2c22-45b3-a2f5-2b4282a924bc tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.661784 Apr 02 20:51:47.955277 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 37/57] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:47 2022] POST /compute/v2.1/flavors => generated 413 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:48.412147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b8a5f35-49fa-4397-92cd-874a85d1ab3f tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:48.473779 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6b8a5f35-49fa-4397-92cd-874a85d1ab3f tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] HTTP exception thrown: Flavor 776422875 has no extra specs with key hw:cpu_thread_policy. Apr 02 20:51:48.483142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b8a5f35-49fa-4397-92cd-874a85d1ab3f tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Returning 404 to user: Flavor 776422875 has no extra specs with key hw:cpu_thread_policy. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.484020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b8a5f35-49fa-4397-92cd-874a85d1ab3f tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] 10.222.0.18 "GET /compute/v2.1/flavors/776422875/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.526892 Apr 02 20:51:48.494210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 38/58] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:51:47 2022] GET /compute/v2.1/flavors/776422875/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:48.499674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b5788ef-e2f1-4739-a694-ce48c7b17be1 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:48.518001 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:48.518001 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:48.519069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5b5788ef-e2f1-4739-a694-ce48c7b17be1 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'cd58307e3a4d45b3bc5f6385dee44c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167ee9fd69c34fbb9d0ba713458b21d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:48.519769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b5788ef-e2f1-4739-a694-ce48c7b17be1 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.530465 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b5788ef-e2f1-4739-a694-ce48c7b17be1 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] 10.222.0.18 "POST /compute/v2.1/flavors/776422875/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.024962 Apr 02 20:51:48.544836 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 39/59] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Apr 2 20:51:48 2022] POST /compute/v2.1/flavors/776422875/os-extra_specs => generated 124 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:48.561302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-213be0d0-b9e2-4bdb-b322-e6e28409a573 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:48.668992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-213be0d0-b9e2-4bdb-b322-e6e28409a573 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/776422875/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.121492 Apr 02 20:51:48.669934 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 40/60] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Apr 2 20:51:48 2022] POST /compute/v2.1/flavors/776422875/os-extra_specs => generated 66 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:48.680405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fbe19181-167f-42a8-80b7-1979295a46f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:48.694388 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:48.694388 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:48.695743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fbe19181-167f-42a8-80b7-1979295a46f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'cd58307e3a4d45b3bc5f6385dee44c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167ee9fd69c34fbb9d0ba713458b21d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:48.702379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fbe19181-167f-42a8-80b7-1979295a46f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.704628 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fbe19181-167f-42a8-80b7-1979295a46f5 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] 10.222.0.18 "DELETE /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.028108 Apr 02 20:51:48.705671 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 41/61] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 20:51:48 2022] DELETE /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:48.715418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-daa971a6-0a32-4096-a6d2-ee6784b90842 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:48.790604 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-daa971a6-0a32-4096-a6d2-ee6784b90842 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/776422875/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079536 Apr 02 20:51:48.791865 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 42/62] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Apr 2 20:51:48 2022] POST /compute/v2.1/flavors/776422875/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:48.802513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-108702f0-58f4-4252-a251-b4148094a7fe tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:48.811890 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:48.811890 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:48.813395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-108702f0-58f4-4252-a251-b4148094a7fe tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'cd58307e3a4d45b3bc5f6385dee44c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167ee9fd69c34fbb9d0ba713458b21d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:48.814266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-108702f0-58f4-4252-a251-b4148094a7fe tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.815278 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-108702f0-58f4-4252-a251-b4148094a7fe tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412 tempest-FlavorsExtraSpecsNegativeTestJSON-1775309412-project] 10.222.0.18 "PUT /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017563 Apr 02 20:51:48.819238 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 43/63] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:51:48 2022] PUT /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:51:48.833311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-024e9303-8b2b-4fec-9992-9d0738d76d33 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:48.853630 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-024e9303-8b2b-4fec-9992-9d0738d76d33 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] HTTP exception thrown: Flavor 776422875 has no extra specs with key hw:cpu_thread_policy. Apr 02 20:51:48.854905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-024e9303-8b2b-4fec-9992-9d0738d76d33 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Returning 404 to user: Flavor 776422875 has no extra specs with key hw:cpu_thread_policy. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.858351 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-024e9303-8b2b-4fec-9992-9d0738d76d33 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/776422875/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.028722 Apr 02 20:51:48.864357 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 44/64] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 20:51:48 2022] DELETE /compute/v2.1/flavors/776422875/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:48.875724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e2614d1-2944-4999-8bad-c63e38452ed3 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:48.878391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-7e2614d1-2944-4999-8bad-c63e38452ed3 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] HTTP exception thrown: Request body and URI mismatch Apr 02 20:51:48.890712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e2614d1-2944-4999-8bad-c63e38452ed3 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.891821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e2614d1-2944-4999-8bad-c63e38452ed3 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026191 Apr 02 20:51:48.892906 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 45/65] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:51:48 2022] PUT /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:51:48.904142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aef82a73-9a8b-4d0e-ae25-d3aac2afe9c0 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:48.909621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aef82a73-9a8b-4d0e-ae25-d3aac2afe9c0 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:48.918238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aef82a73-9a8b-4d0e-ae25-d3aac2afe9c0 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019877 Apr 02 20:51:48.929661 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 46/66] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:51:48 2022] PUT /compute/v2.1/flavors/776422875/os-extra_specs/hw:numa_nodes => generated 117 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:51:48.937969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9eb94e39-507d-49e0-b4a7-a39e417bee9e tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:48.939018 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:48.939018 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:48.978494 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9eb94e39-507d-49e0-b4a7-a39e417bee9e tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/776422875" status: 202 len: 0 microversion: 2.1 time: 0.044217 Apr 02 20:51:48.980201 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 47/67] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:51:48 2022] DELETE /compute/v2.1/flavors/776422875 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:48.997364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-636f8c19-c8b1-4509-aad6-37c1917da64e tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:49.075370 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-636f8c19-c8b1-4509-aad6-37c1917da64e tempest-FlavorsExtraSpecsNegativeTestJSON-293131298 tempest-FlavorsExtraSpecsNegativeTestJSON-293131298-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089081 Apr 02 20:51:49.077149 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 48/68] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:49.513717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:49.525139 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7749c8dc-cfa9-427a-9f91-5911772c88bf tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 1.686965 Apr 02 20:51:49.527418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 21/69] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:47 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:49.783310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a9a4054f-8d48-4006-83d2-50640258b899 req-1cc616d8-86ad-458a-af89-bca0f7081663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f8f353-82ba-4c3e-82f7-792315bda7c6", "tag": "7af56c27-53b5-4df3-9e0f-085bb8d51a15"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:49.814480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a9a4054f-8d48-4006-83d2-50640258b899 req-1cc616d8-86ad-458a-af89-bca0f7081663 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:49.814929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a9a4054f-8d48-4006-83d2-50640258b899 req-1cc616d8-86ad-458a-af89-bca0f7081663 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:49.922069 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a9a4054f-8d48-4006-83d2-50640258b899 req-1cc616d8-86ad-458a-af89-bca0f7081663 service nova] Creating event network-changed:7af56c27-53b5-4df3-9e0f-085bb8d51a15 for instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 on nch2-master-1 Apr 02 20:51:49.930816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a9a4054f-8d48-4006-83d2-50640258b899 req-1cc616d8-86ad-458a-af89-bca0f7081663 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:51:49.932017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:49.932545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:49.938899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:49.939492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:49.990535 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.rpcapi [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 02 20:51:49.991956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] Releasing lock "compute-rpcapi-router" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:51:50.047914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-217054a4-7880-401e-a2a4-b279cd538f6c None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.653486 Apr 02 20:51:50.049462 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 49/70] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:51:50.547440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:50.550085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:50.565353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:50.566551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:50.571210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:50.572836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:51.327089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-939019235", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:51.421810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:51.430043 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-83f0b436-5fc7-40f4-b0be-2641eb9ca5b2 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.889780 Apr 02 20:51:51.433182 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 22/71] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:50 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:51.510889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:51:51.715390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23c14c5d-4c07-4dda-a164-636ecc012384 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2086960873", "id": 1335039229, "os-flavor-access:is_public": "False"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:51.717701 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:51.717701 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:51.747332 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23c14c5d-4c07-4dda-a164-636ecc012384 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.311563 Apr 02 20:51:51.759509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 23/72] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:51 2022] POST /compute/v2.1/flavors => generated 439 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:51.772545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4bcc895f-a02c-44e2-9cae-54ab7c162f2b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:51.776735 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:51.776735 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:51.933582 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4bcc895f-a02c-44e2-9cae-54ab7c162f2b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1335039229/action" status: 200 len: 97 microversion: 2.1 time: 0.165224 Apr 02 20:51:51.937581 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 24/73] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:51 2022] POST /compute/v2.1/flavors/1335039229/action => generated 97 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:52.000778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6565d0aa-c931-4462-8812-02ff1bc59349 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:52.161953 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-6565d0aa-c931-4462-8812-02ff1bc59349 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 8633aa0dea5440d9a9a03f23a9a8a558 combination. Apr 02 20:51:52.165060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6565d0aa-c931-4462-8812-02ff1bc59349 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 8633aa0dea5440d9a9a03f23a9a8a558 combination. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:52.167372 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6565d0aa-c931-4462-8812-02ff1bc59349 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1335039229/action" status: 409 len: 152 microversion: 2.1 time: 0.189600 Apr 02 20:51:52.173132 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 25/74] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:51 2022] POST /compute/v2.1/flavors/1335039229/action => generated 152 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:51:52.195995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c741ad7-5cf5-4654-a8e1-b60d7d5e0eae tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:52.200246 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:52.200246 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:52.494344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c741ad7-5cf5-4654-a8e1-b60d7d5e0eae tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1335039229/action" status: 200 len: 21 microversion: 2.1 time: 0.316365 Apr 02 20:51:52.495911 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 26/75] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:52 2022] POST /compute/v2.1/flavors/1335039229/action => generated 21 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:52.508084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:52.510290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:52.523985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:52.524756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:52.525634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:52.526666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:52.989967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:51:52.990572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:51:52.991064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:51:52.991483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:51:52.991912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:51:53.027210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:53.027672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:53.038027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:53.038810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:53.135232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Getting quotas for project 493bc8b0b32f4804a5694c0bf34cdeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:51:53.147487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Getting quotas for user b68e4ad966924cf98c972f0fc0704fc1 and project 493bc8b0b32f4804a5694c0bf34cdeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:51:53.195077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:53.203999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9faa7cad-9121-4c70-b1d6-8bcab9166942 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.704211 Apr 02 20:51:53.205048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:51:53.209421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 27/76] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:52 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:53.211434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:51:53.227444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3d2ba0be-b176-4e9f-8b89-9ddf7e2d18cc tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:53.228667 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:53.228667 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:53.295993 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3d2ba0be-b176-4e9f-8b89-9ddf7e2d18cc tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1335039229" status: 202 len: 0 microversion: 2.1 time: 0.084189 Apr 02 20:51:53.299126 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 28/77] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:51:53 2022] DELETE /compute/v2.1/flavors/1335039229 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:53.311102 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c77dc28b-b5f8-4bd0-8757-7488997277dd tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.489431 Apr 02 20:51:53.317481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e59d308-8f58-42e9-8795-2da439da4e74 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:53.319308 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 50/78] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:51:53.329068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7782a079-a851-4090-a08c-882f1939de50 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:53.333594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7782a079-a851-4090-a08c-882f1939de50 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:53.427851 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e59d308-8f58-42e9-8795-2da439da4e74 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.123388 Apr 02 20:51:53.429639 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 29/79] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:51:53.462864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a31a5e80-30d5-4162-8684-7f3c2a81a07a tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-390188194", "id": 961149977, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:53.470407 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:53.470407 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:53.526392 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a31a5e80-30d5-4162-8684-7f3c2a81a07a tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.073661 Apr 02 20:51:53.533276 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 30/80] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:53 2022] POST /compute/v2.1/flavors => generated 434 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:53.555888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77bab9a7-f531-442a-88a5-ac44ed85253d tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:53.556896 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:53.556896 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:53.583290 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-77bab9a7-f531-442a-88a5-ac44ed85253d tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] HTTP exception thrown: Access list not available for public flavors. Apr 02 20:51:53.587554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77bab9a7-f531-442a-88a5-ac44ed85253d tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:53.588745 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-77bab9a7-f531-442a-88a5-ac44ed85253d tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/961149977/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.048248 Apr 02 20:51:53.594663 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 31/81] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 20:51:53 2022] GET /compute/v2.1/flavors/961149977/os-flavor-access => generated 91 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:51:53.605712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-761cfeb7-dfb9-44a2-95dd-59272a4eacad tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:53.652075 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-761cfeb7-dfb9-44a2-95dd-59272a4eacad tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/961149977" status: 202 len: 0 microversion: 2.1 time: 0.055593 Apr 02 20:51:53.657918 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 32/82] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:51:53 2022] DELETE /compute/v2.1/flavors/961149977 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:53.673106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-14842779-184d-42d8-a300-c01e1de25f1b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:53.692288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7782a079-a851-4090-a08c-882f1939de50 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:53.701167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7782a079-a851-4090-a08c-882f1939de50 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1218 microversion: 2.1 time: 0.379735 Apr 02 20:51:53.712635 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 51/83] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:53 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1218 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:53.770207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-14842779-184d-42d8-a300-c01e1de25f1b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.110633 Apr 02 20:51:53.782459 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 33/84] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:53.791335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-724b4760-4fb8-4f55-89c9-1bd32eab101f tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-995780232", "id": 486473787, "os-flavor-access:is_public": "False"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:53.794030 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:53.794030 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:53.835441 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-724b4760-4fb8-4f55-89c9-1bd32eab101f tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.050652 Apr 02 20:51:53.836572 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 52/85] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:51:54.226099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:54.226749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:54.246749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:54.253293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:54.256718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:54.257260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:54.555413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46927b7a-3930-4ddb-8b35-7ae137834d4c tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:54.557669 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:54.557669 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:54.559041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46927b7a-3930-4ddb-8b35-7ae137834d4c tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9bd45d73ee784b2d88712ec65d16d62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8633aa0dea5440d9a9a03f23a9a8a558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:54.559998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46927b7a-3930-4ddb-8b35-7ae137834d4c tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:54.569420 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46927b7a-3930-4ddb-8b35-7ae137834d4c tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] 10.222.0.18 "POST /compute/v2.1/flavors/486473787/action" status: 403 len: 130 microversion: 2.1 time: 0.720547 Apr 02 20:51:54.570446 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 34/86] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Apr 2 20:51:53 2022] POST /compute/v2.1/flavors/486473787/action => generated 130 bytes in 728 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:54.586516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d83e0bb0-ef1c-4d85-97d4-a245774dbb92 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:54.647344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d83e0bb0-ef1c-4d85-97d4-a245774dbb92 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/486473787" status: 202 len: 0 microversion: 2.1 time: 0.071035 Apr 02 20:51:54.651810 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 35/87] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:51:54 2022] DELETE /compute/v2.1/flavors/486473787 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:54.663024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23e86166-30d4-464a-b9f0-359406fbe1da tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:54.720996 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23e86166-30d4-464a-b9f0-359406fbe1da tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064801 Apr 02 20:51:54.728340 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 36/88] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:54.739682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17acf63e-b8a2-4bf4-90b7-e8c1bac07e11 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:54.742302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17acf63e-b8a2-4bf4-90b7-e8c1bac07e11 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:54.912475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17acf63e-b8a2-4bf4-90b7-e8c1bac07e11 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:54.943324 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17acf63e-b8a2-4bf4-90b7-e8c1bac07e11 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1218 microversion: 2.1 time: 0.212954 Apr 02 20:51:54.948726 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 37/89] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:54 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1218 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:54.970144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7311ba6e-60b0-48a2-baec-bb65e16efa1e tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1333859622", "id": 1445380110, "os-flavor-access:is_public": "False"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:54.986070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:54.989678 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:54.989678 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:55.006145 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9934e258-0be1-4e91-a082-072c308c7f41 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.782024 Apr 02 20:51:55.013050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 53/90] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:54 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:51:55.021550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7311ba6e-60b0-48a2-baec-bb65e16efa1e tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.071690 Apr 02 20:51:55.026613 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 38/91] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:54 2022] POST /compute/v2.1/flavors => generated 439 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:55.040583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6dc5d01-5581-408c-b6c8-b7d184addbdd tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:55.043556 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:55.043556 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:55.517422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4fd8f0fe-9d2e-4a0e-83c0-53ac664dad5b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:55.531839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4fd8f0fe-9d2e-4a0e-83c0-53ac664dad5b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.515039 Apr 02 20:51:55.532782 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 54/92] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:51:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:55.601717 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6dc5d01-5581-408c-b6c8-b7d184addbdd tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1445380110/action" status: 200 len: 97 microversion: 2.1 time: 0.570014 Apr 02 20:51:55.605902 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 39/93] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:55 2022] POST /compute/v2.1/flavors/1445380110/action => generated 97 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:55.617909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9597113-f6d4-4e2f-954b-fb141eca1156 tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:55.622829 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:55.622829 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:55.624716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9597113-f6d4-4e2f-954b-fb141eca1156 tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9bd45d73ee784b2d88712ec65d16d62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8633aa0dea5440d9a9a03f23a9a8a558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:55.626616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9597113-f6d4-4e2f-954b-fb141eca1156 tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:55.632816 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9597113-f6d4-4e2f-954b-fb141eca1156 tempest-FlavorsAccessNegativeTestJSON-1889065635 tempest-FlavorsAccessNegativeTestJSON-1889065635-project] 10.222.0.18 "POST /compute/v2.1/flavors/1445380110/action" status: 403 len: 133 microversion: 2.1 time: 0.020644 Apr 02 20:51:55.637528 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 40/94] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:55 2022] POST /compute/v2.1/flavors/1445380110/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:55.652997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a481b614-c400-4fa7-8bed-ef6219c032b9 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8633aa0dea5440d9a9a03f23a9a8a558"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:55.988874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77f1496b-8411-4da7-b010-31c771066948 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-146084530", "id": 52101737, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:55.991131 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:55.991131 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:56.039120 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77f1496b-8411-4da7-b010-31c771066948 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.495858 Apr 02 20:51:56.048749 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 55/95] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:55 2022] POST /compute/v2.1/flavors => generated 418 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:51:56.055426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:56.060542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:56.077462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:56.079003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:56.082782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:56.084228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:56.253075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:56.262938 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d24db8b5-f2cd-4ab3-9a37-88f572fa59d0 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1278 microversion: 2.1 time: 0.211200 Apr 02 20:51:56.276677 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 56/96] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:56 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:56.281864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:56.289321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:56.304119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:56.304948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:56.305977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:56.306633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:56.389909 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a481b614-c400-4fa7-8bed-ef6219c032b9 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1445380110/action" status: 200 len: 21 microversion: 2.1 time: 0.749679 Apr 02 20:51:56.406351 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 41/97] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:55 2022] POST /compute/v2.1/flavors/1445380110/action => generated 21 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:56.413584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6798b99-877a-4641-8136-1f3529351fd8 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:56.441567 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6798b99-877a-4641-8136-1f3529351fd8 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026760 Apr 02 20:51:56.441567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 42/98] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Apr 2 20:51:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:56.465845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-617a0091-47ff-4cae-9d3a-dac4b869ffa3 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:56.466722 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:56.466722 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:56.512607 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-617a0091-47ff-4cae-9d3a-dac4b869ffa3 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1445380110" status: 202 len: 0 microversion: 2.1 time: 0.076286 Apr 02 20:51:56.513332 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 43/99] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:51:56 2022] DELETE /compute/v2.1/flavors/1445380110 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:56.521461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2740a1f2-8a9f-4d51-ba51-43b83b15638f tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1593190544", "id": 1530115126, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:56.532992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:56.569728 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e8429fbc-2204-4fb3-bddd-cc934b570618 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.287802 Apr 02 20:51:56.572078 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2740a1f2-8a9f-4d51-ba51-43b83b15638f tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.046986 Apr 02 20:51:56.573836 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 57/100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:56 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:56.587937 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 44/101] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:56 2022] POST /compute/v2.1/flavors => generated 425 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:56.600040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f99500e8-aad7-4801-9908-f84132c0c958 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:56.602412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5ce3383e-0320-4a91-9b76-89736c6e4866 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:56.627914 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f99500e8-aad7-4801-9908-f84132c0c958 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037924 Apr 02 20:51:56.633579 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 45/102] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Apr 2 20:51:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:51:56.668789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5ce3383e-0320-4a91-9b76-89736c6e4866 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.087528 Apr 02 20:51:56.669921 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 58/103] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:56 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:56.680398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09d4533f-7966-471e-bce2-214f6bb4f49e tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Action: 'create', calling method: .version_select at 0x7f54d5514820>, body: {"keypair": {"name": "tempest-keypair-1511390929"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:56.713199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-09d4533f-7966-471e-bce2-214f6bb4f49e tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for project fde6bd005e3a4a25b63639832027ab85. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:51:56.718026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-09d4533f-7966-471e-bce2-214f6bb4f49e tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for user c42119999e6f40b487a7174dc5a7d617 and project fde6bd005e3a4a25b63639832027ab85. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:51:57.053105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d558f5e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.053983 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.053983 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:57.055261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.055714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.098091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.098487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.129864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.130563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.142054 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e65550cc-df75-4431-96c6-d04d7991738d tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.512131 Apr 02 20:51:57.147299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 46/104] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:57.152303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-69b9abf7-c210-485a-83a8-9d6b2c9be9dc tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1741335935", "id": 1306064955, "os-flavor-access:is_public": "False"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:57.164010 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.164010 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:57.194031 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-69b9abf7-c210-485a-83a8-9d6b2c9be9dc tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.045559 Apr 02 20:51:57.199644 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 47/105] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:51:57 2022] POST /compute/v2.1/flavors => generated 439 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:57.206539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-09d4533f-7966-471e-bce2-214f6bb4f49e tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for project fde6bd005e3a4a25b63639832027ab85. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:51:57.210584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d55a1940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.211486 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.211486 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:57.217859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.218417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.223413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-09d4533f-7966-471e-bce2-214f6bb4f49e tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for user c42119999e6f40b487a7174dc5a7d617 and project fde6bd005e3a4a25b63639832027ab85. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:51:57.251666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.252148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.275723 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09d4533f-7966-471e-bce2-214f6bb4f49e tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.604651 Apr 02 20:51:57.276907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.277370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.292982 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7cf671ec-bb0f-4f7f-b2d5-e4de172803de tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.091337 Apr 02 20:51:57.296730 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 48/106] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 20:51:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:57.301347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b43714f7-bc2b-4eaa-ad32-85438afc098b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5c8862ffa283462ca3bc634c79f45ba6"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:57.302586 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.302586 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:57.305301 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 59/107] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:51:56 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:57.310860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.319908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:57.340131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.340649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.341496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.341896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.659699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:57.668915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ea4786d-35a9-4dd3-997a-36ceea60bd90 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1276 microversion: 2.1 time: 0.362395 Apr 02 20:51:57.669519 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 60/108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:57 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1276 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:57.699806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d54bdf70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.719769 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.719769 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:57.725026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.725442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.750917 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b43714f7-bc2b-4eaa-ad32-85438afc098b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] HTTP exception thrown: Flavor access not found for 23 / 5c8862ffa283462ca3bc634c79f45ba6 combination. Apr 02 20:51:57.762851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b43714f7-bc2b-4eaa-ad32-85438afc098b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Returning 404 to user: Flavor access not found for 23 / 5c8862ffa283462ca3bc634c79f45ba6 combination. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:51:57.768418 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b43714f7-bc2b-4eaa-ad32-85438afc098b tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1306064955/action" status: 404 len: 124 microversion: 2.1 time: 0.466061 Apr 02 20:51:57.773768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 49/109] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Apr 2 20:51:57 2022] POST /compute/v2.1/flavors/1306064955/action => generated 124 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:51:57.797190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.799541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:57.808615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.815720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.827073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.833108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.836934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.840138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.848271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.849607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.868512 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ecb6a50e-390a-4d2f-824e-a1547e3fe7df tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.188650 Apr 02 20:51:57.873500 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 61/110] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:57.890831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-859c5ec8-f08e-4f96-acbf-845d5590b2c3 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.891978 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.891978 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:57.922073 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-859c5ec8-f08e-4f96-acbf-845d5590b2c3 tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1306064955" status: 202 len: 0 microversion: 2.1 time: 0.040747 Apr 02 20:51:57.926323 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 62/111] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:51:57 2022] DELETE /compute/v2.1/flavors/1306064955 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:51:57.933183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cee98355-5ea6-4a4e-916e-8110b7b2dc76 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d54bd040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:57.934130 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:57.934130 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:57.940379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee98355-5ea6-4a4e-916e-8110b7b2dc76 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.942442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee98355-5ea6-4a4e-916e-8110b7b2dc76 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.973668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee98355-5ea6-4a4e-916e-8110b7b2dc76 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:57.974353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee98355-5ea6-4a4e-916e-8110b7b2dc76 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:57.985188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cee98355-5ea6-4a4e-916e-8110b7b2dc76 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.054291 Apr 02 20:51:57.995886 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 63/112] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:58.001067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a3d02af6-7a49-4eae-96fb-7ee4b0df4a2c tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.093635 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a3d02af6-7a49-4eae-96fb-7ee4b0df4a2c tempest-FlavorsAccessNegativeTestJSON-488008481 tempest-FlavorsAccessNegativeTestJSON-488008481-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.093065 Apr 02 20:51:58.110488 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 64/113] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:57 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:58.124601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0239103d-575e-45c1-88f8-70aafea3d049 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d79b4040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.133683 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:58.133683 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:58.140333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0239103d-575e-45c1-88f8-70aafea3d049 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.147475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0239103d-575e-45c1-88f8-70aafea3d049 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.234994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0239103d-575e-45c1-88f8-70aafea3d049 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.114014 Apr 02 20:51:58.235619 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 65/114] 10.222.0.18 () {58 vars in 1178 bytes} [Sat Apr 2 20:51:58 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:58.263715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d54bd820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.273552 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:58.273552 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:58.282155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.286927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.288711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:58.305725 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d47dbc3-67be-4711-b041-f987d29897d0 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.528567 Apr 02 20:51:58.308321 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 50/115] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:57 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:58.344250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.344749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.400607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.401471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.417743 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ae6dc60-8474-4f71-b52a-4671ab1d1d8c tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.166353 Apr 02 20:51:58.420086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 66/116] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:51:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:58.430723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49db8156-83ac-4dd9-aa1d-85bf9a7173a6 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d55a1430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.431875 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:58.431875 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:58.434606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49db8156-83ac-4dd9-aa1d-85bf9a7173a6 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.435013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49db8156-83ac-4dd9-aa1d-85bf9a7173a6 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.478477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49db8156-83ac-4dd9-aa1d-85bf9a7173a6 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.479827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49db8156-83ac-4dd9-aa1d-85bf9a7173a6 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.496406 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49db8156-83ac-4dd9-aa1d-85bf9a7173a6 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.069878 Apr 02 20:51:58.509386 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 51/117] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:58.517858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0c32e5d4-c64d-485e-a594-0bf07f745635 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d54bd430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.519454 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:58.519454 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:51:58.522662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c32e5d4-c64d-485e-a594-0bf07f745635 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.523550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c32e5d4-c64d-485e-a594-0bf07f745635 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.569613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c32e5d4-c64d-485e-a594-0bf07f745635 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.571589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c32e5d4-c64d-485e-a594-0bf07f745635 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.589279 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0c32e5d4-c64d-485e-a594-0bf07f745635 tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.076404 Apr 02 20:51:58.590180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 67/118] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:51:58 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:51:58.610501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Calling method '.version_select at 0x7f54d55a13a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.611430 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:58.611430 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:58.612792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.613291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.686159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:58.687430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:58.698605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.699266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.700998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.703100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.706656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.708439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.750669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.758326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.773327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf06ea53-137a-4783-bb1a-447934983d1a tempest-HypervisorAdminTestJSON-1582609616 tempest-HypervisorAdminTestJSON-1582609616-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:51:58.789937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.792552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.793675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:58.795560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:58.824592 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.compute.rpcapi [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 02 20:51:58.827761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] Releasing lock "compute-rpcapi-router" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:51:58.912857 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0a90da9b-1801-4c45-bcae-f512a2f13abf None None] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.311925 Apr 02 20:51:58.918551 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 52/119] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Apr 2 20:51:58 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:51:59.035440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:59.044201 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c5fecd6-75f1-4fd9-ae69-875118bbfe93 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.362383 Apr 02 20:51:59.062928 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 68/120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:58 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:51:59.328598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:51:59.330583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:51:59.346371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:59.347799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:59.351851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:51:59.353312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:51:59.586245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7af933e-7e27-4d7e-82c7-4199bd24dd9d tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-572936004", "id": 1323991107, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:51:59.589269 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:51:59.589269 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:51:59.630802 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7af933e-7e27-4d7e-82c7-4199bd24dd9d tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.703592 Apr 02 20:51:59.634606 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 53/121] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:51:58 2022] POST /compute/v2.1/flavors => generated 448 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:51:59.825726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:51:59.850927 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be723b63-aa78-4047-acae-c40049cf42d7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.527046 Apr 02 20:51:59.852216 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 69/122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:51:59 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:00.090516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.091136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:00.101614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:00.102080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:00.102887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:00.106986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:00.307692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e7477ec6-dbdd-4e22-b564-e5b06cdc9a03 tempest-FlavorsV255TestJSON-1861828249 tempest-FlavorsV255TestJSON-1861828249-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.328943 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e7477ec6-dbdd-4e22-b564-e5b06cdc9a03 tempest-FlavorsV255TestJSON-1861828249 tempest-FlavorsV255TestJSON-1861828249-project] 10.222.0.18 "GET /compute/v2.1/flavors/1323991107" status: 200 len: 448 microversion: 2.55 time: 0.686938 Apr 02 20:52:00.329601 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 54/123] 10.222.0.18 () {60 vars in 1198 bytes} [Sat Apr 2 20:51:59 2022] GET /compute/v2.1/flavors/1323991107 => generated 448 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:52:00.342308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11348c75-aa6f-4d7e-bf18-ba6e937dfa6d tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] Action: 'update', calling method: .version_select at 0x7f54d7553430>, body: {"flavor": {"description": "new"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:00.369812 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:00.369812 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:00.419782 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11348c75-aa6f-4d7e-bf18-ba6e937dfa6d tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1323991107" status: 200 len: 449 microversion: 2.55 time: 0.081686 Apr 02 20:52:00.420911 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 55/124] 10.222.0.18 () {62 vars in 1218 bytes} [Sat Apr 2 20:52:00 2022] PUT /compute/v2.1/flavors/1323991107 => generated 449 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:00.432338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8840de8d-3535-4e5a-b9b2-94dbae209438 tempest-FlavorsV255TestJSON-1861828249 tempest-FlavorsV255TestJSON-1861828249-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.467394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:00.485897 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-44fd9acf-f861-4741-a65a-a864a6041156 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.409806 Apr 02 20:52:00.501901 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 70/125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:00 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:00.503067 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8840de8d-3535-4e5a-b9b2-94dbae209438 tempest-FlavorsV255TestJSON-1861828249 tempest-FlavorsV255TestJSON-1861828249-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.074976 Apr 02 20:52:00.507433 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 56/126] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:52:00 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:52:00.532739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa7eb736-1989-4bb3-9199-1fbbbec05249 tempest-FlavorsV255TestJSON-1861828249 tempest-FlavorsV255TestJSON-1861828249-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.628490 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa7eb736-1989-4bb3-9199-1fbbbec05249 tempest-FlavorsV255TestJSON-1861828249 tempest-FlavorsV255TestJSON-1861828249-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.100368 Apr 02 20:52:00.634378 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 71/127] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Apr 2 20:52:00 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:00.647185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78cabba2-dce1-42dc-a735-d7e4fb459197 tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.648360 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:00.648360 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:00.694228 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78cabba2-dce1-42dc-a735-d7e4fb459197 tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1323991107" status: 202 len: 0 microversion: 2.55 time: 0.050712 Apr 02 20:52:00.694887 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 57/128] 10.222.0.18 () {60 vars in 1201 bytes} [Sat Apr 2 20:52:00 2022] DELETE /compute/v2.1/flavors/1323991107 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:00.709835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe6cbe6b-4037-4f2f-81ee-0f06714ef7d7 tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.793848 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe6cbe6b-4037-4f2f-81ee-0f06714ef7d7 tempest-FlavorsV255TestJSON-1177624432 tempest-FlavorsV255TestJSON-1177624432-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.093156 Apr 02 20:52:00.795747 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 72/129] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:52:00 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:00.868421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:00.869422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:00.880963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:00.881742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:00.884801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:00.888079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:01.463847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:01.514144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:01.515312 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c3feaec-b42e-4c6f-a272-2a4aed367066 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.649603 Apr 02 20:52:01.515455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:01.519121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 58/130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:00 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:01.529556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:01.530326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:01.531347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:01.531964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:01.866387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:01.879217 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb1856af-b6b0-4cf1-89c1-581f98f5baac tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.375541 Apr 02 20:52:01.879816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 73/131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:01 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:02.327449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1258078105", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "1530115126", "adminPass": "***", "networks": [{"uuid": "ad76fa2d-1a20-484e-b4bb-76fd756272b5"}], "security_groups": [{"name": "tempest-securitygroup--1045426101"}], "key_name": "tempest-keypair-1511390929", "user_data": "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:02.533465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:02.534678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:02.541983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:02.542598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:02.543657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:02.544251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:02.675319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] validate_networks() for [('ad76fa2d-1a20-484e-b4bb-76fd756272b5', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:02.861733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:02.875250 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0aaa3865-500e-4d9c-bd33-0f6f6a6aa952 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.344593 Apr 02 20:52:02.877727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 74/132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:02 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:02.905378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:02.907008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:02.930938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:02.931755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:02.932789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:02.933631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:03.390078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:03.408848 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87834e68-c6ed-446a-ba0e-d3e853c8e5ff tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.513214 Apr 02 20:52:03.411129 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 75/133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:02 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:03.427678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f711af57-ed77-41e1-941e-05c5bda9fc7c req-eefcb579-571b-4e3a-90f9-7f115e7f8cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "956192a0-bfaa-49a0-ad2b-3fb4b6a2566f", "tag": "dc71895b-80e5-4b2a-850c-ab6d2e2a4e12"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:03.449326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f711af57-ed77-41e1-941e-05c5bda9fc7c req-eefcb579-571b-4e3a-90f9-7f115e7f8cda service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:03.457696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f711af57-ed77-41e1-941e-05c5bda9fc7c req-eefcb579-571b-4e3a-90f9-7f115e7f8cda service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:03.488242 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f711af57-ed77-41e1-941e-05c5bda9fc7c req-eefcb579-571b-4e3a-90f9-7f115e7f8cda service nova] Creating event network-changed:dc71895b-80e5-4b2a-850c-ab6d2e2a4e12 for instance 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f on nch1-master-1 Apr 02 20:52:03.502425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f711af57-ed77-41e1-941e-05c5bda9fc7c req-eefcb579-571b-4e3a-90f9-7f115e7f8cda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089269 Apr 02 20:52:03.504959 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 76/134] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:03.911205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:03.914082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:03.925849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:03.940184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:03.942174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:03.943603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:04.218547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:04.228104 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ece2099-f104-45f1-b074-4ddfb49b125b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.335892 Apr 02 20:52:04.251070 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 77/135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:03 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:04.426767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:04.427287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:04.436656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:04.437778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:04.438760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:04.445861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:04.596623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:04.597698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:04.599276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:04.600203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:04.600956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:04.612948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:04.613409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:04.614503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:04.616417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:04.710777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for project fde6bd005e3a4a25b63639832027ab85. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:04.714153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:04.726142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for user c42119999e6f40b487a7174dc5a7d617 and project fde6bd005e3a4a25b63639832027ab85. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:04.735716 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1218d47-1862-4a98-acdc-f132e887e7c1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.313017 Apr 02 20:52:04.738010 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 78/136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:04 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:04.761326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:52:04.767949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:52:04.857112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7fbeac2f-40ba-458b-bbdd-d999faed6ad9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.538507 Apr 02 20:52:04.858073 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 59/137] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:52:04.869495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c097620d-50ba-45aa-a877-4523b4b9e458 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:04.870127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c097620d-50ba-45aa-a877-4523b4b9e458 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:04.948325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c097620d-50ba-45aa-a877-4523b4b9e458 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:04.960221 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c097620d-50ba-45aa-a877-4523b4b9e458 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1265 microversion: 2.1 time: 0.094396 Apr 02 20:52:04.972420 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 79/138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:04 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:05.250094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:05.250734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:05.266886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.267357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:05.268155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.268634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:05.515298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:05.527742 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a12e7aa4-9863-4633-8f1d-6e29a95d2fd8 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.281344 Apr 02 20:52:05.538785 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 60/139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:05 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:05.757642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:05.758391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:05.765283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.765926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:05.766861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.767446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:05.832149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a052c15c-20db-410d-badf-7b3f8b97831b req-18fcd146-9931-4e96-8d14-f397caf384cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f8f353-82ba-4c3e-82f7-792315bda7c6", "name": "network-vif-plugged", "status": "completed", "tag": "7af56c27-53b5-4df3-9e0f-085bb8d51a15"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:05.854080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a052c15c-20db-410d-badf-7b3f8b97831b req-18fcd146-9931-4e96-8d14-f397caf384cc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.854548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a052c15c-20db-410d-badf-7b3f8b97831b req-18fcd146-9931-4e96-8d14-f397caf384cc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:05.867242 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a052c15c-20db-410d-badf-7b3f8b97831b req-18fcd146-9931-4e96-8d14-f397caf384cc service nova] Creating event network-vif-plugged:7af56c27-53b5-4df3-9e0f-085bb8d51a15 for instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 on nch2-master-1 Apr 02 20:52:05.874043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a052c15c-20db-410d-badf-7b3f8b97831b req-18fcd146-9931-4e96-8d14-f397caf384cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215817 Apr 02 20:52:05.878206 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 80/140] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:05.981283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:05.982484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:05.991603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.992976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:05.994840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:05.995451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:06.027605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:06.036734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1faf6027-e519-44a7-8b10-f076b11b50d6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.286040 Apr 02 20:52:06.041869 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 61/141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:05 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:06.111537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:06.124709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f98b94a1-0845-4cba-a971-fbb63b9bd96f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1269 microversion: 2.1 time: 0.146069 Apr 02 20:52:06.125664 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 81/142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:05 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:06.425679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cc7f5b5-5f3b-4189-9c83-095746f5c749 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Calling method '.version_select at 0x7f54d54838b0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:06.543247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:06.543958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:06.550190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:06.550714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:06.551564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:06.552081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:06.673047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cc7f5b5-5f3b-4189-9c83-095746f5c749 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 371 microversion: 2.1 time: 0.363340 Apr 02 20:52:06.675600 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 62/143] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 20:52:06 2022] GET /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:06.690293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd3bf612-2997-4058-a806-15ae5ddc427f tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Action: 'update', calling method: .version_select at 0x7f54d5502670>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:06.751200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:06.760497 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c79f876b-4f51-4f7a-8c24-6b0f1186d76b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.220552 Apr 02 20:52:06.770145 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 82/144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:06 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:06.852259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf612-2997-4058-a806-15ae5ddc427f tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:06.853458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf612-2997-4058-a806-15ae5ddc427f tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:06.854413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf612-2997-4058-a806-15ae5ddc427f tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:06.855025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd3bf612-2997-4058-a806-15ae5ddc427f tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:06.915999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd3bf612-2997-4058-a806-15ae5ddc427f tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 328 microversion: 2.1 time: 0.233410 Apr 02 20:52:06.916984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 63/145] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:06 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 328 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.021139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a1288c67-976e-4f2e-a0c9-a4becc808937 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Calling method '.version_select at 0x7f54d54b1e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.022538 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.022538 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.023655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a1288c67-976e-4f2e-a0c9-a4becc808937 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'a72be51adbcd4880a3c4b2e47759d16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9839c4966f3646a692929ca82a9a5fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.024519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a1288c67-976e-4f2e-a0c9-a4becc808937 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.025571 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a1288c67-976e-4f2e-a0c9-a4becc808937 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.183920 Apr 02 20:52:07.026095 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 83/146] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 20:52:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 185 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:52:07.039140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20e69f6b-da49-41b8-8587-fdfafc88951e tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Calling method '.version_select at 0x7f54d551d3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.040733 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.040733 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:07.042255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20e69f6b-da49-41b8-8587-fdfafc88951e tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'a72be51adbcd4880a3c4b2e47759d16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9839c4966f3646a692929ca82a9a5fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.043115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20e69f6b-da49-41b8-8587-fdfafc88951e tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.044642 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20e69f6b-da49-41b8-8587-fdfafc88951e tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.011733 Apr 02 20:52:07.046231 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 64/147] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:52:07.056261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-727c23e5-6d74-4884-be0f-e5f5227f2bc5 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Calling method '.version_select at 0x7f54d54f8700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.058051 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.058051 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:07.059164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-727c23e5-6d74-4884-be0f-e5f5227f2bc5 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'a72be51adbcd4880a3c4b2e47759d16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9839c4966f3646a692929ca82a9a5fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.059810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-727c23e5-6d74-4884-be0f-e5f5227f2bc5 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.060668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-727c23e5-6d74-4884-be0f-e5f5227f2bc5 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009393 Apr 02 20:52:07.061188 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 65/148] 10.222.0.18 () {58 vars in 1178 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:07.066707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.067510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:07.074390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.074853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.075641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.076111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.157329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-639479698", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:07.213426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:07.402234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.409723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a0c8cf4b-a1af-4ef2-9a89-739809c2599b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.347539 Apr 02 20:52:07.410287 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 66/149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:07.414091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:07.414616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:07.415347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:07.416362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:07.416803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:07.425557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.426005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.426800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.427239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.444815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Getting quotas for project d4e4c08f91e24bedb51356cd9e640749. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:07.449374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Getting quotas for user cf654deee6974ffa8cacea70192c8a90 and project d4e4c08f91e24bedb51356cd9e640749. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:07.461070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.utils [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] cores quota exceeded for d4e4c08f91e24bedb51356cd9e640749, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136518) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 02 20:52:07.461892 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Apr 02 20:52:07.462490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.463430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-89c7066c-9309-428e-9316-47a7846e28a3 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.425689 Apr 02 20:52:07.464019 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 84/150] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 427 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:07.468978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.469588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:07.475928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.476394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.477198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.477646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.536437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.544603 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4bc9e760-2565-41e5-b42d-597cc50b3167 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1269 microversion: 2.1 time: 0.079456 Apr 02 20:52:07.545163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 85/151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1269 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:07.583054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Calling method '.version_select at 0x7f54d54f8430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.583864 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.583864 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:07.585101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.585551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.597288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Calling method '.version_select at 0x7f54d55d34c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.598089 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.598089 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.599235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.599675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.605440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.605845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.614328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.614784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.615666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.616127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.622255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1d2ed14-8a43-4a4e-af00-cf86edea8bc1 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.210969 Apr 02 20:52:07.622821 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 67/152] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.627735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.627735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.627911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c01c4065-83cb-4f21-a43b-721a4eafa8ae tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Action: 'update', calling method: .version_select at 0x7f54d54f81f0>, body: {"quota_set": {"cores": 20}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:07.632478 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-813fda7a-1252-4bc5-a716-7e9b823ff6fd tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086356 Apr 02 20:52:07.633065 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 86/153] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.637427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f17d8fed-e9db-4b72-abe2-91c817282233 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Calling method '.version_select at 0x7f54d5612e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.638404 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.638404 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.639460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f17d8fed-e9db-4b72-abe2-91c817282233 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'a72be51adbcd4880a3c4b2e47759d16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9839c4966f3646a692929ca82a9a5fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.640098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f17d8fed-e9db-4b72-abe2-91c817282233 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.640912 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f17d8fed-e9db-4b72-abe2-91c817282233 tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.006964 Apr 02 20:52:07.642318 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 87/154] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:07.648538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Calling method '.version_select at 0x7f54d54b1670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.649402 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.649402 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.651049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.651500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.671943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.672392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.703465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.703925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.709755 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e10f379c-ada2-4b36-9e75-8f2d92260abf tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.066842 Apr 02 20:52:07.710313 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 88/155] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.716505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a09a9e6-09d6-4638-86c4-955f787716d7 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Calling method '.version_select at 0x7f54d54b1d30>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.716505 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.716505 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.717139 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2a09a9e6-09d6-4638-86c4-955f787716d7 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] HTTP exception thrown: Hypervisor with ID '2392ebbc-719a-4104-a6cd-daa33f7dc0c0' could not be found. Apr 02 20:52:07.717620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a09a9e6-09d6-4638-86c4-955f787716d7 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Returning 404 to user: Hypervisor with ID '2392ebbc-719a-4104-a6cd-daa33f7dc0c0' could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.718420 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2a09a9e6-09d6-4638-86c4-955f787716d7 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2392ebbc-719a-4104-a6cd-daa33f7dc0c0/uptime" status: 404 len: 123 microversion: 2.1 time: 0.007207 Apr 02 20:52:07.722840 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 89/156] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/2392ebbc-719a-4104-a6cd-daa33f7dc0c0/uptime => generated 123 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:07.723367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Calling method '.version_select at 0x7f54d545a550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.724158 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.724158 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.725324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.725788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.739755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.740212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.744827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c01c4065-83cb-4f21-a43b-721a4eafa8ae tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.745313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c01c4065-83cb-4f21-a43b-721a4eafa8ae tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.746112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c01c4065-83cb-4f21-a43b-721a4eafa8ae tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.746546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c01c4065-83cb-4f21-a43b-721a4eafa8ae tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.750135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.750589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.756176 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e880310d-9a3e-41b7-bdc3-b36fd94950c0 tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.036015 Apr 02 20:52:07.756784 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 90/157] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.761280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Calling method '.version_select at 0x7f54d54b1790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.762081 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.762081 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.763230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.763665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.778969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.779430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.789449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.789906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.796114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bea8433b-d9e8-4848-97d9-a3f48d5b97b3 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.038386 Apr 02 20:52:07.796725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 91/158] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.800421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c01c4065-83cb-4f21-a43b-721a4eafa8ae tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 329 microversion: 2.1 time: 0.176495 Apr 02 20:52:07.801026 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 68/159] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:07 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 329 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.805120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1ae76e07-a40c-4779-bd3e-79a96f3f268c tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Calling method '.version_select at 0x7f54d54ecca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.807123 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.807123 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.807123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ae76e07-a40c-4779-bd3e-79a96f3f268c tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.807841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ae76e07-a40c-4779-bd3e-79a96f3f268c tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.808797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.809422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:07.816064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.816549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.817326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.818040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.819974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ae76e07-a40c-4779-bd3e-79a96f3f268c tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:07.820628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ae76e07-a40c-4779-bd3e-79a96f3f268c tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:07.826638 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1ae76e07-a40c-4779-bd3e-79a96f3f268c tempest-HypervisorAdminUnderV252Test-1051560098 tempest-HypervisorAdminUnderV252Test-1051560098-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.028986 Apr 02 20:52:07.827297 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 92/160] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.831940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35ad0073-eefb-46ce-96fd-70c802de19ec tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Calling method '.version_select at 0x7f54d545a9d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.832418 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:07.832418 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:07.833611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35ad0073-eefb-46ce-96fd-70c802de19ec tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'a72be51adbcd4880a3c4b2e47759d16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9839c4966f3646a692929ca82a9a5fa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.834607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35ad0073-eefb-46ce-96fd-70c802de19ec tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.835398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35ad0073-eefb-46ce-96fd-70c802de19ec tempest-HypervisorAdminNegativeTestJSON-83629797 tempest-HypervisorAdminNegativeTestJSON-83629797-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.007215 Apr 02 20:52:07.836028 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 93/161] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:07.840720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13aeb2cf-203f-4ec3-97f4-9b3b81076f96 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Calling method '.version_select at 0x7f54d53fb8b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.919801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13aeb2cf-203f-4ec3-97f4-9b3b81076f96 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 371 microversion: 2.1 time: 0.082676 Apr 02 20:52:07.920394 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 94/162] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:07.924856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16531d78-f456-4ad2-a62f-7c0ed866a882 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Calling method '.version_select at 0x7f54d53fba60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:07.927076 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-16531d78-f456-4ad2-a62f-7c0ed866a882 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] HTTP exception thrown: Hypervisor with ID '83559fde-501c-4f2f-86f4-21023cc1772f' could not be found. Apr 02 20:52:07.928323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16531d78-f456-4ad2-a62f-7c0ed866a882 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] Returning 404 to user: Hypervisor with ID '83559fde-501c-4f2f-86f4-21023cc1772f' could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:07.929183 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16531d78-f456-4ad2-a62f-7c0ed866a882 tempest-HypervisorAdminNegativeTestJSON-1442180037 tempest-HypervisorAdminNegativeTestJSON-1442180037-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/83559fde-501c-4f2f-86f4-21023cc1772f" status: 404 len: 123 microversion: 2.1 time: 0.007843 Apr 02 20:52:07.929699 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 95/163] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/os-hypervisors/83559fde-501c-4f2f-86f4-21023cc1772f => generated 123 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:07.938390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8ff18e7-0bfe-4e56-8296-a5a4d922b998 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Action: 'update', calling method: .version_select at 0x7f54d5514f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:07.970500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:07.978080 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ca05cc4-e78a-4786-b844-64c920024c73 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1338 microversion: 2.1 time: 0.175943 Apr 02 20:52:07.978798 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 69/164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:07 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1338 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:08.229910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8ff18e7-0bfe-4e56-8296-a5a4d922b998 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.230402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8ff18e7-0bfe-4e56-8296-a5a4d922b998 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.231139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8ff18e7-0bfe-4e56-8296-a5a4d922b998 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.231573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8ff18e7-0bfe-4e56-8296-a5a4d922b998 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.290883 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8ff18e7-0bfe-4e56-8296-a5a4d922b998 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 328 microversion: 2.1 time: 0.356272 Apr 02 20:52:08.291907 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 96/165] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:07 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 328 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:08.390747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1968862288", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:08.437300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:08.438664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:08.465346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.465861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.469559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.470216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.474831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:08.723424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:08.741231 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00893880-bce5-4797-add1-f7f69e95b3f8 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.317994 Apr 02 20:52:08.741826 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 97/166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:08 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:08.753081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:08.758524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:08.765027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.765490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.766363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.766964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.850433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:08.864158 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-88cd8007-8e67-4a29-a3d8-4f049bc30429 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1317 microversion: 2.1 time: 0.115446 Apr 02 20:52:08.865262 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 98/167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:08 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1317 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:08.908761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:08.909385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:08.909854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:08.910446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:08.910867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:08.944114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.944619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.946849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:08.947515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:08.967715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Getting quotas for project d4e4c08f91e24bedb51356cd9e640749. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:08.974410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Getting quotas for user cf654deee6974ffa8cacea70192c8a90 and project d4e4c08f91e24bedb51356cd9e640749. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:08.997152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:08.997776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:09.007867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.008118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.utils [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] instances quota exceeded for d4e4c08f91e24bedb51356cd9e640749, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136517) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 02 20:52:09.008795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Apr 02 20:52:09.008910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.009396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:09.010130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.010326 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-522e50ce-bc28-41b4-8c8b-1cf69fa52c08 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.624230 Apr 02 20:52:09.010556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.010919 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 70/168] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:08 2022] POST /compute/v2.1/servers => generated 119 bytes in 626 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:52:09.029109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17babf7f-3ed3-4138-9acb-5709e5db435e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Action: 'update', calling method: .version_select at 0x7f54d54d38b0>, body: {"quota_set": {"instances": 10}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:09.274611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:09.285028 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1645ce3-b5a8-427f-b334-74b42dac638b tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1487 microversion: 2.1 time: 0.293641 Apr 02 20:52:09.286747 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 99/169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:08 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1487 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:09.305293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:09.308757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:09.316135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.317008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.318529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.319173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.522985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17babf7f-3ed3-4138-9acb-5709e5db435e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.524086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17babf7f-3ed3-4138-9acb-5709e5db435e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.526305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17babf7f-3ed3-4138-9acb-5709e5db435e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.527628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17babf7f-3ed3-4138-9acb-5709e5db435e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.614284 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17babf7f-3ed3-4138-9acb-5709e5db435e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 329 microversion: 2.1 time: 0.591646 Apr 02 20:52:09.615777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 71/170] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:09 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:09.628257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dedfc46c-6937-4798-82dd-9d3f3e735fcc tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Calling method '.version_select at 0x7f54d54d3e50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:09.897610 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dedfc46c-6937-4798-82dd-9d3f3e735fcc tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 371 microversion: 2.1 time: 0.274400 Apr 02 20:52:09.898889 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 72/171] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 20:52:09 2022] GET /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:09.904731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:09.905666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:09.912563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.913248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.914659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.915402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.964706 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4df3e8f-8c10-4791-8203-6ac9d11599c1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1638 microversion: 2.1 time: 0.663240 Apr 02 20:52:09.967629 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 100/172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:09 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1638 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:09.974745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:09.977267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:09.984218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.984775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:09.985646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:09.986285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.069411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:10.077229 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c952e77-b972-4da3-ba17-664549debf6b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1323 microversion: 2.1 time: 0.108171 Apr 02 20:52:10.077813 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 101/173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:09 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1323 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:10.092482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4346aedb-895a-4973-b3ab-3ab3ac862e92 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Action: 'update', calling method: .version_select at 0x7f54d53d14c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:10.181259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4346aedb-895a-4973-b3ab-3ab3ac862e92 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.182314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4346aedb-895a-4973-b3ab-3ab3ac862e92 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.183890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4346aedb-895a-4973-b3ab-3ab3ac862e92 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.184669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4346aedb-895a-4973-b3ab-3ab3ac862e92 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.248279 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4346aedb-895a-4973-b3ab-3ab3ac862e92 tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 325 microversion: 2.1 time: 0.162394 Apr 02 20:52:10.249127 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 102/174] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:10 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:10.254249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:10.254939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:10.267936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.268398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.269948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.270544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.313669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:52:10.329433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:10.341538 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-98a4fb16-8141-495e-9bb6-0079c513b835 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.441176 Apr 02 20:52:10.347438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 73/175] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:09 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:10.423882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1502664538", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:10.508820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:10.545599 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d21a8601-1945-476a-bb28-903749f28af9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 204 len: 0 microversion: 2.1 time: 0.294719 Apr 02 20:52:10.548242 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 103/176] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:52:10 2022] DELETE /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:10.559981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:10.561389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:10.573012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.573587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.575179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.575841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.777387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:10.786099 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2956fc25-b3d5-4fd1-b010-89da1d97c9d4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1493 microversion: 2.1 time: 0.233506 Apr 02 20:52:10.801300 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 104/177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:10 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:10.897577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:10.898216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:10.898851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:10.899392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:10.900051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:10.913343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.914302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.915325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:10.916719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:10.960427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Getting quotas for project d4e4c08f91e24bedb51356cd9e640749. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:10.968241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Getting quotas for user cf654deee6974ffa8cacea70192c8a90 and project d4e4c08f91e24bedb51356cd9e640749. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:10.988333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.utils [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] ram quota exceeded for d4e4c08f91e24bedb51356cd9e640749, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136517) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 02 20:52:10.989159 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Apr 02 20:52:10.990730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:10.991772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a6ed5ec-803c-4508-bb9d-428ac99a011b tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.572411 Apr 02 20:52:10.995188 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 74/178] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 576 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:11.004401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df7b37de-f6f9-42e5-8413-d5165962753e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Action: 'update', calling method: .version_select at 0x7f54d53fbc10>, body: {"quota_set": {"ram": 51200}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:11.094785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:11.095645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:11.106449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.107083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.107983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.109406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.270474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7b37de-f6f9-42e5-8413-d5165962753e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.271244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7b37de-f6f9-42e5-8413-d5165962753e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.272312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7b37de-f6f9-42e5-8413-d5165962753e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.273000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7b37de-f6f9-42e5-8413-d5165962753e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.348768 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df7b37de-f6f9-42e5-8413-d5165962753e tempest-QuotasAdminNegativeTest-330870327 tempest-QuotasAdminNegativeTest-330870327-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 200 len: 329 microversion: 2.1 time: 0.349149 Apr 02 20:52:11.350339 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 105/179] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:10 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 329 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:11.363356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b01e31c-3eda-4e85-888c-ef6d668c5847 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Action: 'update', calling method: .version_select at 0x7f54d53fb820>, body: {"quota_set": {"ram": 0}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:11.366713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b01e31c-3eda-4e85-888c-ef6d668c5847 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'cf654deee6974ffa8cacea70192c8a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4e4c08f91e24bedb51356cd9e640749', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:11.367752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b01e31c-3eda-4e85-888c-ef6d668c5847 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:11.368873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b01e31c-3eda-4e85-888c-ef6d668c5847 tempest-QuotasAdminNegativeTest-1052956590 tempest-QuotasAdminNegativeTest-1052956590-project] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749" status: 403 len: 116 microversion: 2.1 time: 0.010424 Apr 02 20:52:11.369897 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 106/180] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 20:52:11 2022] PUT /compute/v2.1/os-quota-sets/d4e4c08f91e24bedb51356cd9e640749 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:52:11.377069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:11.377901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:11.385328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.386091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.386963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.387469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.555713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:11.562918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:11.570584 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-af674e33-2a29-47ee-8ecf-24f4e4f729ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.199657 Apr 02 20:52:11.571154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 107/181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:11 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:11.581176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-426f1f52-cffd-4ab7-8c1c-df46b0a440f9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.480639 Apr 02 20:52:11.592057 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 75/182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:11 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:11.804114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:11.804818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:11.811870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.814504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:11.818286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:11.818902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:12.033378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-27205d53-91fc-4852-82c1-c00afe492c15 req-c14e0c12-5a3d-4aae-b3ed-c25df254ec39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e6da4-1b09-4731-9332-98dce9466b87", "tag": "94129b94-caea-4aa7-bc27-5f3cfd83ebcb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:12.054512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:12.059635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27205d53-91fc-4852-82c1-c00afe492c15 req-c14e0c12-5a3d-4aae-b3ed-c25df254ec39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:12.068804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27205d53-91fc-4852-82c1-c00afe492c15 req-c14e0c12-5a3d-4aae-b3ed-c25df254ec39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:12.082020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cca741b3-9da9-4d2e-bfb5-18f839062ec9 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1493 microversion: 2.1 time: 0.282637 Apr 02 20:52:12.082874 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 108/183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:11 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1493 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:12.127038 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-27205d53-91fc-4852-82c1-c00afe492c15 req-c14e0c12-5a3d-4aae-b3ed-c25df254ec39 service nova] Creating event network-changed:94129b94-caea-4aa7-bc27-5f3cfd83ebcb for instance 807e6da4-1b09-4731-9332-98dce9466b87 on nch1-master-1 Apr 02 20:52:12.137306 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-27205d53-91fc-4852-82c1-c00afe492c15 req-c14e0c12-5a3d-4aae-b3ed-c25df254ec39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111391 Apr 02 20:52:12.137902 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 76/184] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:12.588888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:12.590097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:12.600728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:12.602360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:12.611720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:12.613621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:12.615104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:12.616337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:12.617163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:12.617949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:12.620206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:12.622464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:12.860830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:12.869933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f74a8742-cfff-414e-81c4-b4bd3cdc7826 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.286524 Apr 02 20:52:12.871705 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 109/185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:12 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:13.087326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:13.097885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe08cce6-7624-4625-aa3d-ba4e2801a66f tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.502656 Apr 02 20:52:13.109387 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 77/186] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:12 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:13.142163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76aa08b1-2bae-49c9-a66a-185f86fc197d tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Action: 'create', calling method: .version_select at 0x7f54d528e430>, body: {"keypair": {"name": "tempest-keypair-1476600772", "type": "ssh", "user_id": "76911712017c4cf9a027988418f39970"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:13.158021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-76aa08b1-2bae-49c9-a66a-185f86fc197d tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:13.164335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-76aa08b1-2bae-49c9-a66a-185f86fc197d tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for user c6966eb0d5334c0aaa8cb1ddc36bb5dd and project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:13.274646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6315d9fe-a266-4d88-a172-21228819fcb3 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Action: 'update', calling method: .version_select at 0x7f54d551de50>, body: {"quota_set": {"ram": "5120"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:13.489612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6315d9fe-a266-4d88-a172-21228819fcb3 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.490252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6315d9fe-a266-4d88-a172-21228819fcb3 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.491617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6315d9fe-a266-4d88-a172-21228819fcb3 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.497958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6315d9fe-a266-4d88-a172-21228819fcb3 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.537886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-76aa08b1-2bae-49c9-a66a-185f86fc197d tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:13.543497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-76aa08b1-2bae-49c9-a66a-185f86fc197d tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for user c6966eb0d5334c0aaa8cb1ddc36bb5dd and project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:13.557980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76aa08b1-2bae-49c9-a66a-185f86fc197d tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.684954 Apr 02 20:52:13.558675 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 110/187] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Apr 2 20:52:12 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 686 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:52:13.563933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:13.564796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:13.571995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.572710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.573857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.574453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.630721 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6315d9fe-a266-4d88-a172-21228819fcb3 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2" status: 200 len: 240 microversion: 2.36 time: 0.519187 Apr 02 20:52:13.633088 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 78/188] 10.222.0.18 () {62 vars in 1302 bytes} [Sat Apr 2 20:52:13 2022] PUT /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2 => generated 240 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:13.645270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42369aad-7722-41ee-8ff1-91dc79a3fd3e tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Action: 'create', calling method: .version_select at 0x7f54d551d3a0>, body: {"keypair": {"name": "tempest-keypair-1980409150", "type": "ssh", "user_id": "76911712017c4cf9a027988418f39970"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:13.666790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-42369aad-7722-41ee-8ff1-91dc79a3fd3e tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:13.674203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61c0b07ac66748afbf2c5671b1adaf08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9fb7e0a29fc4b53825f8910b80bc992', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:13.678351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-42369aad-7722-41ee-8ff1-91dc79a3fd3e tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for user c6966eb0d5334c0aaa8cb1ddc36bb5dd and project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:13.682973 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49ab0742-d8eb-4299-8a11-fe515cd3c708 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 200 len: 1323 microversion: 2.1 time: 0.123031 Apr 02 20:52:13.685393 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 111/189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:13 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 1323 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:13.690718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96fd83ab-abe3-442f-b0c8-b67ecd01b304 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Calling method '.version_select at 0x7f54d528edc0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:13.885569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-42369aad-7722-41ee-8ff1-91dc79a3fd3e tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:13.889994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-42369aad-7722-41ee-8ff1-91dc79a3fd3e tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for user c6966eb0d5334c0aaa8cb1ddc36bb5dd and project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:13.904647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42369aad-7722-41ee-8ff1-91dc79a3fd3e tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 0.270137 Apr 02 20:52:13.905361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 79/190] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Apr 2 20:52:13 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 272 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:52:13.913368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:13.914022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:13.920730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.921181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.922714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.923366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.966596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96fd83ab-abe3-442f-b0c8-b67ecd01b304 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.967051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96fd83ab-abe3-442f-b0c8-b67ecd01b304 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.967914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96fd83ab-abe3-442f-b0c8-b67ecd01b304 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:13.968362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96fd83ab-abe3-442f-b0c8-b67ecd01b304 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:13.988556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96fd83ab-abe3-442f-b0c8-b67ecd01b304 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2/detail" status: 200 len: 672 microversion: 2.36 time: 0.301257 Apr 02 20:52:13.989180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 112/191] 10.222.0.18 () {60 vars in 1303 bytes} [Sat Apr 2 20:52:13 2022] GET /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2/detail => generated 672 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:14.001004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-373fa64a-1e8b-4fc7-bf71-d472473ed7a1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Calling method '.version_select at 0x7f54d53d1430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.011631 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-373fa64a-1e8b-4fc7-bf71-d472473ed7a1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1476600772?user_id=76911712017c4cf9a027988418f39970" status: 200 len: 706 microversion: 2.10 time: 0.016986 Apr 02 20:52:14.013283 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 113/192] 10.222.0.18 () {60 vars in 1339 bytes} [Sat Apr 2 20:52:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1476600772?user_id=76911712017c4cf9a027988418f39970 => generated 706 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:14.027036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11eb4674-8c0d-4878-99b0-c2654e1dedc1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Action: 'create', calling method: .version_select at 0x7f54d53d1280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1193409317", "type": "ssh"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:14.048883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-11eb4674-8c0d-4878-99b0-c2654e1dedc1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:14.053366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-11eb4674-8c0d-4878-99b0-c2654e1dedc1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for user c6966eb0d5334c0aaa8cb1ddc36bb5dd and project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:14.113768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:14.126806 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bc18757-db85-4fc9-aa9f-a27a9c8b5444 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.219307 Apr 02 20:52:14.129420 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 80/193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:13 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:14.151710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.152374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:14.159500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.160399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.161396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.162244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.324307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-11eb4674-8c0d-4878-99b0-c2654e1dedc1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:14.332306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-11eb4674-8c0d-4878-99b0-c2654e1dedc1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Getting quotas for user c6966eb0d5334c0aaa8cb1ddc36bb5dd and project 3b221652690d48439f5cfd605c190c09. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:14.348824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11eb4674-8c0d-4878-99b0-c2654e1dedc1 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.10 time: 0.327911 Apr 02 20:52:14.350112 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 114/194] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 20:52:14 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 330 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:52:14.356609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:14.357168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ded39477-8bb9-4f69-9ae1-9f0904dc650f req-f408358a-1311-4139-ac6f-b008320356cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f8f353-82ba-4c3e-82f7-792315bda7c6", "name": "network-vif-deleted", "tag": "7af56c27-53b5-4df3-9e0f-085bb8d51a15"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:14.366720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ded39477-8bb9-4f69-9ae1-9f0904dc650f req-f408358a-1311-4139-ac6f-b008320356cb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.367202 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-694eb721-3914-4e75-a7cb-6dc76d358973 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.233145 Apr 02 20:52:14.367844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ded39477-8bb9-4f69-9ae1-9f0904dc650f req-f408358a-1311-4139-ac6f-b008320356cb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.377655 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 81/195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:14 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:14.380200 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ded39477-8bb9-4f69-9ae1-9f0904dc650f req-f408358a-1311-4139-ac6f-b008320356cb service nova] Creating event network-vif-deleted:7af56c27-53b5-4df3-9e0f-085bb8d51a15 for instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 on nch2-master-1 Apr 02 20:52:14.382882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Action: 'update', calling method: .version_select at 0x7f54d5447e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:14.386529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ded39477-8bb9-4f69-9ae1-9f0904dc650f req-f408358a-1311-4139-ac6f-b008320356cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034846 Apr 02 20:52:14.387435 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 115/196] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:14.392711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e07fba24-2761-464f-8a84-3ef8f04b70e6 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Calling method '.version_select at 0x7f54d5280790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.395407 ncdv-master-1 devstack@n-api.service[136518]: WARNING oslo_db.sqlalchemy.utils [None req-e07fba24-2761-464f-8a84-3ef8f04b70e6 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Apr 02 20:52:14.403145 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e07fba24-2761-464f-8a84-3ef8f04b70e6 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs?user_id=76911712017c4cf9a027988418f39970" status: 200 len: 1114 microversion: 2.10 time: 0.013888 Apr 02 20:52:14.404640 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 116/197] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Apr 2 20:52:14 2022] GET /compute/v2.1/os-keypairs?user_id=76911712017c4cf9a027988418f39970 => generated 1114 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:14.413312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0208065c-f4d3-4ca0-a4a9-2bd7156976bc tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Calling method '.version_select at 0x7f54d54b1700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.445739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0208065c-f4d3-4ca0-a4a9-2bd7156976bc tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1193409317" status: 204 len: 0 microversion: 2.10 time: 0.036021 Apr 02 20:52:14.446544 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 117/198] 10.222.0.18 () {60 vars in 1324 bytes} [Sat Apr 2 20:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1193409317 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 02 20:52:14.456867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ff803ae-d497-477e-ac3f-d5ec6eb62ad0 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Calling method '.version_select at 0x7f54d53af4c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.476706 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ff803ae-d497-477e-ac3f-d5ec6eb62ad0 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980409150?user_id=76911712017c4cf9a027988418f39970" status: 204 len: 0 microversion: 2.10 time: 0.025022 Apr 02 20:52:14.481025 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 118/199] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1980409150?user_id=76911712017c4cf9a027988418f39970 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:52:14.486535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2f9bf1ef-50f4-4fc6-bb25-c19508d9b357 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] Calling method '.version_select at 0x7f54d5280f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.506030 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2f9bf1ef-50f4-4fc6-bb25-c19508d9b357 tempest-KeyPairsV210TestJSON-1785280144 tempest-KeyPairsV210TestJSON-1785280144-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476600772?user_id=76911712017c4cf9a027988418f39970" status: 204 len: 0 microversion: 2.10 time: 0.022909 Apr 02 20:52:14.506781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 119/200] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:52:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476600772?user_id=76911712017c4cf9a027988418f39970 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:52:14.680034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.680709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.681768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.682386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.703434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.704439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:14.711308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.712006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.713967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.714683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.723015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.723667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.724673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.725123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.730405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] HTTP exception thrown: Instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 could not be found. Apr 02 20:52:14.731006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Returning 404 to user: Instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:14.731988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-15762f67-ac39-41f1-9fac-e356441ccdb4 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 404 len: 111 microversion: 2.1 time: 0.032988 Apr 02 20:52:14.733024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 120/201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:14 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:52:14.746750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3df312bf-9324-42db-9a45-6bb91afdc966 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:14.749170 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:14.749170 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:14.761466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3df312bf-9324-42db-9a45-6bb91afdc966 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:14.762126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3df312bf-9324-42db-9a45-6bb91afdc966 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:14.799061 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ea5be8b-babf-4458-82fa-e67b1c8212b9 tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2?user_id=54fd082c6add472abcda7348d1b26b19" status: 200 len: 240 microversion: 2.36 time: 0.419941 Apr 02 20:52:14.800142 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 82/202] 10.222.0.18 () {62 vars in 1383 bytes} [Sat Apr 2 20:52:14 2022] PUT /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2?user_id=54fd082c6add472abcda7348d1b26b19 => generated 240 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:14.815613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c83c05b5-b3c2-4d4c-9b03-6fa2a31cc0ee tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] Calling method '.version_select at 0x7f54d551de50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.901247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3df312bf-9324-42db-9a45-6bb91afdc966 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.163637 Apr 02 20:52:14.901841 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 121/203] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:52:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:14.911925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e02e8e7-1e59-4396-a3d3-789e6c1a7f36 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:14.912727 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:14.912727 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:14.940923 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e02e8e7-1e59-4396-a3d3-789e6c1a7f36 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.032097 Apr 02 20:52:14.941321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 122/204] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:14 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:14.955188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4a44c9e-1b70-4c53-9de2-b0e3c22a73d8 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-889287489"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:14.956723 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:14.956723 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:14.957769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-f4a44c9e-1b70-4c53-9de2-b0e3c22a73d8 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid cedd05b1-3f33-463e-aa72-f0b503aecd81 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:14.988702 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4a44c9e-1b70-4c53-9de2-b0e3c22a73d8 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037979 Apr 02 20:52:14.989834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 123/205] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:14 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:15.005234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0b7f35a-7364-42c7-8702-d40c9fea5a4d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.007655 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.007655 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.019805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0b7f35a-7364-42c7-8702-d40c9fea5a4d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.020021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0b7f35a-7364-42c7-8702-d40c9fea5a4d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.136154 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c83c05b5-b3c2-4d4c-9b03-6fa2a31cc0ee tempest-QuotasAdminTestV236-1594641617 tempest-QuotasAdminTestV236-1594641617-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2?user_id=54fd082c6add472abcda7348d1b26b19" status: 200 len: 282 microversion: 2.36 time: 0.325122 Apr 02 20:52:15.136769 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 83/206] 10.222.0.18 () {60 vars in 1363 bytes} [Sat Apr 2 20:52:14 2022] GET /compute/v2.1/os-quota-sets/8adb188035954ff490370ac2cea6b9e2?user_id=54fd082c6add472abcda7348d1b26b19 => generated 282 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:15.158253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:15.159433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:15.173305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.175378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.178014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.179301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.182339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0b7f35a-7364-42c7-8702-d40c9fea5a4d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.184689 Apr 02 20:52:15.182942 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 124/207] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:52:14 2022] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.198151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4f234c22-0b15-48d7-8803-2346fd48b02b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:15.198957 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.198957 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.207038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4f234c22-0b15-48d7-8803-2346fd48b02b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.017699 Apr 02 20:52:15.208014 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 125/208] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 20:52:15 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.219572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4932ebaa-a960-4b7f-bd08-90cc9a228c52 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.221088 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.221088 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.230750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4932ebaa-a960-4b7f-bd08-90cc9a228c52 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.231428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4932ebaa-a960-4b7f-bd08-90cc9a228c52 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.362308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4932ebaa-a960-4b7f-bd08-90cc9a228c52 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.147311 Apr 02 20:52:15.362918 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 126/209] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:52:15 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.376004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b8c3747-2779-4ebf-be4c-43b9a5a8eb8f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:15.376848 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.376848 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.416332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:15.423570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b8c3747-2779-4ebf-be4c-43b9a5a8eb8f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.052981 Apr 02 20:52:15.426852 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 127/210] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:15 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:15.433339 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd83ad99-ed55-4d81-9f87-3e5efc72099f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.284571 Apr 02 20:52:15.433764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:15.434613 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 84/211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:15 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:15.440996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45050f23-a126-49fb-8c80-d17a0e37d250 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1639200270"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.443867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:15.444554 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.444554 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:15.447484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.aggregate [None req-45050f23-a126-49fb-8c80-d17a0e37d250 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid bcea2264-104c-4224-af1b-df8e2dd6ea7e for aggregate {{(pid=136517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:15.451506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.451506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.452369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.452836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.501344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45050f23-a126-49fb-8c80-d17a0e37d250 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065018 Apr 02 20:52:15.513207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 85/212] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.522094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8695a353-9622-4d08-8962-cb9ed850b520 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.524650 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.524650 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:15.534115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8695a353-9622-4d08-8962-cb9ed850b520 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.534621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8695a353-9622-4d08-8962-cb9ed850b520 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.616800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:15.626826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-999bb438-db27-4e72-81b1-a9c2d981a44c tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.198627 Apr 02 20:52:15.627511 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 128/213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:15 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:15.676002 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8695a353-9622-4d08-8962-cb9ed850b520 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.161575 Apr 02 20:52:15.676652 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 86/214] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:52:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.687360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4534d3a5-c50b-47cd-b39b-2d9c101d5e23 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:15.688417 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.688417 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.696797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4534d3a5-c50b-47cd-b39b-2d9c101d5e23 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.013083 Apr 02 20:52:15.697998 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 129/215] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:52:15 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.707579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ce32175c-979d-41ae-b42c-d165634b1cce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.708894 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.708894 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:15.718267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce32175c-979d-41ae-b42c-d165634b1cce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.718729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce32175c-979d-41ae-b42c-d165634b1cce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:15.828484 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ce32175c-979d-41ae-b42c-d165634b1cce tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.124571 Apr 02 20:52:15.829355 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 87/216] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Apr 2 20:52:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.843412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ccb66f5a-880d-4590-b569-7a17f974f4d2 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:15.844185 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.844185 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.872486 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ccb66f5a-880d-4590-b569-7a17f974f4d2 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.032938 Apr 02 20:52:15.873098 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 130/217] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:15 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:15.883157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d045720b-6ddd-4ec4-a5d7-599b0071e85a tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-695995172"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.884389 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.884389 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:15.886443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.aggregate [None req-d045720b-6ddd-4ec4-a5d7-599b0071e85a tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid ce3f224b-4f13-481e-a1c7-4ab502a7ba0c for aggregate {{(pid=136517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:15.908095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d045720b-6ddd-4ec4-a5d7-599b0071e85a tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.028542 Apr 02 20:52:15.909154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 88/218] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:15.919923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d149c81-c40f-4269-87f6-5a383800658b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:15.921309 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:15.921309 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:15.935806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d149c81-c40f-4269-87f6-5a383800658b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:15.936264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d149c81-c40f-4269-87f6-5a383800658b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.052282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d149c81-c40f-4269-87f6-5a383800658b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.136816 Apr 02 20:52:16.053120 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 131/219] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:15 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:16.064516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6db59f9-f3d2-47c3-a5e3-c53a9b6fc673 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.065826 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.065826 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.075176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6db59f9-f3d2-47c3-a5e3-c53a9b6fc673 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.075710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6db59f9-f3d2-47c3-a5e3-c53a9b6fc673 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.199094 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6db59f9-f3d2-47c3-a5e3-c53a9b6fc673 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.139134 Apr 02 20:52:16.199963 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 89/220] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:16.212215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-87913ce8-079e-4eeb-ac66-11c3fec22082 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:16.217306 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.217306 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.249066 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-87913ce8-079e-4eeb-ac66-11c3fec22082 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.042708 Apr 02 20:52:16.255499 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 90/221] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:16 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:16.265636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-592b35ae-e9f5-42cb-a0ae-413bbf0799c0 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2025666539"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.267792 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.267792 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.269729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.aggregate [None req-592b35ae-e9f5-42cb-a0ae-413bbf0799c0 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid 4d98334b-6dd9-405d-ae0c-f9d9718aaea7 for aggregate {{(pid=136517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:16.306928 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-592b35ae-e9f5-42cb-a0ae-413bbf0799c0 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050132 Apr 02 20:52:16.319292 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 91/222] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:16.329218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3b90b3a-4ff7-4595-a7d5-4ce6741501f3 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-57875232"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.331832 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.331832 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.332751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.aggregate [None req-e3b90b3a-4ff7-4595-a7d5-4ce6741501f3 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid b6278d37-067f-40c7-ae92-d40c7097c5ad for aggregate {{(pid=136517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:16.361033 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e3b90b3a-4ff7-4595-a7d5-4ce6741501f3 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.039106 Apr 02 20:52:16.363828 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 92/223] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:16.370795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0a8b726-470a-4643-80a6-15c9b65ee80f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:16.373487 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.373487 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.424646 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0a8b726-470a-4643-80a6-15c9b65ee80f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.058174 Apr 02 20:52:16.427241 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 93/224] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:16 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:16.448608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45f0e8fb-5377-4cf5-af97-56afbc088e25 tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] Action: 'create', calling method: .version_select at 0x7f54d54b1e50>, body: {"security_group": {"name": "tempest-securitygroup-1264301081", "description": "tempest-description-1672593002"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.452032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-474813c8-5e97-43d3-a493-d572cc9b1a92 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.453631 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.453631 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.468363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-474813c8-5e97-43d3-a493-d572cc9b1a92 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.468905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-474813c8-5e97-43d3-a493-d572cc9b1a92 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.601678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-474813c8-5e97-43d3-a493-d572cc9b1a92 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 241 microversion: 2.1 time: 0.173087 Apr 02 20:52:16.602704 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 94/225] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:16.609271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b887b52-b291-460b-a60a-8a6b7fbb5ffd tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:16.610752 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.610752 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:16.638572 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-9b887b52-b291-460b-a60a-8a6b7fbb5ffd tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Apr 02 20:52:16.639025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b887b52-b291-460b-a60a-8a6b7fbb5ffd tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:16.639861 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b887b52-b291-460b-a60a-8a6b7fbb5ffd tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.036083 Apr 02 20:52:16.648877 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 95/226] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:16 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:16.655764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:16.658931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:16.677158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.677877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.679119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.680054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.802878 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-45f0e8fb-5377-4cf5-af97-56afbc088e25 tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.656440 Apr 02 20:52:16.803623 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 132/227] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:16.809793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-72197db1-9fa5-4da8-aade-73521ef11b53 req-69726637-45c8-4e02-91a6-a55409028889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956192a0-bfaa-49a0-ad2b-3fb4b6a2566f", "name": "network-vif-plugged", "status": "completed", "tag": "dc71895b-80e5-4b2a-850c-ab6d2e2a4e12"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.840795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-72197db1-9fa5-4da8-aade-73521ef11b53 req-69726637-45c8-4e02-91a6-a55409028889 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.841839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-72197db1-9fa5-4da8-aade-73521ef11b53 req-69726637-45c8-4e02-91a6-a55409028889 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.885831 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-72197db1-9fa5-4da8-aade-73521ef11b53 req-69726637-45c8-4e02-91a6-a55409028889 service nova] Creating event network-vif-plugged:dc71895b-80e5-4b2a-850c-ab6d2e2a4e12 for instance 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f on nch1-master-1 Apr 02 20:52:16.886405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:16.892195 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-72197db1-9fa5-4da8-aade-73521ef11b53 req-69726637-45c8-4e02-91a6-a55409028889 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086272 Apr 02 20:52:16.892849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 133/228] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:16.895572 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc54d068-fb6c-42a2-8ff1-d3d7bf1644d3 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.245500 Apr 02 20:52:16.896147 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 96/229] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:16 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:16.909297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69d2f38f-cc4d-4c83-a1d2-cb73c9ef03df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.910618 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.910618 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:16.911465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69d2f38f-cc4d-4c83-a1d2-cb73c9ef03df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'f3407b4401294ecb8b01a81ef19dd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f55ac7e48c4634ba63ef1bec31a1de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:16.912106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69d2f38f-cc4d-4c83-a1d2-cb73c9ef03df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:16.912944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69d2f38f-cc4d-4c83-a1d2-cb73c9ef03df tempest-AggregatesAdminNegativeTestJSON-1126187670 tempest-AggregatesAdminNegativeTestJSON-1126187670-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.017641 Apr 02 20:52:16.913469 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 134/230] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:16.918808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8fa2efe-2518-4030-b898-aacdb38dec46 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:16.919790 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:16.919790 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:16.923750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:16.924645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:16.934225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e8fa2efe-2518-4030-b898-aacdb38dec46 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Apr 02 20:52:16.935254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8fa2efe-2518-4030-b898-aacdb38dec46 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:16.936693 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e8fa2efe-2518-4030-b898-aacdb38dec46 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.021889 Apr 02 20:52:16.937373 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 135/231] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:16 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:16.947913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e369118f-5988-43eb-85df-e25eafb35025 tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] Action: 'create', calling method: .version_select at 0x7f54d5357b80>, body: {"security_group": {"name": "tempest-securitygroup-53673134", "description": "tempest-description-900208683"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:16.949138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.950305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:16.952013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:16.953610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:17.138021 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e369118f-5988-43eb-85df-e25eafb35025 tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.194850 Apr 02 20:52:17.145391 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 136/232] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:52:16 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.145391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7b08e1d-59c8-4afc-ac94-77da01f9f654 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.161313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7b08e1d-59c8-4afc-ac94-77da01f9f654 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:17.161509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7b08e1d-59c8-4afc-ac94-77da01f9f654 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:17.180123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:17.189402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ef7dc4a-036f-413d-bc48-190b3e9af9cc tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.292006 Apr 02 20:52:17.201068 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 97/233] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:16 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:17.205752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca21c432-adc0-48f8-bd4e-2ea460d73949 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-91617477", "name": "tempest-test_aggregate-373797901"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.227146 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.227146 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:17.228491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.aggregate [None req-ca21c432-adc0-48f8-bd4e-2ea460d73949 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid 7bf464ea-9b7a-4318-b95a-f4897164fa8e for aggregate {{(pid=136517) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:17.276434 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca21c432-adc0-48f8-bd4e-2ea460d73949 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.074197 Apr 02 20:52:17.277097 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 98/234] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.315678 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7b08e1d-59c8-4afc-ac94-77da01f9f654 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 226 microversion: 2.1 time: 0.175041 Apr 02 20:52:17.317512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 137/235] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates/12/action => generated 226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.324418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46a0fb3c-634e-42ef-9020-3264eb8e2424 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.325981 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.325981 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.359515 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46a0fb3c-634e-42ef-9020-3264eb8e2424 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.040628 Apr 02 20:52:17.360592 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 138/236] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:17 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:17.372011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f59f4cb-7792-4c38-aaca-a8e8e34f638b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.372860 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.372860 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.399456 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f59f4cb-7792-4c38-aaca-a8e8e34f638b tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.032329 Apr 02 20:52:17.400799 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 139/237] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:17 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:17.407385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e3e4d3bd-5d09-438d-ac26-a51302c6cf1d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.408651 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.408651 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.416175 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e3e4d3bd-5d09-438d-ac26-a51302c6cf1d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Apr 02 20:52:17.417253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e3e4d3bd-5d09-438d-ac26-a51302c6cf1d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:17.418721 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e3e4d3bd-5d09-438d-ac26-a51302c6cf1d tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.016656 Apr 02 20:52:17.422548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 140/238] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:17 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:17.427399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e1464f2-c5c5-4804-ba50-94f93e060b0a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-454957642"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.428997 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.428997 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.430504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-4e1464f2-c5c5-4804-ba50-94f93e060b0a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Generated uuid 06e0774a-a23f-4ce2-8196-7a4f16cc0866 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:17.491592 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e1464f2-c5c5-4804-ba50-94f93e060b0a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069836 Apr 02 20:52:17.492198 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 141/239] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.503300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d620ac29-29ef-4562-96b6-133d67a3ace1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.504053 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.504053 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.517771 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d620ac29-29ef-4562-96b6-133d67a3ace1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Apr 02 20:52:17.518762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d620ac29-29ef-4562-96b6-133d67a3ace1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:17.519824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d620ac29-29ef-4562-96b6-133d67a3ace1 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.026646 Apr 02 20:52:17.520884 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 142/240] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:17 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:17.526601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5a955de-56e2-464f-a783-0bfbde2649ea tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1568317709"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.528669 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.528669 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.529870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-b5a955de-56e2-464f-a783-0bfbde2649ea tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Generated uuid 06466899-4f1e-4ff0-b9d3-8025f88f024e for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:17.560362 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5a955de-56e2-464f-a783-0bfbde2649ea tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.038066 Apr 02 20:52:17.561758 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 143/241] 10.222.0.18 () {62 vars in 1204 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:17.569708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.571219 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.571219 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.581652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:17.582316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:17.590489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:17.590959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:17.608125 ncdv-master-1 devstack@n-api.service[136518]: ERROR nova.api.openstack.compute.aggregates [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Failed to remove host nonexist_host from aggregate 14. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Apr 02 20:52:17.608861 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 14 Apr 02 20:52:17.609554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 14 {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:17.610529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2fc03e8-8dfa-480b-9787-a00160712b3a tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/14/action" status: 404 len: 94 microversion: 2.1 time: 0.047090 Apr 02 20:52:17.611878 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 144/242] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates/14/action => generated 94 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:17.626999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-01e64443-c36b-4120-b8cc-01bbaaa4db77 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-867614534"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.628389 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.628389 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.629462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-01e64443-c36b-4120-b8cc-01bbaaa4db77 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid 0e5111ef-b761-4358-b4d8-c491715ac6cd for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:17.638813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc81201a-6377-421f-89f9-240d3fe3273c tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Action: 'create', calling method: .version_select at 0x7f54d5433430>, body: {"security_group": {"name": "tempest-securitygroup-1236863135", "description": "tempest-description-1860152754"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.660112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-01e64443-c36b-4120-b8cc-01bbaaa4db77 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046828 Apr 02 20:52:17.660904 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 145/243] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.666001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08341f80-5dd3-425d-b40a-82c0e5ae5cc9 tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1672242984"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.751052 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.751052 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.780792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08341f80-5dd3-425d-b40a-82c0e5ae5cc9 tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/15" status: 200 len: 300 microversion: 2.41 time: 0.118100 Apr 02 20:52:17.781799 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 146/244] 10.222.0.18 () {62 vars in 1212 bytes} [Sat Apr 2 20:52:17 2022] PUT /compute/v2.1/os-aggregates/15 => generated 300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:17.786978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4050ec66-6e1f-4c0a-bd48-bc9904680ae8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.787818 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.787818 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.814400 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4050ec66-6e1f-4c0a-bd48-bc9904680ae8 tempest-AggregatesAdminNegativeTestJSON-979818286 tempest-AggregatesAdminNegativeTestJSON-979818286-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.031340 Apr 02 20:52:17.816055 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 147/245] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:17 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:17.822190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ef459ab-f528-4448-8c28-18dbf2a6b0ad tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.824055 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.824055 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.834309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ef459ab-f528-4448-8c28-18dbf2a6b0ad tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.017194 Apr 02 20:52:17.835224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 148/246] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:17 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.839898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da720149-29f6-44f8-a2c0-a0913984fb97 tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:17.841118 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.841118 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.850372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da720149-29f6-44f8-a2c0-a0913984fb97 tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 300 microversion: 2.41 time: 0.013853 Apr 02 20:52:17.851396 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 149/247] 10.222.0.18 () {60 vars in 1192 bytes} [Sat Apr 2 20:52:17 2022] GET /compute/v2.1/os-aggregates/15 => generated 300 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:17.856801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-440065e6-e27e-417f-85a9-553588418b2b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.858190 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.858190 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.886644 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-440065e6-e27e-417f-85a9-553588418b2b tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.033381 Apr 02 20:52:17.887838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 150/248] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:17.895466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-582f9988-f160-41bf-bf92-9a8f7b9cc6be tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:17.897077 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:17.897077 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:17.912203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-582f9988-f160-41bf-bf92-9a8f7b9cc6be tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:17.912581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-582f9988-f160-41bf-bf92-9a8f7b9cc6be tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:18.095325 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-582f9988-f160-41bf-bf92-9a8f7b9cc6be tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 315 microversion: 2.41 time: 0.205145 Apr 02 20:52:18.102221 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 151/249] 10.222.0.18 () {62 vars in 1234 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-aggregates/15/action => generated 315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:18.110930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0464ad7f-1dcf-4e26-ac8b-31d4d16ab293 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:18.113821 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:18.113821 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:18.126750 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0464ad7f-1dcf-4e26-ac8b-31d4d16ab293 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.026120 Apr 02 20:52:18.126750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 152/250] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:52:18 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:18.131857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:18.133603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:18.144084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:18.144753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:18.145995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:18.146784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:18.209073 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc81201a-6377-421f-89f9-240d3fe3273c tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.930841 Apr 02 20:52:18.210087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 99/251] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:52:17 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:18.216838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecd5a68d-2cf2-46af-97b8-0daaab87f97d tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:18.219165 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:18.219165 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:18.242455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd5a68d-2cf2-46af-97b8-0daaab87f97d tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:18.244007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd5a68d-2cf2-46af-97b8-0daaab87f97d tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:18.463375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecd5a68d-2cf2-46af-97b8-0daaab87f97d tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 300 microversion: 2.41 time: 0.249206 Apr 02 20:52:18.464420 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 100/252] 10.222.0.18 () {62 vars in 1234 bytes} [Sat Apr 2 20:52:18 2022] POST /compute/v2.1/os-aggregates/15/action => generated 300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:18.469899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:18.472739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b70b1472-3b59-48e5-8a58-7372654fcdd0 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:18.473890 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:18.473890 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:18.479970 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1a52c0d-7adf-4bab-85e2-488016abee36 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1318 microversion: 2.1 time: 0.353900 Apr 02 20:52:18.483343 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 153/253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:18 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:18.500191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:18.508041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:18.510130 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b70b1472-3b59-48e5-8a58-7372654fcdd0 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.038800 Apr 02 20:52:18.510780 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 101/254] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:18 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:18.521582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:18.521759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4354345e-e672-4c38-9a9f-6b1bec74ae12 tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Action: 'create', calling method: .version_select at 0x7f54d5433040>, body: {"security_group": {"name": "tempest-securitygroup-3950191", "description": "tempest-description-1473618981"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:18.522503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:18.523793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:18.524480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:18.812546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:18.830964 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9e251e50-2b81-454e-b95f-9b35be87362d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.344710 Apr 02 20:52:18.831765 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 154/255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:18 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:18.841201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-24617a7f-328b-4e58-a455-1d6614036d60 tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:18.841201 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:18.841201 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:18.891376 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-24617a7f-328b-4e58-a455-1d6614036d60 tempest-AggregatesAdminTestV241-223447751 tempest-AggregatesAdminTestV241-223447751-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.41 time: 0.058166 Apr 02 20:52:18.892751 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 155/256] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Apr 2 20:52:18 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:18.908661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18881f3e-7391-4c8a-94ee-ea2acb49c7b5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1439440269", "availability_zone": "tempest-test_az-147645828"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:18.911480 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:18.911480 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:18.913193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-18881f3e-7391-4c8a-94ee-ea2acb49c7b5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid fcbbf3a5-2abb-4e89-a706-25c99da112fc for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:18.957236 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18881f3e-7391-4c8a-94ee-ea2acb49c7b5 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.063186 Apr 02 20:52:18.960487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 156/257] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Apr 2 20:52:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:18.976643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ff7f80a-7190-4275-8d26-1665699e4a6f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1439440269_new", "availability_zone": "tempest-test_az-147645828_new"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:18.979500 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:18.979500 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:19.060287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ff7f80a-7190-4275-8d26-1665699e4a6f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.063563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ff7f80a-7190-4275-8d26-1665699e4a6f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.095841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4354345e-e672-4c38-9a9f-6b1bec74ae12 tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.578396 Apr 02 20:52:19.097054 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 102/258] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:52:18 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:19.107689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Calling method '.version_select at 0x7f54d53fa820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.141849 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ff7f80a-7190-4275-8d26-1665699e4a6f tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.160674 Apr 02 20:52:19.142532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 157/259] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Apr 2 20:52:18 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:19.163792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc1ecf4d-3bab-49bc-9d9f-0ecdfd3a72ac tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.164663 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:19.164663 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:19.193458 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc1ecf4d-3bab-49bc-9d9f-0ecdfd3a72ac tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.042788 Apr 02 20:52:19.199272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 158/260] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:52:19 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:19.208886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b75cc31-6ee9-4d23-aa90-de852d40cd1e tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.210961 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:19.210961 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:19.266682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b75cc31-6ee9-4d23-aa90-de852d40cd1e tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.064388 Apr 02 20:52:19.273622 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 159/261] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:19 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:19.282318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b7320e98-fe01-47e5-8980-3ee6833d8ad9 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-646783719"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:19.286303 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:19.286303 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:19.289807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-b7320e98-fe01-47e5-8980-3ee6833d8ad9 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Generated uuid a8bdeddb-18a2-4a25-ab97-bb3e392cf1b9 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 20:52:19.348498 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b7320e98-fe01-47e5-8980-3ee6833d8ad9 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073219 Apr 02 20:52:19.349297 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 160/262] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 20:52:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:19.361717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fac247f4-93e0-4712-be0f-f0953b60c963 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.362481 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:19.362481 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:19.381951 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fac247f4-93e0-4712-be0f-f0953b60c963 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.023711 Apr 02 20:52:19.382541 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 161/263] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:52:19 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:19.394540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d9f7744-85ab-441d-8d61-20363e1cdd79 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.395328 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:19.395328 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:19.473987 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d9f7744-85ab-441d-8d61-20363e1cdd79 tempest-AggregatesAdminTestJSON-1327216345 tempest-AggregatesAdminTestJSON-1327216345-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.084196 Apr 02 20:52:19.475336 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 162/264] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:19 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 20:52:19.484921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.486287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:19.499059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.509454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.510716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.511308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.540124 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] HTTP exception thrown: Instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 could not be found. Apr 02 20:52:19.541612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Returning 404 to user: Instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:19.542600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26941d2d-afd8-4dac-b842-11405c3a8cf7 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 404 len: 111 microversion: 2.1 time: 0.061570 Apr 02 20:52:19.555412 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 163/265] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:52:19 2022] DELETE /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:19.564994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.570259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:19.585928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.586653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.588137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.588810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.769657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:19.778637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0debe238-12aa-4450-81a4-a8fc4b2d902a tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1467 microversion: 2.1 time: 0.221701 Apr 02 20:52:19.780481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 164/266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:19 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1467 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:19.786064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:19.786941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] [instance: 38f8f353-82ba-4c3e-82f7-792315bda7c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:19.795579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.800435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.801857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:19.802575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:19.832866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] HTTP exception thrown: Instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 could not be found. Apr 02 20:52:19.834220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] Returning 404 to user: Instance 38f8f353-82ba-4c3e-82f7-792315bda7c6 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:19.834360 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e28f65ca-937e-4035-96ac-d1053798c214 tempest-AggregatesAdminTestJSON-1153364545 tempest-AggregatesAdminTestJSON-1153364545-project] 10.222.0.18 "GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6" status: 404 len: 111 microversion: 2.1 time: 0.052349 Apr 02 20:52:19.835446 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 165/267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:19 2022] GET /compute/v2.1/servers/38f8f353-82ba-4c3e-82f7-792315bda7c6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:19.880157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 75877cda-9998-4d90-b143-9a28cab17517 does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:52:19.880891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Neutron security group 75877cda-9998-4d90-b143-9a28cab17517 not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 20:52:19.881472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.security_groups [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Security Group ID 75877cda-9998-4d90-b143-9a28cab17517 does not exist {{(pid=136517) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Apr 02 20:52:19.905111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 75877cda-9998-4d90-b143-9a28cab17517 does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:52:19.905712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Neutron security group 75877cda-9998-4d90-b143-9a28cab17517 not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 20:52:19.906177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.security_groups [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Security Group ID 75877cda-9998-4d90-b143-9a28cab17517 does not exist {{(pid=136517) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Apr 02 20:52:20.372948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1122506243", "block_migration": true, "disk_over_commit": false}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:20.374155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:20.392131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:20.392619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:20.393399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:20.393985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.144128 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-852bb058-0c34-43d5-88e5-3589d1407cfa tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9165 microversion: 2.1 time: 2.039444 Apr 02 20:52:21.147448 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 103/268] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Apr 2 20:52:19 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9165 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:21.159335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:21.160191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:21.176557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.177035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.177873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lazy-loading 'flavor' on Instance uuid 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:52:21.180098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.181781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.286283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Going to try to live migrate instance to tempest-host-1122506243 {{(pid=136518) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:52:21.295563 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] HTTP exception thrown: Compute host tempest-host-1122506243 could not be found. Apr 02 20:52:21.296844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Returning 400 to user: Compute host tempest-host-1122506243 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:21.297891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd7c6548-10cb-4f52-89ca-cc8579a828c8 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f/action" status: 400 len: 100 microversion: 2.1 time: 1.462142 Apr 02 20:52:21.298935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 166/269] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Apr 2 20:52:19 2022] POST /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f/action => generated 100 bytes in 1463 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:52:21.531918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:21.544110 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ef4c67a1-9977-4413-b13d-965ee89d20be tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.393353 Apr 02 20:52:21.544742 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 104/270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:21 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:21.551114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ec9dcef-b6e1-49ad-94d5-968a3369a83d tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] Calling method '.version_select at 0x7f54d54334c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:21.691572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a03dcbf3-c12c-4398-91c2-cc1ed653f927 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:21.693335 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:21.693335 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:21.694593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a03dcbf3-c12c-4398-91c2-cc1ed653f927 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.695088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a03dcbf3-c12c-4398-91c2-cc1ed653f927 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.697350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a03dcbf3-c12c-4398-91c2-cc1ed653f927 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.698742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a03dcbf3-c12c-4398-91c2-cc1ed653f927 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.771381 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a03dcbf3-c12c-4398-91c2-cc1ed653f927 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.470972 Apr 02 20:52:21.773422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 167/271] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:21 2022] GET /compute/v2.1/os-services => generated 947 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:21.788119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:21.790919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:21.798989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.799450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.800230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.800701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.908768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ec9dcef-b6e1-49ad-94d5-968a3369a83d tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.362258 Apr 02 20:52:21.909584 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 105/272] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Apr 2 20:52:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:21.922013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9e7dff6-15b1-485c-bb2a-9a28b5e5264b tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:21.923592 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:21.923592 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:21.925391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e7dff6-15b1-485c-bb2a-9a28b5e5264b tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.925847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e7dff6-15b1-485c-bb2a-9a28b5e5264b tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.927248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e7dff6-15b1-485c-bb2a-9a28b5e5264b tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:21.927695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e7dff6-15b1-485c-bb2a-9a28b5e5264b tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:21.990454 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9e7dff6-15b1-485c-bb2a-9a28b5e5264b tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.077292 Apr 02 20:52:21.993046 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 106/273] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Apr 2 20:52:21 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:21.999926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64270383-ab92-4064-b358-8584075b90cb tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Calling method '.version_select at 0x7f54d5433040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:22.024410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:22.035187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c363600c-7259-40a2-8816-ce5bab58b7b4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1467 microversion: 2.1 time: 0.260365 Apr 02 20:52:22.036916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 168/274] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:21 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:22.042893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee8be1f1-ce39-430f-a215-ffdb9120d424 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:22.044667 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:22.044667 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:22.046112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8be1f1-ce39-430f-a215-ffdb9120d424 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.046799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8be1f1-ce39-430f-a215-ffdb9120d424 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.047838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8be1f1-ce39-430f-a215-ffdb9120d424 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.048547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8be1f1-ce39-430f-a215-ffdb9120d424 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.077777 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee8be1f1-ce39-430f-a215-ffdb9120d424 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039485 Apr 02 20:52:22.084943 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 169/275] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:52:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:22.091195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a3be52f-6444-4cbd-984b-0731491cf6e2 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:22.092934 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:22.092934 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:22.094447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3be52f-6444-4cbd-984b-0731491cf6e2 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.095109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3be52f-6444-4cbd-984b-0731491cf6e2 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.096125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3be52f-6444-4cbd-984b-0731491cf6e2 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.096874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3be52f-6444-4cbd-984b-0731491cf6e2 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.124816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a3be52f-6444-4cbd-984b-0731491cf6e2 tempest-ServicesAdminTestJSON-1272450343 tempest-ServicesAdminTestJSON-1272450343-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038288 Apr 02 20:52:22.133600 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 170/276] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:22 2022] GET /compute/v2.1/os-services => generated 947 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:22.262772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-764937086", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:22.348798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:22.552751 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64270383-ab92-4064-b358-8584075b90cb tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c09aa001-e89b-4980-8498-64f042d6b050" status: 202 len: 0 microversion: 2.1 time: 0.557769 Apr 02 20:52:22.557383 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 107/277] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:52:21 2022] DELETE /compute/v2.1/os-security-groups/c09aa001-e89b-4980-8498-64f042d6b050 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:22.566009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:22.568030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:22.587120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.588525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.590726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.593389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.795859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:22.795859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:22.795859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:22.795859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:22.795859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:22.806995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.807734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.809063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:22.809689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:22.833650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Getting quotas for project 493bc8b0b32f4804a5694c0bf34cdeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:22.840437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Getting quotas for user b68e4ad966924cf98c972f0fc0704fc1 and project 493bc8b0b32f4804a5694c0bf34cdeb4. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:22.852841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:52:22.855642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:52:22.920672 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a262665f-7ac8-452d-92a5-506b22faa372 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662316 Apr 02 20:52:22.928147 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 171/278] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 20:52:22.936613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a91b254-142e-4acd-9dd0-8a05b4b04804 tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] Calling method '.version_select at 0x7f54d53d18b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:23.007238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:23.035746 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f2039c9-4db7-4e49-b54d-d407cf7f1e3b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.465436 Apr 02 20:52:23.035746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 108/279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:22 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:23.038792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-411b59d6-fa97-4f12-85bc-51bf5d25a5b4 req-bdd159b1-023c-43a3-9cbc-8bc82751d523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e6da4-1b09-4731-9332-98dce9466b87", "name": "network-vif-plugged", "status": "completed", "tag": "94129b94-caea-4aa7-bc27-5f3cfd83ebcb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:23.057692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-411b59d6-fa97-4f12-85bc-51bf5d25a5b4 req-bdd159b1-023c-43a3-9cbc-8bc82751d523 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:23.063668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-411b59d6-fa97-4f12-85bc-51bf5d25a5b4 req-bdd159b1-023c-43a3-9cbc-8bc82751d523 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:23.091468 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-411b59d6-fa97-4f12-85bc-51bf5d25a5b4 req-bdd159b1-023c-43a3-9cbc-8bc82751d523 service nova] Creating event network-vif-plugged:94129b94-caea-4aa7-bc27-5f3cfd83ebcb for instance 807e6da4-1b09-4731-9332-98dce9466b87 on nch1-master-1 Apr 02 20:52:23.116021 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-411b59d6-fa97-4f12-85bc-51bf5d25a5b4 req-bdd159b1-023c-43a3-9cbc-8bc82751d523 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071466 Apr 02 20:52:23.117682 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 109/280] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:23.293687 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a91b254-142e-4acd-9dd0-8a05b4b04804 tempest-SecurityGroupsTestAdminJSON-153696875 tempest-SecurityGroupsTestAdminJSON-153696875-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/d8fb4a03-a222-4744-aba2-975054d55376" status: 202 len: 0 microversion: 2.1 time: 0.363538 Apr 02 20:52:23.294515 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 172/281] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:52:22 2022] DELETE /compute/v2.1/os-security-groups/d8fb4a03-a222-4744-aba2-975054d55376 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:23.303809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de84f1fa-80ba-4c7b-a41b-9d9ab0b89ecf tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:23.304819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de84f1fa-80ba-4c7b-a41b-9d9ab0b89ecf tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:23.439008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de84f1fa-80ba-4c7b-a41b-9d9ab0b89ecf tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:23.453315 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de84f1fa-80ba-4c7b-a41b-9d9ab0b89ecf tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1218 microversion: 2.1 time: 0.156999 Apr 02 20:52:23.459217 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 173/282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:23 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:23.475107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25fbbfca-1ebb-4edb-befc-b821a51c7c48 tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] Calling method '.version_select at 0x7f54d5133f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:23.550642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-702758036", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "83a57283-8e77-4048-913b-713f633ea68f"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:23.645961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] validate_networks() for [('83a57283-8e77-4048-913b-713f633ea68f', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:23.876846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25fbbfca-1ebb-4edb-befc-b821a51c7c48 tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/653cbe4b-4f5a-4980-a77a-8281a90a0d76" status: 202 len: 0 microversion: 2.1 time: 0.405560 Apr 02 20:52:23.880416 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 174/283] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:52:23 2022] DELETE /compute/v2.1/os-security-groups/653cbe4b-4f5a-4980-a77a-8281a90a0d76 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:23.889101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-17674f69-f682-4b25-91d7-d1743ba0476a tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] Calling method '.version_select at 0x7f54d51339d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:24.173510 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-17674f69-f682-4b25-91d7-d1743ba0476a tempest-SecurityGroupsTestAdminJSON-1384498464 tempest-SecurityGroupsTestAdminJSON-1384498464-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a7ca6dcf-9eec-4f14-b150-94989984ac91" status: 202 len: 0 microversion: 2.1 time: 0.291702 Apr 02 20:52:24.174668 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 175/284] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:52:23 2022] DELETE /compute/v2.1/os-security-groups/a7ca6dcf-9eec-4f14-b150-94989984ac91 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:52:24.183165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:24.184072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:24.187738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:24.188409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:24.189129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:24.189751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:24.190606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:24.215583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:24.216042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:24.217086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:24.218174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:24.220152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:24.220472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:24.221665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:24.222701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:24.285372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:24.296712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for user a2e061bb9a054fb1945417baf444eaee and project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:24.322741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:52:24.328701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:52:24.428489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:24.438836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d49e592e-6985-48e2-ade3-f34c6bb38c46 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1391 microversion: 2.1 time: 0.262759 Apr 02 20:52:24.450383 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 176/285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:24 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1391 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:24.476819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:24.477762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:24.479657 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38b4c77b-36af-44b9-80a5-8dc7cab418ad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360348 Apr 02 20:52:24.480656 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 110/286] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:52:24.491137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f212b47-2d8c-4b5f-9e42-1248fee0f864 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:24.491898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f212b47-2d8c-4b5f-9e42-1248fee0f864 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:24.495968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:24.499699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:24.501911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:24.504021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:24.635837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:24.647156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2db7f912-3a90-4765-aed7-c78032f03d5c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1278 microversion: 2.1 time: 0.174531 Apr 02 20:52:24.647902 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 177/287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:24 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:24.732037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f212b47-2d8c-4b5f-9e42-1248fee0f864 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:24.748101 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f212b47-2d8c-4b5f-9e42-1248fee0f864 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1210 microversion: 2.1 time: 0.256189 Apr 02 20:52:24.749130 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 111/288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:24 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1210 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:25.457426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:25.458031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:25.470555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:25.472300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:25.474746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:25.475365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:25.482596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be68fa25-c0cc-4373-a6cc-258252a28b3f tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-892690759", "id": 26411799, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:25.485457 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:25.485457 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:25.522316 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be68fa25-c0cc-4373-a6cc-258252a28b3f tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.86 time: 0.626403 Apr 02 20:52:25.533110 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 178/289] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:52:24 2022] POST /compute/v2.1/flavors => generated 464 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:25.547401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cb5cf09b-5f91-460b-b819-e61fba1d40fd tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:25.550034 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:25.550034 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:25.847412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:25.865217 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b31d2fb3-8fa8-4700-8dc1-6a4f6bb61575 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1589 microversion: 2.1 time: 0.411424 Apr 02 20:52:25.871266 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 112/290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:25 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1589 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:25.894202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:25.895475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:25.935140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:25.936058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:25.943878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:25.944491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:25.959325 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cb5cf09b-5f91-460b-b819-e61fba1d40fd tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/26411799/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.416998 Apr 02 20:52:25.960177 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 179/291] 10.222.0.18 () {62 vars in 1258 bytes} [Sat Apr 2 20:52:25 2022] POST /compute/v2.1/flavors/26411799/os-extra_specs => generated 62 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:25.972591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:25.990415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:26.007633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:26.025225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:26.026357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:26.026952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:26.416964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:26.431477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-14a2d62c-9682-4b40-996d-015d61e92cf5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1270 microversion: 2.1 time: 0.466960 Apr 02 20:52:26.435292 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 180/292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:25 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1270 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:26.454962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:26.458135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:26.470987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:26.471453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:26.473313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:26.473965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:26.797937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8805bef7-96d6-47b2-8869-9816ffaef294 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360478 Apr 02 20:52:26.799458 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 181/293] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 20:52:26 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:26.810040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c4ac0ea-d5cb-496f-8b5f-4728aa3b7f97 tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:26.811432 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:26.811432 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:26.847118 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c4ac0ea-d5cb-496f-8b5f-4728aa3b7f97 tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/26411799" status: 202 len: 0 microversion: 2.86 time: 0.045767 Apr 02 20:52:26.850215 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 182/294] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Apr 2 20:52:26 2022] DELETE /compute/v2.1/flavors/26411799 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:26.990497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:27.001054 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f288e103-a4ae-422e-8db9-5b74700b550f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1318 microversion: 2.1 time: 1.128026 Apr 02 20:52:27.010804 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 113/295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:25 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1318 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:27.016347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e911d58-d7ee-430b-84b8-b7e44ea2fcf6 tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:27.043685 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e911d58-d7ee-430b-84b8-b7e44ea2fcf6 tempest-FlavorMetadataValidation-2045590821 tempest-FlavorMetadataValidation-2045590821-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.031099 Apr 02 20:52:27.061238 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 114/296] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:52:27 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:27.266386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6ec7b20b-1034-4464-9954-f90b187eba19 req-73786325-083c-4c61-8780-76d97730796f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d", "tag": "fb218633-df83-4912-b30d-33b8e54180f1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:27.284368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6ec7b20b-1034-4464-9954-f90b187eba19 req-73786325-083c-4c61-8780-76d97730796f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:27.289571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6ec7b20b-1034-4464-9954-f90b187eba19 req-73786325-083c-4c61-8780-76d97730796f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:27.331382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6ec7b20b-1034-4464-9954-f90b187eba19 req-73786325-083c-4c61-8780-76d97730796f service nova] Creating event network-changed:fb218633-df83-4912-b30d-33b8e54180f1 for instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d on nch2-master-1 Apr 02 20:52:27.345260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6ec7b20b-1034-4464-9954-f90b187eba19 req-73786325-083c-4c61-8780-76d97730796f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081481 Apr 02 20:52:27.348375 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 115/297] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:27.415264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7c1d836b-56f4-4491-8929-280d556a0167 tempest-InstanceUsageAuditLogTestJSON-568165748 tempest-InstanceUsageAuditLogTestJSON-568165748-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:27.417056 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:27.417056 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:27.456086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:27.456858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:27.467986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:27.468441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:27.469253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:27.469688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:27.473994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7c1d836b-56f4-4491-8929-280d556a0167 tempest-InstanceUsageAuditLogTestJSON-568165748 tempest-InstanceUsageAuditLogTestJSON-568165748-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-02 20:52:26" status: 200 len: 318 microversion: 2.1 time: 0.621324 Apr 02 20:52:27.474535 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 183/298] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:52:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-02%2020%3A52%3A26 => generated 318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:27.487363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-877017b1-dc26-47b0-890b-9e66940deed7 tempest-InstanceUsageAuditLogTestJSON-568165748 tempest-InstanceUsageAuditLogTestJSON-568165748-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:27.487836 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:27.487836 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:27.515256 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-877017b1-dc26-47b0-890b-9e66940deed7 tempest-InstanceUsageAuditLogTestJSON-568165748 tempest-InstanceUsageAuditLogTestJSON-568165748-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.032588 Apr 02 20:52:27.517359 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 184/299] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 20:52:27 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:27.635368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:27.650936 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-853714ca-c445-4052-9153-691fb7ad928e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1268 microversion: 2.1 time: 0.201077 Apr 02 20:52:27.652151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 116/300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:27 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:28.025472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:28.026444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:28.039519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:28.041634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:28.043098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:28.043540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:28.659226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:28.672335 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b69525f-96b6-4fff-89d0-c498e2f676f4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1318 microversion: 2.1 time: 0.654835 Apr 02 20:52:28.672997 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 185/301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:28 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:28.679979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:28.680707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:28.699519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:28.699977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:28.701561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:28.702015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:28.963117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-202288158", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:29.055098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:29.286890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:29.298157 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ad196b6-83d1-484d-acf0-2f1a247bd5fb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.624059 Apr 02 20:52:29.314981 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 186/302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:28 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:29.358821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:29.359537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:29.360391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:29.361155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:29.361780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:29.382531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.387756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.390997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.391918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.417920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Getting quotas for project 7755ff4a52a843d5afe245dd067d37fb. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:29.424031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Getting quotas for user b6bd66a0c09642dc91a334698fbd4daa and project 7755ff4a52a843d5afe245dd067d37fb. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:29.439127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:52:29.442670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:52:29.499093 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b65dfa3-0c64-44f9-bd25-e11bc333b541 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038168 Apr 02 20:52:29.500499 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 117/303] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:52:29.511479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e71e3dfb-8670-4fb5-90cb-5828e17a43c1 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:29.512249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e71e3dfb-8670-4fb5-90cb-5828e17a43c1 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:29.618878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e71e3dfb-8670-4fb5-90cb-5828e17a43c1 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:29.627133 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e71e3dfb-8670-4fb5-90cb-5828e17a43c1 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1219 microversion: 2.1 time: 0.121118 Apr 02 20:52:29.627714 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 118/304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:29 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:29.690862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:29.692291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:29.704105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.708041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.711129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.713313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.770524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Action: 'update', calling method: .version_select at 0x7f54d5133040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:29.772127 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:29.772127 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:29.773552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.774006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.793238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.793692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.808089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] HTTP exception thrown: Service 9f1a62a6-8741-4eca-9735-05e3e2fc84a8 could not be found. Apr 02 20:52:29.808972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Returning 404 to user: Service 9f1a62a6-8741-4eca-9735-05e3e2fc84a8 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:29.809995 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4af8fa8-573c-4050-93f9-0cf24e601a71 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/9f1a62a6-8741-4eca-9735-05e3e2fc84a8" status: 404 len: 110 microversion: 2.53 time: 0.488719 Apr 02 20:52:29.811299 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 187/305] 10.222.0.18 () {62 vars in 1308 bytes} [Sat Apr 2 20:52:29 2022] PUT /compute/v2.1/os-services/9f1a62a6-8741-4eca-9735-05e3e2fc84a8 => generated 110 bytes in 495 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:52:29.830252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Action: 'update', calling method: .version_select at 0x7f54d51331f0>, body: {"status": "disabled"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:29.833166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.833621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.840083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.840416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.846335 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] HTTP exception thrown: Service 9f1a62a6-8741-4eca-9735-05e3e2fc84a8 could not be found. Apr 02 20:52:29.846688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Returning 404 to user: Service 9f1a62a6-8741-4eca-9735-05e3e2fc84a8 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:29.847580 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0c695659-1b95-4684-9d9c-ed8169874748 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/9f1a62a6-8741-4eca-9735-05e3e2fc84a8" status: 404 len: 110 microversion: 2.53 time: 0.027881 Apr 02 20:52:29.848604 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 188/306] 10.222.0.18 () {62 vars in 1308 bytes} [Sat Apr 2 20:52:29 2022] PUT /compute/v2.1/os-services/9f1a62a6-8741-4eca-9735-05e3e2fc84a8 => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 20:52:29.862891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Action: 'update', calling method: .version_select at 0x7f54d509baf0>, body: {"status": "enabled"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:29.865391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.865841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.872951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.873911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.880491 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] HTTP exception thrown: Service 9f1a62a6-8741-4eca-9735-05e3e2fc84a8 could not be found. Apr 02 20:52:29.881485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Returning 404 to user: Service 9f1a62a6-8741-4eca-9735-05e3e2fc84a8 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:29.882628 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de31cfde-c090-4084-871e-d22dd433d16d tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/9f1a62a6-8741-4eca-9735-05e3e2fc84a8" status: 404 len: 110 microversion: 2.53 time: 0.027155 Apr 02 20:52:29.884265 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 189/307] 10.222.0.18 () {62 vars in 1308 bytes} [Sat Apr 2 20:52:29 2022] PUT /compute/v2.1/os-services/9f1a62a6-8741-4eca-9735-05e3e2fc84a8 => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 20:52:29.895197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-258ae5fd-c027-4c2b-afef-8333a432ab67 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:29.896866 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:29.896866 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:29.898685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-258ae5fd-c027-4c2b-afef-8333a432ab67 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.899951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-258ae5fd-c027-4c2b-afef-8333a432ab67 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.901635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-258ae5fd-c027-4c2b-afef-8333a432ab67 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.902307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-258ae5fd-c027-4c2b-afef-8333a432ab67 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.934314 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-258ae5fd-c027-4c2b-afef-8333a432ab67 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.044249 Apr 02 20:52:29.935215 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 190/308] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Apr 2 20:52:29 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:29.940236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:29.941064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:29.949911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.950605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:29.951766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:29.952986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.046576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:30.058696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd0a06ae-0f38-4f03-972f-4cf2f864fc0f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1318 microversion: 2.1 time: 0.372861 Apr 02 20:52:30.072169 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 119/309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:29 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:30.082269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-670fc404-4571-47b2-947a-734cd00f16da tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.083703 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:30.083703 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:30.086622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670fc404-4571-47b2-947a-734cd00f16da tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.088320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670fc404-4571-47b2-947a-734cd00f16da tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.093075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670fc404-4571-47b2-947a-734cd00f16da tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.094088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670fc404-4571-47b2-947a-734cd00f16da tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.149234 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-670fc404-4571-47b2-947a-734cd00f16da tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.075593 Apr 02 20:52:30.156151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 120/310] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:30.167974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aa862400-7564-40fc-b9ec-fef28228375f tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.169340 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:30.169340 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:30.170618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa862400-7564-40fc-b9ec-fef28228375f tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.171063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa862400-7564-40fc-b9ec-fef28228375f tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.177099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa862400-7564-40fc-b9ec-fef28228375f tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.178899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa862400-7564-40fc-b9ec-fef28228375f tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.237492 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aa862400-7564-40fc-b9ec-fef28228375f tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.079054 Apr 02 20:52:30.238189 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 121/311] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:30.253410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44a76f26-fcf6-4880-aa9c-6e42b5bee6fd tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.261230 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:30.261230 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:30.262904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44a76f26-fcf6-4880-aa9c-6e42b5bee6fd tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.265145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44a76f26-fcf6-4880-aa9c-6e42b5bee6fd tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.266626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44a76f26-fcf6-4880-aa9c-6e42b5bee6fd tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.267227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44a76f26-fcf6-4880-aa9c-6e42b5bee6fd tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.309078 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44a76f26-fcf6-4880-aa9c-6e42b5bee6fd tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.059025 Apr 02 20:52:30.310269 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 122/312] 10.222.0.18 () {60 vars in 1236 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:30.324320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe497b69-50c2-4384-a5fb-1fdefd4b79c2 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.326509 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:30.326509 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:30.328551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe497b69-50c2-4384-a5fb-1fdefd4b79c2 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.329278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe497b69-50c2-4384-a5fb-1fdefd4b79c2 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.330533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe497b69-50c2-4384-a5fb-1fdefd4b79c2 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.331142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe497b69-50c2-4384-a5fb-1fdefd4b79c2 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.360552 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe497b69-50c2-4384-a5fb-1fdefd4b79c2 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.042302 Apr 02 20:52:30.361777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 123/313] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:30.367554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.369146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:30.382969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.384777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.385822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.386451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.671416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:30.682792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b629f351-0f8c-4ebc-9eb2-38b25788e6a1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 200 len: 1589 microversion: 2.1 time: 0.746067 Apr 02 20:52:30.683395 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 191/314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:29 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 1589 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:30.702868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4aeb9c5-b902-47b9-8154-7453a32e0e65 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.704576 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:30.704576 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:30.707288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4aeb9c5-b902-47b9-8154-7453a32e0e65 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.707971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4aeb9c5-b902-47b9-8154-7453a32e0e65 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.709103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4aeb9c5-b902-47b9-8154-7453a32e0e65 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.710099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4aeb9c5-b902-47b9-8154-7453a32e0e65 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.774847 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4aeb9c5-b902-47b9-8154-7453a32e0e65 tempest-ServicesAdminNegativeV253TestJSON-207124925 tempest-ServicesAdminNegativeV253TestJSON-207124925-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.089809 Apr 02 20:52:30.778585 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 192/315] 10.222.0.18 () {60 vars in 1238 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:30.794126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:30.798445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:30.815578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.816268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.817633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:30.818648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:30.823497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:30.837437 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8caa988-8a3c-4479-af51-0c442585a10a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.471816 Apr 02 20:52:30.846812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 124/316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:30.940311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:30.951931 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8db2ac70-120c-4b8a-9360-60c7e34aca0a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1271 microversion: 2.1 time: 0.167065 Apr 02 20:52:30.963714 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 193/317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:31.068306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76418d3d-8577-4b18-856c-f6d6b12dd204 tempest-ServicesAdminNegativeV253TestJSON-457122793 tempest-ServicesAdminNegativeV253TestJSON-457122793-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:31.071847 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:31.071847 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:31.072598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-76418d3d-8577-4b18-856c-f6d6b12dd204 tempest-ServicesAdminNegativeV253TestJSON-457122793 tempest-ServicesAdminNegativeV253TestJSON-457122793-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f1475ed2bd1a4f6fa581f9d5616e1e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce16d6684bbf4f0eb8223f7a65631ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:31.073296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76418d3d-8577-4b18-856c-f6d6b12dd204 tempest-ServicesAdminNegativeV253TestJSON-457122793 tempest-ServicesAdminNegativeV253TestJSON-457122793-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:31.074754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76418d3d-8577-4b18-856c-f6d6b12dd204 tempest-ServicesAdminNegativeV253TestJSON-457122793 tempest-ServicesAdminNegativeV253TestJSON-457122793-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.232518 Apr 02 20:52:31.076808 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 125/318] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Apr 2 20:52:30 2022] GET /compute/v2.1/os-services => generated 112 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:52:31.093438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:31.099569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:31.118941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:31.124319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:31.130383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:31.141095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:31.270368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9ef394fd-1edf-4273-9525-19a085279c07 req-8c8218f2-5aba-4400-8c26-6784b88bcde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e6da4-1b09-4731-9332-98dce9466b87", "tag": "94129b94-caea-4aa7-bc27-5f3cfd83ebcb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:31.298521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9ef394fd-1edf-4273-9525-19a085279c07 req-8c8218f2-5aba-4400-8c26-6784b88bcde7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:31.304578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9ef394fd-1edf-4273-9525-19a085279c07 req-8c8218f2-5aba-4400-8c26-6784b88bcde7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:31.343302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9ef394fd-1edf-4273-9525-19a085279c07 req-8c8218f2-5aba-4400-8c26-6784b88bcde7 service nova] Creating event network-changed:94129b94-caea-4aa7-bc27-5f3cfd83ebcb for instance 807e6da4-1b09-4731-9332-98dce9466b87 on nch1-master-1 Apr 02 20:52:31.359430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9ef394fd-1edf-4273-9525-19a085279c07 req-8c8218f2-5aba-4400-8c26-6784b88bcde7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394406 Apr 02 20:52:31.363492 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 194/319] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:31.823738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:31.832047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-813031aa-ea02-4045-9c2f-91782c78f0a6 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1318 microversion: 2.1 time: 0.751223 Apr 02 20:52:31.837605 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 126/320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:31 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:31.854331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:31.855360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:31.878669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:31.879366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:31.880329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:31.882779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:31.975557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0fbca46e-f2ef-4314-a607-60862dcada29 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:31.997608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0fbca46e-f2ef-4314-a607-60862dcada29 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.627933 Apr 02 20:52:31.998211 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 195/321] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:32.011556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.012297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:32.040443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:32.041152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:32.042049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:32.045198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:32.250225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:32.260189 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-516ea5cb-ad66-4cf3-b373-dcee89936285 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1277 microversion: 2.1 time: 0.259632 Apr 02 20:52:32.261475 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 196/322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:31 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:32.270234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b376c08-3b84-4bfd-a409-fb86276e94d1 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.332146 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b376c08-3b84-4bfd-a409-fb86276e94d1 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3075 microversion: 2.1 time: 0.067856 Apr 02 20:52:32.343337 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 197/323] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors => generated 3075 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:32.348737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00fc2688-1553-443b-9ee3-4bd150856801 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.359136 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00fc2688-1553-443b-9ee3-4bd150856801 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014225 Apr 02 20:52:32.360114 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 198/324] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:32.373453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f6f48c6-2fb6-4304-ab50-31e82ece3de1 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.382468 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f6f48c6-2fb6-4304-ab50-31e82ece3de1 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014000 Apr 02 20:52:32.388736 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 199/325] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:32.395595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5fbe9a02-f21c-4aec-bd72-08fdbeb695b2 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.422159 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5fbe9a02-f21c-4aec-bd72-08fdbeb695b2 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.031666 Apr 02 20:52:32.423104 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 200/326] 10.222.0.18 () {58 vars in 1164 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:32.445621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab50f25e-fb6e-4c43-9bdb-55643012468b tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.473419 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab50f25e-fb6e-4c43-9bdb-55643012468b tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039255 Apr 02 20:52:32.474027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 201/327] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:32.486440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8504c02c-4aef-43b1-850c-80e2184f68f0 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.521166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8504c02c-4aef-43b1-850c-80e2184f68f0 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039250 Apr 02 20:52:32.530874 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 202/328] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:32.536527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-914c017f-441c-4875-8d3d-4dcc689fc36d tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.550189 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-914c017f-441c-4875-8d3d-4dcc689fc36d tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017435 Apr 02 20:52:32.551096 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 203/329] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:32.563477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1114813-795a-4cde-94d9-38da54ee7ea9 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.572960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1114813-795a-4cde-94d9-38da54ee7ea9 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013376 Apr 02 20:52:32.574220 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 204/330] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:32.590293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4cc08c83-e31b-4aed-8620-2fd336b3ed2a tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.680015 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4cc08c83-e31b-4aed-8620-2fd336b3ed2a tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2908 microversion: 2.1 time: 0.099142 Apr 02 20:52:32.689872 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 205/331] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2908 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:32.701757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c44aad2-5491-46fa-82f2-647c0bdfb4d1 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.727106 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c44aad2-5491-46fa-82f2-647c0bdfb4d1 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033796 Apr 02 20:52:32.727917 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 206/332] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:32.738814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a374c86-0a78-4f73-a47f-035cc3906a59 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.755840 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a374c86-0a78-4f73-a47f-035cc3906a59 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.020644 Apr 02 20:52:32.760796 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 207/333] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:32.769350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b7bd705-929e-4518-8f86-fa0811d75bd9 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.782511 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b7bd705-929e-4518-8f86-fa0811d75bd9 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016724 Apr 02 20:52:32.788578 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 208/334] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:32.793279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-669d2a75-b52e-4f85-a35e-d57141ea7c3b tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.808018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-669d2a75-b52e-4f85-a35e-d57141ea7c3b tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.018239 Apr 02 20:52:32.808639 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 209/335] 10.222.0.18 () {58 vars in 1147 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:32.820763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:32.830016 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed381a7e-84c9-4bb2-90ac-f477297d1f88 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.979525 Apr 02 20:52:32.832823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-353bf660-e543-421d-a5b7-324169893fef tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.841852 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 127/336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:31 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:32.852905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.853566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:32.858941 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-353bf660-e543-421d-a5b7-324169893fef tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.040363 Apr 02 20:52:32.860250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:32.860957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:32.868532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 210/337] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:32.869676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:32.871144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:32.882232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d6bab36b-d7b7-4c51-9703-639ff317b511 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.891172 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d6bab36b-d7b7-4c51-9703-639ff317b511 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012690 Apr 02 20:52:32.897416 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 211/338] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:32.903197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61e65184-75eb-44a1-9797-467ddf8c6bd0 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.930915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61e65184-75eb-44a1-9797-467ddf8c6bd0 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1537 microversion: 2.1 time: 0.031329 Apr 02 20:52:32.931776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 212/339] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1537 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:32.945320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3cc2b0e-7601-4e67-a0a2-696bf64caa58 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:32.967391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c3cc2b0e-7601-4e67-a0a2-696bf64caa58 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.026771 Apr 02 20:52:32.968848 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 213/340] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:32.983475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5aeed40-2a65-4e78-a707-84398ec4d6c4 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:33.003356 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5aeed40-2a65-4e78-a707-84398ec4d6c4 tempest-FlavorsV2TestJSON-810550814 tempest-FlavorsV2TestJSON-810550814-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016725 Apr 02 20:52:33.005221 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 214/341] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:33.279927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:33.280431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:33.287616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:33.288066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:33.288868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:33.289303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:33.434816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:33.453426 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9a8b0f2-8f70-4a2d-aba3-1ec05d3593ba tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1277 microversion: 2.1 time: 0.177748 Apr 02 20:52:33.454247 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 215/342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:33 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:33.489207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-12fb3541-6ad3-40c2-a7e1-e526db96837e req-ea95cc9d-0f6e-4fcf-b280-26553695f64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d", "name": "network-vif-plugged", "status": "completed", "tag": "fb218633-df83-4912-b30d-33b8e54180f1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:33.522801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:33.525366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-12fb3541-6ad3-40c2-a7e1-e526db96837e req-ea95cc9d-0f6e-4fcf-b280-26553695f64f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:33.529655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-12fb3541-6ad3-40c2-a7e1-e526db96837e req-ea95cc9d-0f6e-4fcf-b280-26553695f64f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:33.531859 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0bcd1b51-063b-4612-b049-a3c09541af86 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1318 microversion: 2.1 time: 0.684310 Apr 02 20:52:33.532448 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 128/343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:32 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:33.549040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2f8379ce-9f3e-4bf0-b31f-4e500691fe6e req-eb4de5c9-c7df-4d28-a984-c5c7cb0bd0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90048480-54e7-4b20-8d1b-d8c6a461de71", "tag": "df51f42c-1b75-412d-b9f6-4349066d58c2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:33.569935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2f8379ce-9f3e-4bf0-b31f-4e500691fe6e req-eb4de5c9-c7df-4d28-a984-c5c7cb0bd0d7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:33.572513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2f8379ce-9f3e-4bf0-b31f-4e500691fe6e req-eb4de5c9-c7df-4d28-a984-c5c7cb0bd0d7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:33.579465 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-12fb3541-6ad3-40c2-a7e1-e526db96837e req-ea95cc9d-0f6e-4fcf-b280-26553695f64f service nova] Creating event network-vif-plugged:fb218633-df83-4912-b30d-33b8e54180f1 for instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d on nch2-master-1 Apr 02 20:52:33.588941 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-12fb3541-6ad3-40c2-a7e1-e526db96837e req-ea95cc9d-0f6e-4fcf-b280-26553695f64f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117985 Apr 02 20:52:33.595619 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 216/344] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:33.604806 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2f8379ce-9f3e-4bf0-b31f-4e500691fe6e req-eb4de5c9-c7df-4d28-a984-c5c7cb0bd0d7 service nova] Creating event network-changed:df51f42c-1b75-412d-b9f6-4349066d58c2 for instance 90048480-54e7-4b20-8d1b-d8c6a461de71 on nch2-master-1 Apr 02 20:52:33.621361 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2f8379ce-9f3e-4bf0-b31f-4e500691fe6e req-eb4de5c9-c7df-4d28-a984-c5c7cb0bd0d7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086880 Apr 02 20:52:33.623985 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 129/345] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:33.847595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:33.848357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:33.856965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:33.857700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:33.858858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:33.859574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:34.077427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:34.090398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11b85514-eef5-41f2-8376-caa02ca7a701 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.246758 Apr 02 20:52:34.091909 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 217/346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:33 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:34.471464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:34.472135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:34.480324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:34.481588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:34.482641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:34.483401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:34.516310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b9dc3b8-429a-41e6-9d68-c1fbc9844c28 tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-669282469", "id": 1792205481, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:34.518236 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:34.518236 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:34.539555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b9dc3b8-429a-41e6-9d68-c1fbc9844c28 tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.263351 Apr 02 20:52:34.540827 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 130/347] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:52:34 2022] POST /compute/v2.1/flavors => generated 467 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:34.550580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:34.551573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:34.559818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:34.560445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:34.561819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:34.562356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:34.846748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:34.862300 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e3ff0031-68d2-42f2-ab3f-3f813e01a747 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 0.394389 Apr 02 20:52:34.874268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 218/348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:34 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:35.092822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:35.108173 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d6faf3f3-dac4-416c-a0df-60bbe3f38e51 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1318 microversion: 2.1 time: 0.558813 Apr 02 20:52:35.109480 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 131/349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:34 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:35.119978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.120802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:35.129739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:35.130945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:35.132226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:35.133081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:35.238501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35be0ea6-4c7a-45f4-b9d1-0051d4cff51c tempest-FlavorsV261TestJSON-631484850 tempest-FlavorsV261TestJSON-631484850-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.267966 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35be0ea6-4c7a-45f4-b9d1-0051d4cff51c tempest-FlavorsV261TestJSON-631484850 tempest-FlavorsV261TestJSON-631484850-project] 10.222.0.18 "GET /compute/v2.1/flavors/1792205481" status: 200 len: 467 microversion: 2.61 time: 0.372867 Apr 02 20:52:35.269721 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 219/350] 10.222.0.18 () {60 vars in 1198 bytes} [Sat Apr 2 20:52:34 2022] GET /compute/v2.1/flavors/1792205481 => generated 467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:52:35.281951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b08bf9eb-a333-4977-bf13-c685135f7a6a tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] Action: 'update', calling method: .version_select at 0x7f54d7554430>, body: {"flavor": {"description": "new"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:35.298788 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:35.298788 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:35.339908 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b08bf9eb-a333-4977-bf13-c685135f7a6a tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/1792205481" status: 200 len: 468 microversion: 2.61 time: 0.063121 Apr 02 20:52:35.342030 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 220/351] 10.222.0.18 () {62 vars in 1218 bytes} [Sat Apr 2 20:52:35 2022] PUT /compute/v2.1/flavors/1792205481 => generated 468 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:52:35.362397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5968d27-48a5-4eb1-a18d-b9f326fc1556 tempest-FlavorsV261TestJSON-631484850 tempest-FlavorsV261TestJSON-631484850-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.407646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5968d27-48a5-4eb1-a18d-b9f326fc1556 tempest-FlavorsV261TestJSON-631484850 tempest-FlavorsV261TestJSON-631484850-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.057348 Apr 02 20:52:35.410370 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 221/352] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:52:35 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:35.430765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9080e512-2c39-485a-8b16-82f98c2e029e tempest-FlavorsV261TestJSON-631484850 tempest-FlavorsV261TestJSON-631484850-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.467710 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9080e512-2c39-485a-8b16-82f98c2e029e tempest-FlavorsV261TestJSON-631484850 tempest-FlavorsV261TestJSON-631484850-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.61 time: 0.043979 Apr 02 20:52:35.468736 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 222/353] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Apr 2 20:52:35 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:52:35.486888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-160a2af0-fe6a-4150-983c-643e4758dfdf tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.489504 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:35.489504 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:35.528567 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-160a2af0-fe6a-4150-983c-643e4758dfdf tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1792205481" status: 202 len: 0 microversion: 2.61 time: 0.047957 Apr 02 20:52:35.531175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 223/354] 10.222.0.18 () {60 vars in 1201 bytes} [Sat Apr 2 20:52:35 2022] DELETE /compute/v2.1/flavors/1792205481 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:35.544173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7205e85e-0439-48ab-81d9-754821acaeec tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.599809 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7205e85e-0439-48ab-81d9-754821acaeec tempest-FlavorsV261TestJSON-14397128 tempest-FlavorsV261TestJSON-14397128-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.063027 Apr 02 20:52:35.603645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 224/355] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:52:35 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:52:35.757933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:35.779018 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-18fceb51-e26c-4617-ac8a-4f4ffd7a461c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.666651 Apr 02 20:52:35.781310 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 132/356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:35 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:35.879582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:35.880510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:35.897452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:35.900303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:35.901237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:35.903155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:36.021885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c6cd92e8-83c1-42a7-a313-32ab664e6993 req-7a8b8f1c-0e0d-4324-873a-c9db86102349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014472c4-1c30-4532-b3c6-f008e2778674", "tag": "6a0a7717-2bfa-4c0d-8e10-daf1dc138f06"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:36.053732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c6cd92e8-83c1-42a7-a313-32ab664e6993 req-7a8b8f1c-0e0d-4324-873a-c9db86102349 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:36.054205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c6cd92e8-83c1-42a7-a313-32ab664e6993 req-7a8b8f1c-0e0d-4324-873a-c9db86102349 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:36.114251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c6cd92e8-83c1-42a7-a313-32ab664e6993 req-7a8b8f1c-0e0d-4324-873a-c9db86102349 service nova] Creating event network-changed:6a0a7717-2bfa-4c0d-8e10-daf1dc138f06 for instance 014472c4-1c30-4532-b3c6-f008e2778674 on nch1-master-1 Apr 02 20:52:36.127026 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c6cd92e8-83c1-42a7-a313-32ab664e6993 req-7a8b8f1c-0e0d-4324-873a-c9db86102349 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109985 Apr 02 20:52:36.130065 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 133/357] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:36.148649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:36.152063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:36.174635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:36.175934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:36.177653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:36.178327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:36.380314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:36.398566 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe5adb90-1daf-4983-a8dc-ad3f3c36b385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 0.523146 Apr 02 20:52:36.410539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 225/358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:35 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:36.642021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:36.654117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aefcbc03-e5de-4914-8cdd-64d52b1a7173 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1466 microversion: 2.1 time: 0.517845 Apr 02 20:52:36.655207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 134/359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:36 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1466 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:36.671343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:36.672220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:36.685706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:36.686174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:36.686971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:36.687818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:36.813827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lazy-loading 'flavor' on Instance uuid d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:52:36.957869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-deb03e15-0c5e-4b65-a554-95db2e348bd4 tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:36.967807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-deb03e15-0c5e-4b65-a554-95db2e348bd4 tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.564058 Apr 02 20:52:36.983809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 226/360] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:36.990537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:36.991496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:37.001137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:37.002100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:37.005089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:37.006087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:37.069587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67c4d2ea-4480-44bb-80aa-d6ea23c3227c tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d/action" status: 202 len: 0 microversion: 2.1 time: 0.401885 Apr 02 20:52:37.085803 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 135/361] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:52:36 2022] POST /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:52:37.104261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:37.105239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:37.127321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:37.129839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:37.130860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:37.134284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:37.736849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:37.747077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce45ba00-dec3-4f56-b320-4f16c0991b20 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.760614 Apr 02 20:52:37.747672 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 227/362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:36 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:37.764942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:37.765889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:37.783858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:37.785866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:37.788623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:37.789271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:37.874447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:37.884521 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f153b73e-c3c0-463c-b863-1326f66ed7ef tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1474 microversion: 2.1 time: 0.792962 Apr 02 20:52:37.886067 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 136/363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:37 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1474 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:37.891084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96c87a34-d321-48cc-a113-7681bd11715b tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1415032205", "imageRef": "05a62107-6abd-4a5b-b3de-7080e07ea641", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:37.943823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-96c87a34-d321-48cc-a113-7681bd11715b tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:38.094415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:38.104885 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d6b49c41-f961-44d0-8335-5f4feb591253 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 0.354103 Apr 02 20:52:38.105470 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 228/364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:37 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:38.476176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-96c87a34-d321-48cc-a113-7681bd11715b tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] HTTP exception thrown: Flavor's memory is too small for requested image. Apr 02 20:52:38.479779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96c87a34-d321-48cc-a113-7681bd11715b tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:38.479779 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-96c87a34-d321-48cc-a113-7681bd11715b tempest-FlavorsV2NegativeTest-1595473388 tempest-FlavorsV2NegativeTest-1595473388-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.590589 Apr 02 20:52:38.479779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 137/365] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:37 2022] POST /compute/v2.1/servers => generated 93 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:38.764091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:38.764842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:38.775896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:38.776728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:38.777770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:38.778418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:38.906564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:38.907189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:38.918429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:38.918884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:38.919666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:38.920103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:39.337627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:39.356210 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1560cf09-0969-430d-88a8-82af3620eb0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.590448 Apr 02 20:52:39.358284 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 229/366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:38 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:39.381259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:39.381887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:39.403443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:39.403933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:39.404819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:39.413239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:39.618378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:39.629207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c346ea9-54c7-4033-a59f-f6967f50780f tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1457 microversion: 2.1 time: 0.729650 Apr 02 20:52:39.630543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 138/367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:38 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1457 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:39.650051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:39.650909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:39.662371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:39.662830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:39.666797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:39.667261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:39.824106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:39.831373 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b44d1300-e7d5-46ee-bb76-f6917f6fd7fa tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 0.472041 Apr 02 20:52:39.835483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 230/368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:39 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:40.377799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:40.379255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:40.398382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.399430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.401664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.402258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.818170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8f3d3fb-7448-4989-853f-ea2618ea98ed tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1608 microversion: 2.1 time: 1.173246 Apr 02 20:52:40.829103 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 139/369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:39 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1608 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:40.841147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-799335a4-1550-453e-a1da-1aa6b7a3b700 req-f5b8f4e7-7b7a-428a-be7a-cd28f8ca00dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90048480-54e7-4b20-8d1b-d8c6a461de71", "name": "network-vif-plugged", "status": "completed", "tag": "df51f42c-1b75-412d-b9f6-4349066d58c2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:40.856383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-799335a4-1550-453e-a1da-1aa6b7a3b700 req-f5b8f4e7-7b7a-428a-be7a-cd28f8ca00dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.856893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-799335a4-1550-453e-a1da-1aa6b7a3b700 req-f5b8f4e7-7b7a-428a-be7a-cd28f8ca00dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.888714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-799335a4-1550-453e-a1da-1aa6b7a3b700 req-f5b8f4e7-7b7a-428a-be7a-cd28f8ca00dc service nova] Creating event network-vif-plugged:df51f42c-1b75-412d-b9f6-4349066d58c2 for instance 90048480-54e7-4b20-8d1b-d8c6a461de71 on nch2-master-1 Apr 02 20:52:40.904447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:40.909297 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-799335a4-1550-453e-a1da-1aa6b7a3b700 req-f5b8f4e7-7b7a-428a-be7a-cd28f8ca00dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078656 Apr 02 20:52:40.910422 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 140/370] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:40.918577 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e202cf97-37a8-4b3b-a509-cc427d0ec0ef tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.547048 Apr 02 20:52:40.919948 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 231/371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:40 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:40.922902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c30f079-6b24-41b9-8457-504c918e1a89 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:40.924232 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:40.924232 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:40.928080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:40.928834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:40.938658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.942532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c30f079-6b24-41b9-8457-504c918e1a89 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.944355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c30f079-6b24-41b9-8457-504c918e1a89 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.947749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.953933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.955133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c30f079-6b24-41b9-8457-504c918e1a89 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:40.956023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c30f079-6b24-41b9-8457-504c918e1a89 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.957931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:40.997665 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c30f079-6b24-41b9-8457-504c918e1a89 tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085895 Apr 02 20:52:40.999083 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 141/372] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:52:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:41.012027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:41.016087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:41.028617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.029590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.030628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.032650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.228093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Lazy-loading 'flavor' on Instance uuid d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:52:41.265330 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d while it is in vm_state suspended Apr 02 20:52:41.269046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d while it is in vm_state suspended {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:41.270977 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cabeeaf9-75b4-4a19-b8ec-ca9ebb936aca tempest-LiveMigrationNegativeTest-688717613 tempest-LiveMigrationNegativeTest-688717613-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d/action" status: 409 len: 155 microversion: 2.1 time: 0.264310 Apr 02 20:52:41.278403 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 142/373] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:52:41 2022] POST /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d/action => generated 155 bytes in 268 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:41.286320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:41.286839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:41.303779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.306916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.309850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.310493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.377252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:52:41.648160 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e6097e9-5474-4b14-8c98-306dc5715498 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 204 len: 0 microversion: 2.1 time: 0.368218 Apr 02 20:52:41.649836 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 143/374] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:52:41 2022] DELETE /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:41.659381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:41.666010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:41.686636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.687480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.690671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.691656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.900841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:41.925359 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ff29758-13d7-4fac-b28f-fa2aae15ec76 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 0.994910 Apr 02 20:52:41.927016 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 232/375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:40 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:41.954571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:41.955808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:41.972067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.972985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:41.974536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:41.975324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.129185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:42.138622 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f514243-e6d8-4497-9bf5-915ed6aab72c tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1463 microversion: 2.1 time: 0.484622 Apr 02 20:52:42.141400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 144/376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:41 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1463 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:42.384295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:42.391903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cefccde5-1868-4e6f-b7f9-a4d4dddadb28 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1310 microversion: 2.1 time: 0.458692 Apr 02 20:52:42.396585 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 233/377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:41 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1310 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:42.722238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-134610ff-7d36-4ca8-b87a-588c60f14167 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d53850d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:42.727224 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:42.727224 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:42.728932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-134610ff-7d36-4ca8-b87a-588c60f14167 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.729644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-134610ff-7d36-4ca8-b87a-588c60f14167 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.735674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-134610ff-7d36-4ca8-b87a-588c60f14167 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.737824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-134610ff-7d36-4ca8-b87a-588c60f14167 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.848810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-134610ff-7d36-4ca8-b87a-588c60f14167 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.482174 Apr 02 20:52:42.855971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 145/378] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:52:42 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:52:42.861027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fdac23c3-34f4-4324-8fdf-c595f9a55c92 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d5004af0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:42.862329 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:42.862329 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:42.863736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdac23c3-34f4-4324-8fdf-c595f9a55c92 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.864343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdac23c3-34f4-4324-8fdf-c595f9a55c92 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.865372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdac23c3-34f4-4324-8fdf-c595f9a55c92 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.865961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdac23c3-34f4-4324-8fdf-c595f9a55c92 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.932034 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fdac23c3-34f4-4324-8fdf-c595f9a55c92 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.074771 Apr 02 20:52:42.943195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:42.944271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:42.950048 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 234/379] 10.222.0.18 () {58 vars in 1138 bytes} [Sat Apr 2 20:52:42 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:42.951859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.952524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.963914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.964375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.968049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-475a413c-1f51-4305-9264-c01b0035f969 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d509b9d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:42.969446 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:42.969446 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:42.970640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-475a413c-1f51-4305-9264-c01b0035f969 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.971086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-475a413c-1f51-4305-9264-c01b0035f969 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:42.983538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-475a413c-1f51-4305-9264-c01b0035f969 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:42.991601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-475a413c-1f51-4305-9264-c01b0035f969 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.024355 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-475a413c-1f51-4305-9264-c01b0035f969 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.069502 Apr 02 20:52:43.025730 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 235/380] 10.222.0.18 () {58 vars in 1144 bytes} [Sat Apr 2 20:52:42 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:52:43.040982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-71a83821-6375-465e-9e3f-e65e5e57b1f1 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d50043a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.043124 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:43.043124 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:43.045201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71a83821-6375-465e-9e3f-e65e5e57b1f1 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.045839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71a83821-6375-465e-9e3f-e65e5e57b1f1 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.046830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71a83821-6375-465e-9e3f-e65e5e57b1f1 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.047592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71a83821-6375-465e-9e3f-e65e5e57b1f1 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.086638 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-71a83821-6375-465e-9e3f-e65e5e57b1f1 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.050369 Apr 02 20:52:43.087846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 236/381] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:43.099589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f61c0b72-8b29-465b-bac0-14149f493dda tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d5133160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.101643 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:43.101643 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:43.103873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61c0b72-8b29-465b-bac0-14149f493dda tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.105205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61c0b72-8b29-465b-bac0-14149f493dda tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.106345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61c0b72-8b29-465b-bac0-14149f493dda tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.106995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61c0b72-8b29-465b-bac0-14149f493dda tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.140600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f61c0b72-8b29-465b-bac0-14149f493dda tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.044586 Apr 02 20:52:43.141727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 237/382] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:43.152821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eea349c0-6bc6-407a-929d-bff3dcb8f45b tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d5133af0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.155795 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:43.155795 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:43.157776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea349c0-6bc6-407a-929d-bff3dcb8f45b tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.158448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea349c0-6bc6-407a-929d-bff3dcb8f45b tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.159606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea349c0-6bc6-407a-929d-bff3dcb8f45b tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.160236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea349c0-6bc6-407a-929d-bff3dcb8f45b tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.196064 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eea349c0-6bc6-407a-929d-bff3dcb8f45b tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.047722 Apr 02 20:52:43.198791 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 238/383] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:43.211095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.212180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:43.222361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.223190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.224379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.225094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.481490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:43.493868 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2a5e294-b9d2-4e55-9efb-b7c41854fb7b tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1463 microversion: 2.1 time: 0.289751 Apr 02 20:52:43.494455 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 239/384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1463 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:43.505111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11359e76-7356-4485-8bc5-3a07e2c24729 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d5133f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.507121 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:43.507121 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:43.521434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11359e76-7356-4485-8bc5-3a07e2c24729 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.521970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11359e76-7356-4485-8bc5-3a07e2c24729 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.538758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11359e76-7356-4485-8bc5-3a07e2c24729 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.538758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11359e76-7356-4485-8bc5-3a07e2c24729 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.570114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11359e76-7356-4485-8bc5-3a07e2c24729 tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.074569 Apr 02 20:52:43.571613 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 240/385] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:43.880756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e325793-7b44-4062-afca-a3982bec8b05 tempest-FloatingIPDetailsNegativeTestJSON-59448123 tempest-FloatingIPDetailsNegativeTestJSON-59448123-project] Calling method '.version_select at 0x7f54d5133a60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.931831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-1e325793-7b44-4062-afca-a3982bec8b05 tempest-FloatingIPDetailsNegativeTestJSON-59448123 tempest-FloatingIPDetailsNegativeTestJSON-59448123-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e9d1ac2c-dce7-461b-b0c6-f12509edc190 could not be found", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:52:43.932758 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-1e325793-7b44-4062-afca-a3982bec8b05 tempest-FloatingIPDetailsNegativeTestJSON-59448123 tempest-FloatingIPDetailsNegativeTestJSON-59448123-project] HTTP exception thrown: Floating IP not found for ID e9d1ac2c-dce7-461b-b0c6-f12509edc190 Apr 02 20:52:43.933966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e325793-7b44-4062-afca-a3982bec8b05 tempest-FloatingIPDetailsNegativeTestJSON-59448123 tempest-FloatingIPDetailsNegativeTestJSON-59448123-project] Returning 404 to user: Floating IP not found for ID e9d1ac2c-dce7-461b-b0c6-f12509edc190 {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:43.935069 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e325793-7b44-4062-afca-a3982bec8b05 tempest-FloatingIPDetailsNegativeTestJSON-59448123 tempest-FloatingIPDetailsNegativeTestJSON-59448123-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/e9d1ac2c-dce7-461b-b0c6-f12509edc190" status: 404 len: 111 microversion: 2.1 time: 0.362531 Apr 02 20:52:43.936146 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 241/386] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/os-floating-ips/e9d1ac2c-dce7-461b-b0c6-f12509edc190 => generated 111 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:43.944148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.945617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:43.953659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:43.963112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.966199 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e7b9bec5-6f2d-4c5a-b64a-b636a5ab1007 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 1.026919 Apr 02 20:52:43.966955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.968001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.968618 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 146/387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:42 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:43.970478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:43.985525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f0044ee-31e5-4744-8aa1-3ff3df53013a tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Calling method '.version_select at 0x7f54d527fe50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:43.986348 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:43.986348 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:43.993442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0044ee-31e5-4744-8aa1-3ff3df53013a tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:43.994140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0044ee-31e5-4744-8aa1-3ff3df53013a tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:44.011057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0044ee-31e5-4744-8aa1-3ff3df53013a tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:44.012144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0044ee-31e5-4744-8aa1-3ff3df53013a tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:44.059495 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f0044ee-31e5-4744-8aa1-3ff3df53013a tempest-HostsAdminTestJSON-2005899349 tempest-HostsAdminTestJSON-2005899349-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.088604 Apr 02 20:52:44.060879 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 147/388] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:44.169929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4792a10e-9f20-4d79-989e-aa7a834399bf tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Action: 'create', calling method: .version_select at 0x7f54d53fa0d0>, body: {"keypair": {"name": "tempest-keypair-1695167546"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:44.206813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4792a10e-9f20-4d79-989e-aa7a834399bf tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:44.224168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4792a10e-9f20-4d79-989e-aa7a834399bf tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:44.415378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:44.435217 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4fa7a36-7cf8-416d-aeb9-8db7dc1d86b8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1494 microversion: 2.1 time: 0.497720 Apr 02 20:52:44.436213 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 242/389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:43 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1494 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:44.450152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4792a10e-9f20-4d79-989e-aa7a834399bf tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:44.457638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4792a10e-9f20-4d79-989e-aa7a834399bf tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:44.481695 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4792a10e-9f20-4d79-989e-aa7a834399bf tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.419272 Apr 02 20:52:44.489292 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 148/390] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:44 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:44.497530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-30f3d53f-01ff-4ae8-87cc-f7c6b70a291c tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d5198310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:44.509279 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-30f3d53f-01ff-4ae8-87cc-f7c6b70a291c tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1695167546" status: 200 len: 691 microversion: 2.1 time: 0.018346 Apr 02 20:52:44.511556 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 149/391] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 20:52:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1695167546 => generated 691 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:44.524135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:44.526010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:44.549719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:44.550634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:44.553716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:44.557585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:44.845664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:44.846599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:44.861722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:44.862282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:44.863278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:44.863818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:44.892152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:44.900263 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9525b534-2b0c-4612-aeca-251626c2018d tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 200 len: 1421 microversion: 2.1 time: 0.381462 Apr 02 20:52:44.900893 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 150/392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:44 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 1421 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:44.913343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be4c4d8e-4086-474d-9403-a64d1de13899 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d51d0a60>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:44.960565 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be4c4d8e-4086-474d-9403-a64d1de13899 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695167546" status: 202 len: 0 microversion: 2.1 time: 0.050813 Apr 02 20:52:44.964427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 151/393] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695167546 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:44.980482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b1bad57e-d10a-49b3-8f83-793cf3cf0958 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Action: 'create', calling method: .version_select at 0x7f54d5198550>, body: {"keypair": {"name": "tempest-keypair-1668479456"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:45.024796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b1bad57e-d10a-49b3-8f83-793cf3cf0958 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:45.029430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b1bad57e-d10a-49b3-8f83-793cf3cf0958 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:45.445804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b1bad57e-d10a-49b3-8f83-793cf3cf0958 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:45.455886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b1bad57e-d10a-49b3-8f83-793cf3cf0958 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:45.480679 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b1bad57e-d10a-49b3-8f83-793cf3cf0958 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.513715 Apr 02 20:52:45.489839 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 152/394] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:44 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:45.501442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:45.506806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:45.536979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:45.537591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:45.538874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:45.540481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.011194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-115ff0e3-085c-45bb-b78c-771c5f27d760 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1645 microversion: 2.1 time: 1.562035 Apr 02 20:52:46.011772 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 243/395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:44 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1645 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:46.016566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-791da6bb-8a56-4e19-8799-b0e2b339d8a1 req-dd562ee4-c572-4960-afc1-12fdf30792c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d", "name": "network-vif-deleted", "tag": "fb218633-df83-4912-b30d-33b8e54180f1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:46.031858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-791da6bb-8a56-4e19-8799-b0e2b339d8a1 req-dd562ee4-c572-4960-afc1-12fdf30792c0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.032513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-791da6bb-8a56-4e19-8799-b0e2b339d8a1 req-dd562ee4-c572-4960-afc1-12fdf30792c0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.056298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-791da6bb-8a56-4e19-8799-b0e2b339d8a1 req-dd562ee4-c572-4960-afc1-12fdf30792c0 service nova] Creating event network-vif-deleted:fb218633-df83-4912-b30d-33b8e54180f1 for instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d on nch2-master-1 Apr 02 20:52:46.063724 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-791da6bb-8a56-4e19-8799-b0e2b339d8a1 req-dd562ee4-c572-4960-afc1-12fdf30792c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050559 Apr 02 20:52:46.064567 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 244/396] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:46.080568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b7fa67a0-77d2-40e7-a1bb-3be007f88eeb tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d51b0dc0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.110832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b7fa67a0-77d2-40e7-a1bb-3be007f88eeb tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668479456" status: 202 len: 0 microversion: 2.1 time: 0.034385 Apr 02 20:52:46.111602 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 245/397] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668479456 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:46.119497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e8bd6d86-6b1c-4014-ace5-56ec7235aa11 req-ae711db7-79ee-4f24-a717-80fb91988044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014472c4-1c30-4532-b3c6-f008e2778674", "name": "network-vif-plugged", "status": "completed", "tag": "6a0a7717-2bfa-4c0d-8e10-daf1dc138f06"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:46.137918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8bd6d86-6b1c-4014-ace5-56ec7235aa11 req-ae711db7-79ee-4f24-a717-80fb91988044 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.141444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8bd6d86-6b1c-4014-ace5-56ec7235aa11 req-ae711db7-79ee-4f24-a717-80fb91988044 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.168650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e8bd6d86-6b1c-4014-ace5-56ec7235aa11 req-ae711db7-79ee-4f24-a717-80fb91988044 service nova] Creating event network-vif-plugged:6a0a7717-2bfa-4c0d-8e10-daf1dc138f06 for instance 014472c4-1c30-4532-b3c6-f008e2778674 on nch1-master-1 Apr 02 20:52:46.186337 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e8bd6d86-6b1c-4014-ace5-56ec7235aa11 req-ae711db7-79ee-4f24-a717-80fb91988044 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073306 Apr 02 20:52:46.187531 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 246/398] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:46.193245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.194179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:46.211630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.212350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.216553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.218311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.253266 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] HTTP exception thrown: Instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d could not be found. Apr 02 20:52:46.254124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Returning 404 to user: Instance d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:46.255493 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03c2d747-cabe-4b42-8890-4a37b258cd48 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d" status: 404 len: 111 microversion: 2.1 time: 0.066252 Apr 02 20:52:46.256221 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 247/399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:46 2022] GET /compute/v2.1/servers/d44212aa-c3f1-4d1a-8f72-d033e5f2cf8d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:46.272039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.273047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:46.286011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.296990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.297935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.298577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.400447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:46.413383 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de46b8c9-8915-4f22-ad36-07792c186182 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1319 microversion: 2.1 time: 0.922227 Apr 02 20:52:46.413907 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 153/400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:45 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1319 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:46.429212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5904d413-b08a-4d77-a256-53ae124bc483 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Action: 'create', calling method: .version_select at 0x7f54d51d0820>, body: {"keypair": {"name": "tempest-keypair-909251682", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:46.470220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-5904d413-b08a-4d77-a256-53ae124bc483 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:46.474605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-5904d413-b08a-4d77-a256-53ae124bc483 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:46.523034 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5904d413-b08a-4d77-a256-53ae124bc483 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.097634 Apr 02 20:52:46.524012 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 154/401] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Apr 2 20:52:46 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:46.528737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.529248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:46.551992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.552373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.553273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.553724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.614681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:52:46.711988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f338373b-baed-4553-a273-18b4dae2c1ae tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1645 microversion: 2.1 time: 0.450014 Apr 02 20:52:46.716367 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 248/402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:46 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1645 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:46.732298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9670a6e-ee25-493b-977c-0d1daa9f7556 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d4ff1ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.811302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9670a6e-ee25-493b-977c-0d1daa9f7556 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909251682" status: 202 len: 0 microversion: 2.1 time: 0.093524 Apr 02 20:52:46.812205 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 249/403] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 20:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909251682 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:46.828220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa7fd130-1fa4-4700-97ae-ddf4b94bd19c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.830646 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:46.830646 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:46.832599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7fd130-1fa4-4700-97ae-ddf4b94bd19c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.833681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7fd130-1fa4-4700-97ae-ddf4b94bd19c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.835275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7fd130-1fa4-4700-97ae-ddf4b94bd19c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.836813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7fd130-1fa4-4700-97ae-ddf4b94bd19c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.847809 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e21ef377-38d4-4337-b4ac-1451000a9081 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "DELETE /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 204 len: 0 microversion: 2.1 time: 0.322381 Apr 02 20:52:46.848817 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 155/404] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:52:46 2022] DELETE /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:46.871061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad4ffc83-0cc3-41a5-ace4-b1a40e55cbd8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Action: 'create', calling method: .version_select at 0x7f54d5433820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1667390968"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:46.897993 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa7fd130-1fa4-4700-97ae-ddf4b94bd19c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080153 Apr 02 20:52:46.902523 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 250/405] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:52:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:46.913123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:46.919820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad4ffc83-0cc3-41a5-ace4-b1a40e55cbd8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:46.922932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:46.928692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad4ffc83-0cc3-41a5-ace4-b1a40e55cbd8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:46.934032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.934790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:46.936247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:46.936929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:47.367191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad4ffc83-0cc3-41a5-ace4-b1a40e55cbd8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:47.372976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad4ffc83-0cc3-41a5-ace4-b1a40e55cbd8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:47.405054 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad4ffc83-0cc3-41a5-ace4-b1a40e55cbd8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.554538 Apr 02 20:52:47.405997 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 156/406] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:46 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:47.411074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:47.412482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:47.426683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:47.427477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:47.428049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:47.428519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:47.507095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lazy-loading 'flavor' on Instance uuid 90048480-54e7-4b20-8d1b-d8c6a461de71 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:52:47.542379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Going to try to live migrate instance to nch1-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:52:47.999677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e4ad966924cf98c972f0fc0704fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493bc8b0b32f4804a5694c0bf34cdeb4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:48.012284 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1da83b5d-abf7-479f-a674-055e652aabd1 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 200 len: 1473 microversion: 2.1 time: 1.104689 Apr 02 20:52:48.013224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 251/407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:46 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 1473 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:48.026893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-04be5a1c-cb9b-4444-8ce5-11a3613e2149 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Action: 'create', calling method: .version_select at 0x7f54d509b9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-547607890"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:48.128422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-04be5a1c-cb9b-4444-8ce5-11a3613e2149 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:48.135222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-04be5a1c-cb9b-4444-8ce5-11a3613e2149 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:49.207726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-04be5a1c-cb9b-4444-8ce5-11a3613e2149 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:49.222633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-04be5a1c-cb9b-4444-8ce5-11a3613e2149 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:49.261502 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-04be5a1c-cb9b-4444-8ce5-11a3613e2149 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.245533 Apr 02 20:52:49.262462 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 252/408] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:48 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:49.274898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:49.278314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:49.288086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:49.289554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:49.290133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:49.290682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:49.748966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:49.762414 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-790ce3f3-7ae5-4230-a836-8b857a6b674e tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1468 microversion: 2.1 time: 0.498647 Apr 02 20:52:49.763061 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 253/409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:49 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1468 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:50.301368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fd04ebc1-08da-4e08-a34d-07d51dc10e05 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Action: 'create', calling method: .version_select at 0x7f54d5133f70>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:52.010450 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8eeb735-84dd-4817-9abd-85b450623a0c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71/action" status: 202 len: 0 microversion: 2.1 time: 4.603213 Apr 02 20:52:52.012576 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 157/410] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:52:47 2022] POST /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71/action => generated 0 bytes in 4606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:52.030269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:52.033939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] [instance: 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:52.091055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:52.091935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:52.093316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:52.095117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:52.119077 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] HTTP exception thrown: Instance 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f could not be found. Apr 02 20:52:52.120953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] Returning 404 to user: Instance 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:52.122014 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fe0315e-70ca-428a-a11a-1761e8891be4 tempest-LiveMigrationNegativeTest-1556791358 tempest-LiveMigrationNegativeTest-1556791358-project] 10.222.0.18 "GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f" status: 404 len: 111 microversion: 2.1 time: 0.107449 Apr 02 20:52:52.126105 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 158/411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:52 2022] GET /compute/v2.1/servers/956192a0-bfaa-49a0-ad2b-3fb4b6a2566f => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:52.134654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-454a919a-dbe8-494f-8642-87ff945f7a13 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Action: 'create', calling method: .version_select at 0x7f54d513d040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1028122631"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:52.153605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-454a919a-dbe8-494f-8642-87ff945f7a13 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:52.160998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-454a919a-dbe8-494f-8642-87ff945f7a13 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:52.898592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-454a919a-dbe8-494f-8642-87ff945f7a13 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:52.906556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-454a919a-dbe8-494f-8642-87ff945f7a13 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Getting quotas for user 681f1a15a4a94f5ea8e9762494c953ae and project c2496c2b222148dfad37efb60e08356b. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:52.934748 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-454a919a-dbe8-494f-8642-87ff945f7a13 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.807251 Apr 02 20:52:52.936057 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 159/412] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:52 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:53.314753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:53.315380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:53.329840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.332480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.333409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.337983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.400750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:52:53.570986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6824453c-fbb5-47aa-8786-541d80321bba tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 204 len: 0 microversion: 2.1 time: 0.633308 Apr 02 20:52:53.572705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 160/413] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:52:52 2022] DELETE /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:52:53.579253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fece9802-95f6-4c62-8add-7a85750cc69f req-90e30f8d-c2df-4aeb-9b54-3ac472698475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "956192a0-bfaa-49a0-ad2b-3fb4b6a2566f", "name": "network-vif-deleted", "tag": "dc71895b-80e5-4b2a-850c-ab6d2e2a4e12"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:53.589723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fece9802-95f6-4c62-8add-7a85750cc69f req-90e30f8d-c2df-4aeb-9b54-3ac472698475 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.590353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fece9802-95f6-4c62-8add-7a85750cc69f req-90e30f8d-c2df-4aeb-9b54-3ac472698475 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.604550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fece9802-95f6-4c62-8add-7a85750cc69f req-90e30f8d-c2df-4aeb-9b54-3ac472698475 service nova] Creating event network-vif-deleted:dc71895b-80e5-4b2a-850c-ab6d2e2a4e12 for instance 956192a0-bfaa-49a0-ad2b-3fb4b6a2566f on nch1-master-1 Apr 02 20:52:53.610922 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fece9802-95f6-4c62-8add-7a85750cc69f req-90e30f8d-c2df-4aeb-9b54-3ac472698475 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Apr 02 20:52:53.612230 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 161/414] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:53.813393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Calling method '.version_select at 0x7f54d5166040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:53.816638 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:53.816638 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:52:53.819665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.821089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.846075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.846889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.857233 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fd04ebc1-08da-4e08-a34d-07d51dc10e05 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.091094 Apr 02 20:52:53.858310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 254/415] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:52:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:53.864620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:53.865426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:53.878182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.880311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.880997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.886227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.887040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.888215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.901499 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-99721a10-f44c-4414-bc0b-b1a731ef22fe tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.287891 Apr 02 20:52:53.902396 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 162/416] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:53.909587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fea009b7-334b-48f7-9d95-4cd1c9f34512 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d5131040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:53.915788 ncdv-master-1 devstack@n-api.service[136517]: WARNING oslo_db.sqlalchemy.utils [None req-fea009b7-334b-48f7-9d95-4cd1c9f34512 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 02 20:52:53.934733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fea009b7-334b-48f7-9d95-4cd1c9f34512 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1675 microversion: 2.1 time: 0.031168 Apr 02 20:52:53.941316 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 163/417] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:52:53 2022] GET /compute/v2.1/os-keypairs => generated 1675 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:53.951438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:53.953388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:53.964821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.965465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:53.966294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:53.966856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:54.121607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:54.135795 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-842294dd-151e-403a-b45f-10097e59e9db tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.275984 Apr 02 20:52:54.145900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 255/418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:53 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:54.149260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f78ad5c-0f20-40ed-95f5-147dc1567694 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Calling method '.version_select at 0x7f54d5004040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.399177 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f78ad5c-0f20-40ed-95f5-147dc1567694 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/a00de447-64d1-4e41-b714-5e8792fc440c" status: 200 len: 141 microversion: 2.1 time: 0.261230 Apr 02 20:52:54.399955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 256/419] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-floating-ips/a00de447-64d1-4e41-b714-5e8792fc440c => generated 141 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:54.412290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:54.423817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17992362-0ccc-4f1b-8307-eebe463cf77b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1474 microversion: 2.1 time: 0.480882 Apr 02 20:52:54.425099 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 164/420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:53 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1474 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:54.444025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e1fed3b-5db6-4a93-943d-4146e99433d8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d515c940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.478066 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e1fed3b-5db6-4a93-943d-4146e99433d8 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1028122631" status: 202 len: 0 microversion: 2.1 time: 0.047659 Apr 02 20:52:54.481044 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 165/421] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Apr 2 20:52:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1028122631 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:54.489841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0f55702-f19d-47c2-9ea4-971e0d783ee7 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Calling method '.version_select at 0x7f54d5260dc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.625407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1820cfb-a869-470d-9975-d4bfc6b5ac23 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] Calling method '.version_select at 0x7f54d5004d30>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.626414 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:54.626414 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:54.627690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d1820cfb-a869-470d-9975-d4bfc6b5ac23 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '5e902cef0a67479090472d2bfa3bd928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9875c19e834d52b2f43c18e116140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:54.628379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1820cfb-a869-470d-9975-d4bfc6b5ac23 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:54.629304 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d1820cfb-a869-470d-9975-d4bfc6b5ac23 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.228462 Apr 02 20:52:54.629827 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 257/422] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:54.639126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b264894b-585a-48f7-92d9-2a39e0bd4932 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d509b280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.660743 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b264894b-585a-48f7-92d9-2a39e0bd4932 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-547607890" status: 202 len: 0 microversion: 2.1 time: 0.025191 Apr 02 20:52:54.661409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 258/423] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 20:52:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-547607890 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:54.667064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51ab3714-ccc0-4cd1-a3d4-70b9ded9c964 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Calling method '.version_select at 0x7f54d5004af0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.668940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51ab3714-ccc0-4cd1-a3d4-70b9ded9c964 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:54.669395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51ab3714-ccc0-4cd1-a3d4-70b9ded9c964 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:54.675425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-51ab3714-ccc0-4cd1-a3d4-70b9ded9c964 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Apr 02 20:52:54.676015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51ab3714-ccc0-4cd1-a3d4-70b9ded9c964 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:54.676876 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51ab3714-ccc0-4cd1-a3d4-70b9ded9c964 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.014366 Apr 02 20:52:54.677418 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 259/424] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:54.686264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa32bcce-e021-481e-967d-936214ba4ee7 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] Calling method '.version_select at 0x7f54d5133a60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.706591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa32bcce-e021-481e-967d-936214ba4ee7 tempest-KeyPairsV2TestJSON-1830952173 tempest-KeyPairsV2TestJSON-1830952173-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1667390968" status: 202 len: 0 microversion: 2.1 time: 0.024630 Apr 02 20:52:54.707446 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 260/425] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Apr 2 20:52:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1667390968 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:54.712615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Calling method '.version_select at 0x7f54d4f7d4c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.713765 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:54.713765 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:54.715330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:54.716129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:54.735486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:54.735994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:54.749559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:54.750567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:54.758285 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79fffc95-bdba-46c8-aaa4-ef070fe5770c tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049748 Apr 02 20:52:54.760002 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 261/426] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:54.774787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e403ad7b-1016-4f12-b44b-17a8a20ceec7 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] Calling method '.version_select at 0x7f54d4f7d8b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.776324 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:52:54.776324 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:52:54.779620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e403ad7b-1016-4f12-b44b-17a8a20ceec7 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '5e902cef0a67479090472d2bfa3bd928', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9875c19e834d52b2f43c18e116140c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:54.782855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e403ad7b-1016-4f12-b44b-17a8a20ceec7 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:54.789486 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e403ad7b-1016-4f12-b44b-17a8a20ceec7 tempest-HypervisorAdminNegativeUnderV252Test-1658149086 tempest-HypervisorAdminNegativeUnderV252Test-1658149086-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019692 Apr 02 20:52:54.796260 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 262/427] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:54.818466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e71f880-ea11-4f3b-8b83-180448b78c48 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Calling method '.version_select at 0x7f54d509b3a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:54.820826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e71f880-ea11-4f3b-8b83-180448b78c48 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:54.821244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e71f880-ea11-4f3b-8b83-180448b78c48 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:54.841636 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-3e71f880-ea11-4f3b-8b83-180448b78c48 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] HTTP exception thrown: No hypervisor matching '48be7c21-d567-48f4-a328-3a7873666193' could be found. Apr 02 20:52:54.842433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e71f880-ea11-4f3b-8b83-180448b78c48 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] Returning 404 to user: No hypervisor matching '48be7c21-d567-48f4-a328-3a7873666193' could be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:54.843942 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e71f880-ea11-4f3b-8b83-180448b78c48 tempest-HypervisorAdminNegativeUnderV252Test-574407760 tempest-HypervisorAdminNegativeUnderV252Test-574407760-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/48be7c21-d567-48f4-a328-3a7873666193/servers" status: 404 len: 123 microversion: 2.1 time: 0.041124 Apr 02 20:52:54.845626 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 263/428] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-hypervisors/48be7c21-d567-48f4-a328-3a7873666193/servers => generated 123 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:52:55.155468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:55.156288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:55.169022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:55.170214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:55.172839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:55.173313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:55.275529 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0f55702-f19d-47c2-9ea4-971e0d783ee7 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.793099 Apr 02 20:52:55.276220 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 166/429] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 20:52:54 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:55.287889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9572f64b-1aa5-4bc2-9b7b-1383d75f76f6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Calling method '.version_select at 0x7f54d5198550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:55.354767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:55.363116 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec4e92a5-3597-4145-8328-a523551918d3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.212923 Apr 02 20:52:55.365850 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 264/430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:55 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:55.450498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:55.451836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:55.460912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:55.464252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:55.465768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:55.466999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:55.805346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:55.813946 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f226d362-67c5-431f-b02b-af29db962593 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1474 microversion: 2.1 time: 0.374544 Apr 02 20:52:55.826667 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 265/431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:55 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:55.834195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-be8e79be-6e9f-4de0-ba97-7368cbd6f415 req-8f5dc2a6-7f75-4848-b1bb-3e951f976dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90048480-54e7-4b20-8d1b-d8c6a461de71", "name": "network-vif-unplugged", "status": "completed", "tag": "df51f42c-1b75-412d-b9f6-4349066d58c2"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:55.847161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-be8e79be-6e9f-4de0-ba97-7368cbd6f415 req-8f5dc2a6-7f75-4848-b1bb-3e951f976dbc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:55.848127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-be8e79be-6e9f-4de0-ba97-7368cbd6f415 req-8f5dc2a6-7f75-4848-b1bb-3e951f976dbc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:55.870016 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-be8e79be-6e9f-4de0-ba97-7368cbd6f415 req-8f5dc2a6-7f75-4848-b1bb-3e951f976dbc service nova] Creating event network-vif-unplugged:df51f42c-1b75-412d-b9f6-4349066d58c2 for instance 90048480-54e7-4b20-8d1b-d8c6a461de71 on nch2-master-1 Apr 02 20:52:55.879650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-be8e79be-6e9f-4de0-ba97-7368cbd6f415 req-8f5dc2a6-7f75-4848-b1bb-3e951f976dbc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050410 Apr 02 20:52:55.881603 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 266/432] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:56.385999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:56.388345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:56.397052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:56.397754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:56.399966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:56.400625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:56.653218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:56.662653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8dbc125-eb90-4dcc-8d25-b24466b89ba3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.282667 Apr 02 20:52:56.676406 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 267/433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:56 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:56.834736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:56.837140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:56.854474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:56.857229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:56.858857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:56.860717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:57.094922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:57.107319 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a0c708b-6196-4c00-8de5-a0855fc42173 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 200 len: 1432 microversion: 2.1 time: 0.277236 Apr 02 20:52:57.107929 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 268/434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:56 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 1432 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:52:57.241210 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9572f64b-1aa5-4bc2-9b7b-1383d75f76f6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/a00de447-64d1-4e41-b714-5e8792fc440c" status: 202 len: 0 microversion: 2.1 time: 1.957616 Apr 02 20:52:57.242895 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 167/435] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:52:55 2022] DELETE /compute/v2.1/os-floating-ips/a00de447-64d1-4e41-b714-5e8792fc440c => generated 0 bytes in 1960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:52:57.252378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-badfe799-0810-44f6-a783-e065d5843dbf tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Action: 'create', calling method: .version_select at 0x7f54d51339d0>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:57.681112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:57.682226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:57.704107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:57.706690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:57.707778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:57.709874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:57.996044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:58.003896 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9247e031-e9a7-4d6e-b5b2-97ba10233834 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.327092 Apr 02 20:52:58.005267 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 168/436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:57 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:58.180156 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c721cce-cf41-46d6-8968-f983b3f60ace tempest-TenantUsagesNegativeTestJSON-632804493 tempest-TenantUsagesNegativeTestJSON-632804493-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-01T20%3A52%3A57.738752&end=2022-04-03T20%3A52%3A57.738752" status: 404 len: 112 microversion: - time: 0.173527 Apr 02 20:52:58.180858 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 169/437] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Apr 2 20:52:58 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-01T20%3A52%3A57.738752&end=2022-04-03T20%3A52%3A57.738752 => generated 112 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 02 20:52:58.185458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-27f205b9-61ee-46c3-aef9-7f7493be62d3 req-7a11d672-1126-470d-a288-1fd785e2d51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90048480-54e7-4b20-8d1b-d8c6a461de71", "tag": "df51f42c-1b75-412d-b9f6-4349066d58c2"}, {"server_uuid": "014472c4-1c30-4532-b3c6-f008e2778674", "name": "network-vif-deleted", "tag": "6a0a7717-2bfa-4c0d-8e10-daf1dc138f06"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:58.195601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27f205b9-61ee-46c3-aef9-7f7493be62d3 req-7a11d672-1126-470d-a288-1fd785e2d51a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:58.196273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27f205b9-61ee-46c3-aef9-7f7493be62d3 req-7a11d672-1126-470d-a288-1fd785e2d51a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:58.209328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-27f205b9-61ee-46c3-aef9-7f7493be62d3 req-7a11d672-1126-470d-a288-1fd785e2d51a service nova] Creating event network-changed:df51f42c-1b75-412d-b9f6-4349066d58c2 for instance 90048480-54e7-4b20-8d1b-d8c6a461de71 on nch2-master-1 Apr 02 20:52:58.209912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-27f205b9-61ee-46c3-aef9-7f7493be62d3 req-7a11d672-1126-470d-a288-1fd785e2d51a service nova] Creating event network-vif-deleted:6a0a7717-2bfa-4c0d-8e10-daf1dc138f06 for instance 014472c4-1c30-4532-b3c6-f008e2778674 on nch1-master-1 Apr 02 20:52:58.224299 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-27f205b9-61ee-46c3-aef9-7f7493be62d3 req-7a11d672-1126-470d-a288-1fd785e2d51a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040126 Apr 02 20:52:58.224810 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 170/438] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:58.295334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25866489-bb78-43dd-919e-9f410b5cb9de tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Calling method '.version_select at 0x7f54d5198f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:58.320762 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-25866489-bb78-43dd-919e-9f410b5cb9de tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] HTTP exception thrown: Image not found. Apr 02 20:52:58.321869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25866489-bb78-43dd-919e-9f410b5cb9de tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.323271 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25866489-bb78-43dd-919e-9f410b5cb9de tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] 10.222.0.18 "DELETE /compute/v2.1/images/ca58687f-9721-4a3d-9050-fce4994e19e9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.096902 Apr 02 20:52:58.324230 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 171/439] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 20:52:58 2022] DELETE /compute/v2.1/images/ca58687f-9721-4a3d-9050-fce4994e19e9/metadata/os_distro => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:58.381991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2e2c14a-790f-4c07-acad-2cefbe6312a6 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d51685e0>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:58.389207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c2e2c14a-790f-4c07-acad-2cefbe6312a6 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Apr 02 20:52:58.390091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2e2c14a-790f-4c07-acad-2cefbe6312a6 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.391439 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c2e2c14a-790f-4c07-acad-2cefbe6312a6 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.065472 Apr 02 20:52:58.393201 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 172/440] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:58 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:52:58.400635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:58.401639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:58.408012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:58.408793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:58.409820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:58.410472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:58.424745 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] HTTP exception thrown: Instance 014472c4-1c30-4532-b3c6-f008e2778674 could not be found. Apr 02 20:52:58.425791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Returning 404 to user: Instance 014472c4-1c30-4532-b3c6-f008e2778674 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.426747 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4656a3b-0961-4106-8a71-0d0b2d638915 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 404 len: 111 microversion: 2.1 time: 0.032123 Apr 02 20:52:58.437788 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 173/441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:58 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:58.446296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b78f7e2c-43c1-4f4c-878a-09e88da41aef tempest-TenantUsagesNegativeTestJSON-632804493 tempest-TenantUsagesNegativeTestJSON-632804493-project-admin] Calling method '.version_select at 0x7f54d51d09d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:58.453007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b78f7e2c-43c1-4f4c-878a-09e88da41aef tempest-TenantUsagesNegativeTestJSON-632804493 tempest-TenantUsagesNegativeTestJSON-632804493-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Apr 02 20:52:58.453601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b78f7e2c-43c1-4f4c-878a-09e88da41aef tempest-TenantUsagesNegativeTestJSON-632804493 tempest-TenantUsagesNegativeTestJSON-632804493-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.454588 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b78f7e2c-43c1-4f4c-878a-09e88da41aef tempest-TenantUsagesNegativeTestJSON-632804493 tempest-TenantUsagesNegativeTestJSON-632804493-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/3f5ee31cb0954403a80a9edea439fdda?start=2022-04-03T20%3A52%3A57.738752&end=2022-04-01T20%3A52%3A57.738752" status: 400 len: 111 microversion: 2.1 time: 0.015420 Apr 02 20:52:58.455660 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 174/442] 10.222.0.18 () {58 vars in 1411 bytes} [Sat Apr 2 20:52:58 2022] GET /compute/v2.1/os-simple-tenant-usage/3f5ee31cb0954403a80a9edea439fdda?start=2022-04-03T20%3A52%3A57.738752&end=2022-04-01T20%3A52%3A57.738752 => generated 111 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:52:58.462549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e24fb2a-1440-41a9-b830-e4252af52e0c tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Calling method '.version_select at 0x7f54d5168ca0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:58.488884 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1e24fb2a-1440-41a9-b830-e4252af52e0c tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] HTTP exception thrown: Image not found. Apr 02 20:52:58.489823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e24fb2a-1440-41a9-b830-e4252af52e0c tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.490862 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e24fb2a-1440-41a9-b830-e4252af52e0c tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] 10.222.0.18 "GET /compute/v2.1/images/81c4fa9c-bd86-4a91-86cc-7dbca39c5701/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.033911 Apr 02 20:52:58.493082 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 175/443] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 20:52:58 2022] GET /compute/v2.1/images/81c4fa9c-bd86-4a91-86cc-7dbca39c5701/metadata/os_version => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:58.499331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4109e41-124b-40de-9ea8-dee54a4e1c8c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d5198e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-882771234", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:58.534804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-e4109e41-124b-40de-9ea8-dee54a4e1c8c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:58.546234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-e4109e41-124b-40de-9ea8-dee54a4e1c8c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for user d3e44392fbac42388dd99c039d470029 and project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:58.574854 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e4109e41-124b-40de-9ea8-dee54a4e1c8c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 02 20:52:58.575494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4109e41-124b-40de-9ea8-dee54a4e1c8c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.576323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e4109e41-124b-40de-9ea8-dee54a4e1c8c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.082106 Apr 02 20:52:58.577102 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 176/444] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Apr 2 20:52:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:52:58.834775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5c87b7-957b-45a6-8528-b34d17da9451 tempest-TenantUsagesNegativeTestJSON-439882838 tempest-TenantUsagesNegativeTestJSON-439882838-project] Calling method '.version_select at 0x7f54d513d820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:58.837192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b5c87b7-957b-45a6-8528-b34d17da9451 tempest-TenantUsagesNegativeTestJSON-439882838 tempest-TenantUsagesNegativeTestJSON-439882838-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b2acbd3c9ddf41dd8577b9d3049bd7ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5ee31cb0954403a80a9edea439fdda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:58.838798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5c87b7-957b-45a6-8528-b34d17da9451 tempest-TenantUsagesNegativeTestJSON-439882838 tempest-TenantUsagesNegativeTestJSON-439882838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.839882 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b5c87b7-957b-45a6-8528-b34d17da9451 tempest-TenantUsagesNegativeTestJSON-439882838 tempest-TenantUsagesNegativeTestJSON-439882838-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-01T20%3A52%3A57.738752&end=2022-04-03T20%3A52%3A57.738752&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.261087 Apr 02 20:52:58.845103 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 177/445] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Apr 2 20:52:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-01T20%3A52%3A57.738752&end=2022-04-03T20%3A52%3A57.738752&detailed=1 => generated 123 bytes in 267 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:52:58.851778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-005288c2-1c56-41de-910a-c027d1e009b4 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Calling method '.version_select at 0x7f54d5198e50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:58.861499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-badfe799-0810-44f6-a783-e065d5843dbf tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.612877 Apr 02 20:52:58.869614 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 269/446] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:52:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:52:58.874322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-386404277", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:58.878808 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-005288c2-1c56-41de-910a-c027d1e009b4 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] HTTP exception thrown: Image not found. Apr 02 20:52:58.879853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-005288c2-1c56-41de-910a-c027d1e009b4 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:58.880943 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-005288c2-1c56-41de-910a-c027d1e009b4 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] 10.222.0.18 "GET /compute/v2.1/images/17293b2f-4d72-4dc1-8a34-a54de1e5b721/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034599 Apr 02 20:52:58.887123 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 178/447] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:52:58 2022] GET /compute/v2.1/images/17293b2f-4d72-4dc1-8a34-a54de1e5b721/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:58.893131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a988760e-912f-4b63-a2a3-392cc9375452 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d51d0c10>, body: {"keypair": {"name": "tempest-keypair-2073138986"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:58.910134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a988760e-912f-4b63-a2a3-392cc9375452 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:58.928553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a988760e-912f-4b63-a2a3-392cc9375452 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for user d3e44392fbac42388dd99c039d470029 and project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:58.939328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:52:59.185260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:52:59.185619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:52:59.186655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:52:59.187615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:52:59.188235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:52:59.196471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a988760e-912f-4b63-a2a3-392cc9375452 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:59.199078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:59.199761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:59.200781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:59.201402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a988760e-912f-4b63-a2a3-392cc9375452 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for user d3e44392fbac42388dd99c039d470029 and project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:59.201867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:59.220006 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a988760e-912f-4b63-a2a3-392cc9375452 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.331278 Apr 02 20:52:59.221147 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 179/448] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:58 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:59.226462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0c95e7bf-385c-43ef-b375-0056b7f59792 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Calling method '.version_select at 0x7f54d5131160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:59.236314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Getting quotas for project 7755ff4a52a843d5afe245dd067d37fb. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:59.243284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Getting quotas for user b6bd66a0c09642dc91a334698fbd4daa and project 7755ff4a52a843d5afe245dd067d37fb. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:52:59.258759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:52:59.261874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:52:59.325617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc63cc9f-b4b3-4269-ae35-02d2ae85ef9c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454854 Apr 02 20:52:59.327254 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 270/449] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:52:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:52:59.351628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-62092a2e-480a-4c9b-bd79-31e54e2403f8 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Action: 'update_all', calling method: .version_select at 0x7f54d53fbd30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:59.387614 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-62092a2e-480a-4c9b-bd79-31e54e2403f8 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] HTTP exception thrown: Image not found. Apr 02 20:52:59.388528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-62092a2e-480a-4c9b-bd79-31e54e2403f8 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:52:59.390293 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-62092a2e-480a-4c9b-bd79-31e54e2403f8 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] 10.222.0.18 "PUT /compute/v2.1/images/2f03cce5-0f13-4d01-8bbd-9f41ff0408cf/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061250 Apr 02 20:52:59.392256 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 271/450] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 20:52:59 2022] PUT /compute/v2.1/images/2f03cce5-0f13-4d01-8bbd-9f41ff0408cf/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:52:59.417444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:52:59.418160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:52:59.436739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:59.438247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:59.440580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:52:59.441458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:52:59.706725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:52:59.715737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4561e75a-1bf4-4517-8e5c-0b2e4067e20a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.319100 Apr 02 20:52:59.731656 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 272/451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:52:59 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:52:59.745135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d3a8e2e-8b91-4771-a0b8-b26c855f088c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d4ff1430>, body: {"keypair": {"name": "tempest-keypair-2073138986"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:52:59.775503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7d3a8e2e-8b91-4771-a0b8-b26c855f088c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:52:59.786733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7d3a8e2e-8b91-4771-a0b8-b26c855f088c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for user d3e44392fbac42388dd99c039d470029 and project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:00.129386 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-7d3a8e2e-8b91-4771-a0b8-b26c855f088c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] HTTP exception thrown: Key pair 'tempest-keypair-2073138986' already exists. Apr 02 20:53:00.130022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d3a8e2e-8b91-4771-a0b8-b26c855f088c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 409 to user: Key pair 'tempest-keypair-2073138986' already exists. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.130900 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d3a8e2e-8b91-4771-a0b8-b26c855f088c tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.397516 Apr 02 20:53:00.137654 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 273/452] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:52:59 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 405 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:53:00.143137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:00.143750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:00.151444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:00.151904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:00.152748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:00.153750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:00.243391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:00.253016 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8cdcc2b0-10ce-43ba-82ce-f440d0d0458d tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1215 microversion: 2.1 time: 0.114676 Apr 02 20:53:00.254029 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 274/453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:00 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:00.266530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ae38aa7-e118-4c53-8192-69927cd7c363 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Action: 'update', calling method: .version_select at 0x7f54d4f7dc10>, body: {"meta": {"os_distro": "alt"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:00.293450 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4ae38aa7-e118-4c53-8192-69927cd7c363 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] HTTP exception thrown: Image not found. Apr 02 20:53:00.294054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ae38aa7-e118-4c53-8192-69927cd7c363 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.294893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ae38aa7-e118-4c53-8192-69927cd7c363 tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] 10.222.0.18 "PUT /compute/v2.1/images/4ae37295-577f-4d1b-9a08-6bedad1557d8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.039865 Apr 02 20:53:00.299663 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 275/454] 10.222.0.18 () {60 vars in 1309 bytes} [Sat Apr 2 20:53:00 2022] PUT /compute/v2.1/images/4ae37295-577f-4d1b-9a08-6bedad1557d8/metadata/os_distro => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:53:00.300373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d64b590-485e-473a-bfe4-ea14357bb086 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Calling method '.version_select at 0x7f54d5004ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:00.331541 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d64b590-485e-473a-bfe4-ea14357bb086 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073138986" status: 202 len: 0 microversion: 2.1 time: 0.035012 Apr 02 20:53:00.332119 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 276/455] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073138986 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:00.340755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87245ae8-5904-4389-9d12-fa9ba4075a4f tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Action: 'create', calling method: .version_select at 0x7f54d5004820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:00.362498 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-87245ae8-5904-4389-9d12-fa9ba4075a4f tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] HTTP exception thrown: Image not found. Apr 02 20:53:00.363103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87245ae8-5904-4389-9d12-fa9ba4075a4f tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.363923 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87245ae8-5904-4389-9d12-fa9ba4075a4f tempest-ImagesMetadataNegativeTestJSON-1819102593 tempest-ImagesMetadataNegativeTestJSON-1819102593-project] 10.222.0.18 "POST /compute/v2.1/images/d9c793df-4cc0-41bd-9935-41b514ffcedb/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030862 Apr 02 20:53:00.364692 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 277/456] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Apr 2 20:53:00 2022] POST /compute/v2.1/images/d9c793df-4cc0-41bd-9935-41b514ffcedb/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:53:00.486019 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0c95e7bf-385c-43ef-b375-0056b7f59792 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/027ed45c-aa9d-4d2a-a68e-6dad1f1ed733" status: 202 len: 0 microversion: 2.1 time: 1.263387 Apr 02 20:53:00.487234 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 180/457] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:52:59 2022] DELETE /compute/v2.1/os-floating-ips/027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 => generated 0 bytes in 1266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:00.494239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79e78994-42f5-4b68-8280-f3add0f86db8 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d53fa670>, body: {"keypair": {"name": ""}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:00.496275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79e78994-42f5-4b68-8280-f3add0f86db8 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.497514 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79e78994-42f5-4b68-8280-f3add0f86db8 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008893 Apr 02 20:53:00.498690 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 181/458] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:53:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:53:00.504595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ed7564e-47de-403f-8554-d5cbd73e24c6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Calling method '.version_select at 0x7f54d51154c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:00.559618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-7ed7564e-47de-403f-8554-d5cbd73e24c6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 could not be found", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:53:00.560833 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-7ed7564e-47de-403f-8554-d5cbd73e24c6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] HTTP exception thrown: Floating IP not found for ID 027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 Apr 02 20:53:00.561430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ed7564e-47de-403f-8554-d5cbd73e24c6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Returning 404 to user: Floating IP not found for ID 027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.563294 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ed7564e-47de-403f-8554-d5cbd73e24c6 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/027ed45c-aa9d-4d2a-a68e-6dad1f1ed733" status: 404 len: 111 microversion: 2.1 time: 0.063244 Apr 02 20:53:00.564379 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 182/459] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:53:00 2022] GET /compute/v2.1/os-floating-ips/027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:00.569614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1d01ebd-5256-43bb-9801-70a86924aec9 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d545f790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-253137328", "public_key": " "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:00.585142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c1d01ebd-5256-43bb-9801-70a86924aec9 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:00.589122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c1d01ebd-5256-43bb-9801-70a86924aec9 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for user d3e44392fbac42388dd99c039d470029 and project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:00.607312 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c1d01ebd-5256-43bb-9801-70a86924aec9 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 02 20:53:00.608219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1d01ebd-5256-43bb-9801-70a86924aec9 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.608825 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1d01ebd-5256-43bb-9801-70a86924aec9 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.043248 Apr 02 20:53:00.615636 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 183/460] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:53:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:00.615636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-007d4f34-51d5-443f-9146-fa0b313568b4 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Calling method '.version_select at 0x7f54d51ee0d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:00.664166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-007d4f34-51d5-443f-9146-fa0b313568b4 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 could not be found", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:53:00.664896 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-007d4f34-51d5-443f-9146-fa0b313568b4 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] HTTP exception thrown: Floating IP not found for ID 027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 Apr 02 20:53:00.665504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-007d4f34-51d5-443f-9146-fa0b313568b4 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] Returning 404 to user: Floating IP not found for ID 027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.666346 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-007d4f34-51d5-443f-9146-fa0b313568b4 tempest-FloatingIPsTestJSON-1312895134 tempest-FloatingIPsTestJSON-1312895134-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/027ed45c-aa9d-4d2a-a68e-6dad1f1ed733" status: 404 len: 111 microversion: 2.1 time: 0.055546 Apr 02 20:53:00.666916 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 184/461] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:53:00 2022] DELETE /compute/v2.1/os-floating-ips/027ed45c-aa9d-4d2a-a68e-6dad1f1ed733 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:00.673776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2437533c-395a-4120-919b-fc9d575ab0b5 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d5131b80>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:00.674093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2437533c-395a-4120-919b-fc9d575ab0b5 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.675255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2437533c-395a-4120-919b-fc9d575ab0b5 tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.007419 Apr 02 20:53:00.676122 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 185/462] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Apr 2 20:53:00 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:53:00.688523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d63bdd71-6a4c-433a-b21b-10dad701848f tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Action: 'create', calling method: .version_select at 0x7f54d515c0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-148322522", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:00.706745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d63bdd71-6a4c-433a-b21b-10dad701848f tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:00.711517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d63bdd71-6a4c-433a-b21b-10dad701848f tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Getting quotas for user d3e44392fbac42388dd99c039d470029 and project ad36f69b8e4e4691ad078f8f626f41df. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:00.733077 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-d63bdd71-6a4c-433a-b21b-10dad701848f tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 02 20:53:00.734172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d63bdd71-6a4c-433a-b21b-10dad701848f tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:00.736076 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d63bdd71-6a4c-433a-b21b-10dad701848f tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.052087 Apr 02 20:53:00.737848 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 186/463] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Apr 2 20:53:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:00.745859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:00.746735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:00.753534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:00.753990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:00.754774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:00.755222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:00.939201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-39e19360-5e6b-414e-b967-163a083f8a01 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Action: 'update', calling method: .version_select at 0x7f54d4f7dee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:01.034995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:01.043323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c54b21d-4855-45b6-b03d-0cd8e6d6aacd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.304211 Apr 02 20:53:01.043900 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 187/464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:00 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:01.066528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0f8f43e-ade8-4aeb-bb6e-b6a54cc6653a tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Calling method '.version_select at 0x7f54d51ee3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:01.091544 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e0f8f43e-ade8-4aeb-bb6e-b6a54cc6653a tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1044208690 not found for user d3e44392fbac42388dd99c039d470029 Apr 02 20:53:01.092378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0f8f43e-ade8-4aeb-bb6e-b6a54cc6653a tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1044208690 not found for user d3e44392fbac42388dd99c039d470029 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:01.093826 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0f8f43e-ade8-4aeb-bb6e-b6a54cc6653a tempest-KeyPairsNegativeTestJSON-1816468872 tempest-KeyPairsNegativeTestJSON-1816468872-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1044208690" status: 404 len: 145 microversion: 2.1 time: 0.036063 Apr 02 20:53:01.096102 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 188/465] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:53:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1044208690 => generated 145 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:01.215029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e19360-5e6b-414e-b967-163a083f8a01 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:01.219007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e19360-5e6b-414e-b967-163a083f8a01 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:01.221334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e19360-5e6b-414e-b967-163a083f8a01 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:01.222653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e19360-5e6b-414e-b967-163a083f8a01 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:01.271860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:01.272284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:01.286986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:01.287726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:01.296369 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-39e19360-5e6b-414e-b967-163a083f8a01 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9" status: 200 len: 148 microversion: 2.57 time: 0.929641 Apr 02 20:53:01.297677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:01.298258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:01.298430 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 278/466] 10.222.0.18 () {62 vars in 1302 bytes} [Sat Apr 2 20:53:00 2022] PUT /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9 => generated 148 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:53:01.310620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-47407cda-c395-42cd-9e2e-fd39def8f02d tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Calling method '.version_select at 0x7f54d4f92790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:01.405512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:01.415336 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1236dd6a-0fd5-43f0-8d00-7e1ad33688b6 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1277 microversion: 2.1 time: 0.147979 Apr 02 20:53:01.423564 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 189/467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:01 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:01.597583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47407cda-c395-42cd-9e2e-fd39def8f02d tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:01.599421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47407cda-c395-42cd-9e2e-fd39def8f02d tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:01.601921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47407cda-c395-42cd-9e2e-fd39def8f02d tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:01.603234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47407cda-c395-42cd-9e2e-fd39def8f02d tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:01.656871 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-47407cda-c395-42cd-9e2e-fd39def8f02d tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9/detail" status: 200 len: 463 microversion: 2.57 time: 0.331950 Apr 02 20:53:01.670232 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 279/468] 10.222.0.18 () {60 vars in 1303 bytes} [Sat Apr 2 20:53:01 2022] GET /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9/detail => generated 463 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:53:02.061912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:02.062633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:02.080529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.081474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.083738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.085850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.199544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Action: 'update', calling method: .version_select at 0x7f54d5133f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:02.521825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:02.531118 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1ac59465-7b7a-4986-87f9-92956e1ec6cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.474942 Apr 02 20:53:02.535220 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 190/469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:02 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:02.545437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:02.553092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:02.564943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.570241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.571472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.571999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.630693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.630693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.631444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.632637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.708935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.709457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.710849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:02.711294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:02.826302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5f7df72-13fb-40b7-af0e-6a981be19331 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9?user_id=6fab18174a2c4635ad8a606f03c964ab" status: 200 len: 148 microversion: 2.57 time: 0.630407 Apr 02 20:53:02.832546 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 280/470] 10.222.0.18 () {62 vars in 1383 bytes} [Sat Apr 2 20:53:02 2022] PUT /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9?user_id=6fab18174a2c4635ad8a606f03c964ab => generated 148 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:53:02.838531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b2c9613-ed9e-4b6d-936a-d1baa8117470 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] Calling method '.version_select at 0x7f54d4f92f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:03.004150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:03.016357 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e17c04bd-ce0b-4f70-8338-40d62235ee2c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1319 microversion: 2.1 time: 0.475768 Apr 02 20:53:03.017975 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 191/471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:02 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:03.380545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b2c9613-ed9e-4b6d-936a-d1baa8117470 tempest-QuotasAdminTestV257-1211582799 tempest-QuotasAdminTestV257-1211582799-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9?user_id=6fab18174a2c4635ad8a606f03c964ab" status: 200 len: 190 microversion: 2.57 time: 0.546278 Apr 02 20:53:03.386751 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 281/472] 10.222.0.18 () {60 vars in 1363 bytes} [Sat Apr 2 20:53:02 2022] GET /compute/v2.1/os-quota-sets/ce70ee8fbea64070b76ff7540377a9c9?user_id=6fab18174a2c4635ad8a606f03c964ab => generated 190 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:53:03.550960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:03.551552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:03.563938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-461a3389-8e47-4e23-af23-8bb12d3c08ba req-a7a526ea-d3b9-4d08-9473-ae0d60ae9f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7df662-e1f8-4b13-8774-cebcd1d703a4", "tag": "5df181c0-2ca5-438b-9cc6-9e344369eb5b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:03.579251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:03.586575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-461a3389-8e47-4e23-af23-8bb12d3c08ba req-a7a526ea-d3b9-4d08-9473-ae0d60ae9f6e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:03.587434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:03.588418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:03.589098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-461a3389-8e47-4e23-af23-8bb12d3c08ba req-a7a526ea-d3b9-4d08-9473-ae0d60ae9f6e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:03.589709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:03.636281 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-461a3389-8e47-4e23-af23-8bb12d3c08ba req-a7a526ea-d3b9-4d08-9473-ae0d60ae9f6e service nova] Creating event network-changed:5df181c0-2ca5-438b-9cc6-9e344369eb5b for instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 on nch2-master-1 Apr 02 20:53:03.646291 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-461a3389-8e47-4e23-af23-8bb12d3c08ba req-a7a526ea-d3b9-4d08-9473-ae0d60ae9f6e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085922 Apr 02 20:53:03.652887 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 282/473] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:53:03.963867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:03.975170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afcc537b-b3df-44b9-a0cf-76dcb2a25249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.428315 Apr 02 20:53:03.977706 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 192/474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:03 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:04.035427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:04.036441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:04.048228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:04.050816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:04.054717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:04.055677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:04.599379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:04.621165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-758e3851-afbe-4a2b-8465-b13148eb6d7a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1319 microversion: 2.1 time: 0.591014 Apr 02 20:53:04.621331 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 283/475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:04 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:04.878799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1513202520", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:04.993545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:53:04.994254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:04.995009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:05.004749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:05.005225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:05.006031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:05.006487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:05.455950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:05.464511 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-141b00ec-67ea-493d-8d8b-8c9a1d25fcc6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 0.476007 Apr 02 20:53:05.465612 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 284/476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:04 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:05.638516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:05.639400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:05.646671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:05.647121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:05.648149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:05.648622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:05.994096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:53:05.995145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:53:06.001053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:53:06.001573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:53:06.002062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:53:06.011457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:06.012040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:06.012958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:06.013430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:06.037732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Getting quotas for project ee534be172494c1b842d8749d1dfe969. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:06.050770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Getting quotas for user 481d41af70a54782ad2d569d058d6fdc and project ee534be172494c1b842d8749d1dfe969. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:06.064930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:53:06.067781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:06.092151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:06.106307 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b58dd49b-23ab-4249-b77b-6ae8699d423f tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1319 microversion: 2.1 time: 0.471432 Apr 02 20:53:06.107280 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 285/477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:05 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:06.123717 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-265c7d18-0436-400b-a722-55963e1bf6d6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687095 Apr 02 20:53:06.124955 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 193/478] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 20:53:06.134615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5edce6e-0e0a-4d4e-9c17-cf2ac62eb0e5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:06.135232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5edce6e-0e0a-4d4e-9c17-cf2ac62eb0e5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:06.211522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5edce6e-0e0a-4d4e-9c17-cf2ac62eb0e5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:06.218783 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5edce6e-0e0a-4d4e-9c17-cf2ac62eb0e5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1217 microversion: 2.1 time: 0.087969 Apr 02 20:53:06.219935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 286/479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:06 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:06.483222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:06.483833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:06.490190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:06.490876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:06.491915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:06.492854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:07.126475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:07.127852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:07.138804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:07.140909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:07.142153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:07.143595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:07.462798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:07.478502 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ea9fc656-b110-452a-b723-57323bd6f19d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1504 microversion: 2.1 time: 1.000309 Apr 02 20:53:07.492792 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 194/480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:06 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1504 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:07.499100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:07.499932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:07.507479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:07.508664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:07.509652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:07.511211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:07.762849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:07.771270 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-270248a8-8eb7-4033-bb4b-84882e4f6d28 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1275 microversion: 2.1 time: 0.276574 Apr 02 20:53:07.783028 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 195/481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:07 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:07.900331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:07.911083 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9155a632-a83f-407a-ac8f-bac165490f2b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1319 microversion: 2.1 time: 0.791654 Apr 02 20:53:07.912744 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 287/482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:07 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1319 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:08.502733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:08.505738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:08.530100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:08.532366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:08.540512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:08.543946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:08.791361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:08.791972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:08.807036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:08.807751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:08.808948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:08.809554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:08.969661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:08.981497 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e16ec7dd-820a-4615-887e-31439c6f2a58 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1275 microversion: 2.1 time: 0.195409 Apr 02 20:53:08.993416 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 288/483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:08 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:08.999787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:09.001199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:09.039278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:09.041138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:09.044411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:09.045167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:09.483122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:09.494857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fb383d06-7d55-4a5e-bac4-3ec66ed9ec04 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1319 microversion: 2.1 time: 0.500215 Apr 02 20:53:09.497528 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 289/484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:08 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:09.618368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:09.626722 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c855bc2d-bf7e-4058-a505-812e764b5dd8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1494 microversion: 2.1 time: 1.133738 Apr 02 20:53:09.627309 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 196/485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:08 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1494 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:09.656701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-83239e1d-6a6a-45a3-b043-e109328b6a94 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '.version_select at 0x7f54d50ba040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:09.661298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83239e1d-6a6a-45a3-b043-e109328b6a94 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:09.661762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83239e1d-6a6a-45a3-b043-e109328b6a94 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:09.697986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-83239e1d-6a6a-45a3-b043-e109328b6a94 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.047724 Apr 02 20:53:09.706501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 197/486] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:53:09 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:09.718921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:09.719577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:09.733564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:09.733956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:09.737019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:09.737702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:09.814455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1474327894", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "0f6792b8-5956-4f22-8fa8-e47e1a830c39"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:09.933713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] validate_networks() for [('0f6792b8-5956-4f22-8fa8-e47e1a830c39', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:53:10.148120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2214fea0-edb0-41e2-8aa6-dd360a557f33 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1645 microversion: 2.1 time: 0.440315 Apr 02 20:53:10.165390 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 198/487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:09 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1645 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:10.189172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-bf9ab2d6-493a-4844-9044-165627a0ade6 req-3b19cf28-f919-49d6-acab-90f047ad51bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7df662-e1f8-4b13-8774-cebcd1d703a4", "name": "network-vif-plugged", "status": "completed", "tag": "5df181c0-2ca5-438b-9cc6-9e344369eb5b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:10.199265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bf9ab2d6-493a-4844-9044-165627a0ade6 req-3b19cf28-f919-49d6-acab-90f047ad51bc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:10.199975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bf9ab2d6-493a-4844-9044-165627a0ade6 req-3b19cf28-f919-49d6-acab-90f047ad51bc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:10.213161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-bf9ab2d6-493a-4844-9044-165627a0ade6 req-3b19cf28-f919-49d6-acab-90f047ad51bc service nova] Creating event network-vif-plugged:5df181c0-2ca5-438b-9cc6-9e344369eb5b for instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 on nch2-master-1 Apr 02 20:53:10.220208 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-bf9ab2d6-493a-4844-9044-165627a0ade6 req-3b19cf28-f919-49d6-acab-90f047ad51bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043709 Apr 02 20:53:10.222159 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 199/488] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:10.232477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:10.237127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:10.254098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:10.257875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:10.258929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:10.259604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:10.825822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:10.835472 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6efb6f87-eca0-4474-9297-f453fb6b1bc7 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 0.611230 Apr 02 20:53:10.836329 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 200/489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:10 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:10.842325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:10.843685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:10.852750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:10.853636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:10.854647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:10.855305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:11.123205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:53:11.124673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:53:11.125333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:53:11.125958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:53:11.126577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:53:11.143636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:11.144126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:11.145816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:11.150043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:11.172503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Getting quotas for project 89b61101b5644010bc714c2cdeba96eb. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:11.178057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Getting quotas for user 82d0dd5279384016ba00c5688ce1d615 and project 89b61101b5644010bc714c2cdeba96eb. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:11.192816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Going to run 3 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:53:11.196116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:11.237895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=98a121f5-71aa-45c3-9a40-c1534709b364,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:11.285840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=94aec714-8ebc-4f16-8b88-6cc60f848fa5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:11.381119 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-84e4a724-ca07-4a2d-8243-3db846062ed9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882161 Apr 02 20:53:11.383734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:11.389135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 290/490] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:53:11.394987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1656382175", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "83a57283-8e77-4048-913b-713f633ea68f"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:11.399887 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-baaec8fd-9736-446e-8bfd-d9d4f2ccfa7c tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1319 microversion: 2.1 time: 0.561965 Apr 02 20:53:11.403550 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 201/491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:10 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:11.423155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:11.458587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:11.466858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:53:11.527431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] validate_networks() for [('83a57283-8e77-4048-913b-713f633ea68f', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:53:11.554054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:11.555653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:11.557015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:11.557615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:11.739783 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a2e3fac-9ca5-4fd5-819f-ddcffc808f69 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.332587 Apr 02 20:53:11.746751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 202/492] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 20:53:11 2022] GET /compute/v2.1/servers => generated 1018 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:12.291009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6e06e970-ab5e-4c53-bfb6-21e9b1a14a43 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] 10.222.0.18 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.543100 Apr 02 20:53:12.292351 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 203/493] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:53:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 545 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 02 20:53:12.300294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f2621763-a8b8-45c9-b981-1dd29dd42700 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:12.302417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f2621763-a8b8-45c9-b981-1dd29dd42700 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:12.469879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f2621763-a8b8-45c9-b981-1dd29dd42700 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:12.479900 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f2621763-a8b8-45c9-b981-1dd29dd42700 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1223 microversion: 2.1 time: 0.185885 Apr 02 20:53:12.484872 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 204/494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:12 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1223 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:12.507280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:12.507903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:12.524986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:12.525368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:12.529477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:12.540570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:12.910733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:53:12.911913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:53:12.912592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:53:12.913173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:53:12.913930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:53:12.932764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:12.933229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:12.934052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:12.936685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:12.985514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:12.998939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for user a2e061bb9a054fb1945417baf444eaee and project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:13.022138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:53:13.025504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:13.070742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:13.083562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-251bcdc6-31e1-4c66-97b5-89312a04c17d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 0.595883 Apr 02 20:53:13.088422 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 205/495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:12 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:13.098008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93a094cb-953e-4be8-bdeb-66b27d05810e tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Calling method '.version_select at 0x7f54d50c1f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.125522 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23fa40a7-50ce-42ec-87a6-08aad4e5ff03 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.732850 Apr 02 20:53:13.132811 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 291/496] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:53:13.142309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.144120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:13.157832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.160614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.164886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.166233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.177979 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-93a094cb-953e-4be8-bdeb-66b27d05810e tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] HTTP exception thrown: Image not found. Apr 02 20:53:13.179299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93a094cb-953e-4be8-bdeb-66b27d05810e tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:13.180150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93a094cb-953e-4be8-bdeb-66b27d05810e tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] 10.222.0.18 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.090569 Apr 02 20:53:13.180731 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 206/497] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 20:53:13 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:53:13.185766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5a3eeac1-b0be-47c8-8502-448dd928544c req-6c21fb24-5036-49cb-9e51-1a5f8841876a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:13.215536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5a3eeac1-b0be-47c8-8502-448dd928544c req-6c21fb24-5036-49cb-9e51-1a5f8841876a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.216322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5a3eeac1-b0be-47c8-8502-448dd928544c req-6c21fb24-5036-49cb-9e51-1a5f8841876a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.242076 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5a3eeac1-b0be-47c8-8502-448dd928544c req-6c21fb24-5036-49cb-9e51-1a5f8841876a service nova] Creating event network-changed:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:53:13.252837 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5a3eeac1-b0be-47c8-8502-448dd928544c req-6c21fb24-5036-49cb-9e51-1a5f8841876a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070354 Apr 02 20:53:13.256329 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 207/498] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:13.270858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-392da260-2eee-462c-af55-e80ad724c74e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.271822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-392da260-2eee-462c-af55-e80ad724c74e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:13.373138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-392da260-2eee-462c-af55-e80ad724c74e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:13.379923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-392da260-2eee-462c-af55-e80ad724c74e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1211 microversion: 2.1 time: 0.122129 Apr 02 20:53:13.380520 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 208/499] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:13 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:13.390560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f411d59-c9bc-45d3-9a89-99adc67b08f4 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Calling method '.version_select at 0x7f54d5115940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.442897 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4f411d59-c9bc-45d3-9a89-99adc67b08f4 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] HTTP exception thrown: Image not found. Apr 02 20:53:13.443770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f411d59-c9bc-45d3-9a89-99adc67b08f4 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:13.445478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f411d59-c9bc-45d3-9a89-99adc67b08f4 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] 10.222.0.18 "DELETE /compute/v2.1/images/b54b3a70-ec6c-4d24-8179-af8aa7e7179j" status: 404 len: 62 microversion: 2.1 time: 0.063015 Apr 02 20:53:13.446664 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 209/500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:13 2022] DELETE /compute/v2.1/images/b54b3a70-ec6c-4d24-8179-af8aa7e7179j => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:53:13.457014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-377c464f-49e0-4baa-b414-0f9a6cba4ff6 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Calling method '.version_select at 0x7f54d5115b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.479176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-377c464f-49e0-4baa-b414-0f9a6cba4ff6 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] HTTP exception thrown: Image not found. Apr 02 20:53:13.480012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-377c464f-49e0-4baa-b414-0f9a6cba4ff6 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:13.481119 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-377c464f-49e0-4baa-b414-0f9a6cba4ff6 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] 10.222.0.18 "DELETE /compute/v2.1/images/5d8e5a9b-b29d-4d22-b1b1-d9dc84672cb81" status: 404 len: 62 microversion: 2.1 time: 0.029145 Apr 02 20:53:13.482200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 210/501] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:13 2022] DELETE /compute/v2.1/images/5d8e5a9b-b29d-4d22-b1b1-d9dc84672cb81 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:53:13.492316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ac46444-76de-459f-9479-155ed851ab37 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Calling method '.version_select at 0x7f54d513df70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.523566 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0ac46444-76de-459f-9479-155ed851ab37 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] HTTP exception thrown: Image not found. Apr 02 20:53:13.524225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ac46444-76de-459f-9479-155ed851ab37 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:13.525236 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ac46444-76de-459f-9479-155ed851ab37 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] 10.222.0.18 "DELETE /compute/v2.1/images/tempest-invalid-1034628090" status: 404 len: 62 microversion: 2.1 time: 0.038187 Apr 02 20:53:13.526299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 211/502] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 20:53:13 2022] DELETE /compute/v2.1/images/tempest-invalid-1034628090 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:53:13.540861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.542033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:13.555839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.557042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.558765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.559793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.638585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:13.657052 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f683c01d-1214-4d51-bc23-4d490fd96385 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1468 microversion: 2.1 time: 0.522870 Apr 02 20:53:13.658171 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 292/503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:13 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1468 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:13.669530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac33314c-688b-4ecd-b901-d9186491cd70 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Calling method '.version_select at 0x7f54d4f7d160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:13.710139 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ac33314c-688b-4ecd-b901-d9186491cd70 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] HTTP exception thrown: Image not found. Apr 02 20:53:13.711023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac33314c-688b-4ecd-b901-d9186491cd70 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:13.712086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac33314c-688b-4ecd-b901-d9186491cd70 tempest-ImagesDeleteNegativeTestJSON-809020112 tempest-ImagesDeleteNegativeTestJSON-809020112-project] 10.222.0.18 "DELETE /compute/v2.1/images/29c98fab-f95e-4ed2-a23f-9a6bd38971bd" status: 404 len: 62 microversion: 2.1 time: 0.052628 Apr 02 20:53:13.713565 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 293/504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:13 2022] DELETE /compute/v2.1/images/29c98fab-f95e-4ed2-a23f-9a6bd38971bd => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:53:13.722027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:13.723292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:13.743701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.744722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.746917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:13.748960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:13.793362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:13.807998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-468a1271-cd92-4668-870b-f984b6ffb906 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1227 microversion: 2.1 time: 0.279790 Apr 02 20:53:13.816193 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 212/505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:13 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1227 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:14.103847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:14.105143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:14.118154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:14.122724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:14.128825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:14.129678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:14.187790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7d0eb82-b421-4e8a-b548-cd4fbe1ba0f1 tempest-DeleteServersAdminTestJSON-498974367 tempest-DeleteServersAdminTestJSON-498974367-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4/action" status: 202 len: 0 microversion: 2.1 time: 0.472345 Apr 02 20:53:14.191334 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 294/506] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:53:13 2022] POST /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:14.204061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:14.206193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:14.223882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:14.224632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:14.226508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:14.228721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:14.410645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:14.411104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:14.411576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lazy-loading 'fault' on Instance uuid 9e7df662-e1f8-4b13-8774-cebcd1d703a4 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:53:15.431892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:15.439927 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ac6aa92-a3e6-43e1-9e7c-7ce705dc9bb9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 1.342114 Apr 02 20:53:15.452787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 213/507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:14 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:15.466018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:15.466901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:15.478505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.481037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.483501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.484150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.567085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:15.580061 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc926cad-9f7c-4245-a690-205b14d0d9c9 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1451 microversion: 2.1 time: 1.384153 Apr 02 20:53:15.580697 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 295/508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:14 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1451 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:15.592300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:15.592975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:15.605397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.606053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.606863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.607311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.643540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:15.658864 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d833f2c1-ad22-4de8-957b-00cda81833b3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1269 microversion: 2.1 time: 0.204621 Apr 02 20:53:15.660299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 214/509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:15 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1269 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:15.667225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:15.668016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:15.675473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.676203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.677676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.678804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.706551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:53:15.763113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:15.774665 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-792a2dc7-ff50-4055-8767-fa2ffe295351 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1281 microversion: 2.1 time: 0.192847 Apr 02 20:53:15.775908 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 296/510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:15 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:15.805421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6859c84-9824-4abe-add0-89665b42669a tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 204 len: 0 microversion: 2.1 time: 0.142348 Apr 02 20:53:15.806500 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 215/511] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:15 2022] DELETE /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:53:15.818188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:15.819977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:15.825862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.826325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.827118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.827789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.860219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:15.860720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:15.861502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lazy-loading 'fault' on Instance uuid 9e7df662-e1f8-4b13-8774-cebcd1d703a4 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:53:16.282144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:16.292668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-14ecea80-3322-48a1-8743-37a82791b1cc tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1457 microversion: 2.1 time: 0.480983 Apr 02 20:53:16.305583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 297/512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:15 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1457 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:16.477559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:16.477559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:16.484891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:16.485381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:16.487386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:16.487843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:16.681539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:16.682848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:16.697222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:16.702562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:16.703919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:16.704723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:16.946000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:16.955020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1e41333-8c0d-453b-8aff-adc23e2f5d46 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1269 microversion: 2.1 time: 0.279837 Apr 02 20:53:16.960116 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 298/513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:16 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1269 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:16.973164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:16.977643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:16.993657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:16.995665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:16.998095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:17.000589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:17.200084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:17.207837 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d20d65c1-5c08-4485-9934-84800944466e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 0.749680 Apr 02 20:53:17.208414 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 216/514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:16 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:17.237929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:17.247415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-57ad700a-4c6e-48af-ac30-8e2ff3113fad tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1281 microversion: 2.1 time: 0.284586 Apr 02 20:53:17.257015 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 299/515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:16 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1281 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:17.313435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:17.314054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:17.322372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:17.322825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:17.323607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:17.324044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:17.398325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:17.398799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:17.399251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lazy-loading 'fault' on Instance uuid 9e7df662-e1f8-4b13-8774-cebcd1d703a4 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:53:17.994357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6bd66a0c09642dc91a334698fbd4daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7755ff4a52a843d5afe245dd067d37fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:18.011884 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11ecd215-b6d9-457f-8558-c7d6b0d632ae tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 200 len: 1457 microversion: 2.1 time: 0.703998 Apr 02 20:53:18.013152 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 217/516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:17 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 1457 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:18.018011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:18.018832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:18.037444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:18.038082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:18.039032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:18.039624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:18.399344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cc2e35c-498b-493c-a791-a0cbac7f83c6 tempest-ListImageFiltersNegativeTestJSON-1637198591 tempest-ListImageFiltersNegativeTestJSON-1637198591-project] Calling method '.version_select at 0x7f54d4ee7550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:18.442040 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-7cc2e35c-498b-493c-a791-a0cbac7f83c6 tempest-ListImageFiltersNegativeTestJSON-1637198591 tempest-ListImageFiltersNegativeTestJSON-1637198591-project] HTTP exception thrown: Image not found. Apr 02 20:53:18.442640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cc2e35c-498b-493c-a791-a0cbac7f83c6 tempest-ListImageFiltersNegativeTestJSON-1637198591 tempest-ListImageFiltersNegativeTestJSON-1637198591-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:18.447032 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cc2e35c-498b-493c-a791-a0cbac7f83c6 tempest-ListImageFiltersNegativeTestJSON-1637198591 tempest-ListImageFiltersNegativeTestJSON-1637198591-project] 10.222.0.18 "GET /compute/v2.1/images/5d9a235e-d769-4dfc-8c22-2b8606ab597d" status: 404 len: 62 microversion: 2.1 time: 0.522609 Apr 02 20:53:18.454837 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 300/517] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:17 2022] GET /compute/v2.1/images/5d9a235e-d769-4dfc-8c22-2b8606ab597d => generated 62 bytes in 532 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:53:18.462850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d9570e74-3dd9-4679-abd3-ddaeaeaf8ef7 req-cb8d488a-fec9-4038-bf64-c6f7bd96b078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7df662-e1f8-4b13-8774-cebcd1d703a4", "name": "network-vif-deleted", "tag": "5df181c0-2ca5-438b-9cc6-9e344369eb5b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:18.488827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d9570e74-3dd9-4679-abd3-ddaeaeaf8ef7 req-cb8d488a-fec9-4038-bf64-c6f7bd96b078 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:18.489304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d9570e74-3dd9-4679-abd3-ddaeaeaf8ef7 req-cb8d488a-fec9-4038-bf64-c6f7bd96b078 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:18.504172 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d9570e74-3dd9-4679-abd3-ddaeaeaf8ef7 req-cb8d488a-fec9-4038-bf64-c6f7bd96b078 service nova] Creating event network-vif-deleted:5df181c0-2ca5-438b-9cc6-9e344369eb5b for instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 on nch2-master-1 Apr 02 20:53:18.514187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d9570e74-3dd9-4679-abd3-ddaeaeaf8ef7 req-cb8d488a-fec9-4038-bf64-c6f7bd96b078 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056945 Apr 02 20:53:18.519139 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 301/518] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:18.528928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:18.529866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:18.571496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:18.571981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:18.583335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:18.583873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:19.165217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:19.180026 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ba00009f-d053-4bf8-b5c2-7dbfd1487791 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 1.162173 Apr 02 20:53:19.180944 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 218/519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:18 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:19.192439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:19.193625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:19.206369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:19.207001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:19.209942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:19.210744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:19.557672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:19.575616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf915dee-44d3-4909-8af4-2c93cda007ca tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 1.049309 Apr 02 20:53:19.576540 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 302/520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:18 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:19.585751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:19.586754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:19.602314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:19.602937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:19.603874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:19.604475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:19.630737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] HTTP exception thrown: Instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 could not be found. Apr 02 20:53:19.631370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Returning 404 to user: Instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:19.632222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e555ea96-06b1-4ba7-a9dd-ace54922f521 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 404 len: 111 microversion: 2.1 time: 0.054298 Apr 02 20:53:19.652969 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 303/521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:19 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:19.833198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1711472645", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:19.954185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:53:20.104676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:20.142717 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e1fe3bb-adb0-45c1-8aaf-d4387ec35f54 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.960536 Apr 02 20:53:20.147885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 219/522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:19 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:20.167070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:20.169493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:20.190752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.194843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.196225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.197684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.227071 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] HTTP exception thrown: Instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 could not be found. Apr 02 20:53:20.247034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Returning 404 to user: Instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:20.248533 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1f053883-2c1d-4ef2-992c-2a9573baf719 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 404 len: 111 microversion: 2.1 time: 0.099124 Apr 02 20:53:20.252472 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 220/523] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:20 2022] DELETE /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:20.258099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:20.258969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:20.276243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.277105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.278120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.278770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.496530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:53:20.497195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:53:20.497848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:53:20.498403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:53:20.499141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:53:20.529162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.530815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.531956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.544742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.577380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Getting quotas for project 0e3659a4fe104604ab6161e28854b4a6. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:20.587441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Getting quotas for user c24dff48d3544e049af02871f27b2a2c and project 0e3659a4fe104604ab6161e28854b4a6. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:20.612952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:53:20.615786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:20.669128 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5ffe846e-e253-41e2-aeb4-4ba0cfd41f72 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009691 Apr 02 20:53:20.670270 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 304/524] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:53:20.675535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:20.676239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 9e7df662-e1f8-4b13-8774-cebcd1d703a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:20.687682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.688275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.689197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.689912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.723834 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] HTTP exception thrown: Instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 could not be found. Apr 02 20:53:20.724767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Returning 404 to user: Instance 9e7df662-e1f8-4b13-8774-cebcd1d703a4 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:20.726492 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe1d9697-8671-4540-b477-55ee111136da tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4" status: 404 len: 111 microversion: 2.1 time: 0.054486 Apr 02 20:53:20.730725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 305/525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:20 2022] GET /compute/v2.1/servers/9e7df662-e1f8-4b13-8774-cebcd1d703a4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:20.736324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:20.737169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:20.745429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.746224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:20.747490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:20.748093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:21.103898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:21.120418 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32643e20-79bc-4e2b-87be-91e7e62d946e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 0.388288 Apr 02 20:53:21.137892 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 306/526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:20 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:21.151527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ca4ac59-0d05-4c90-a727-584225f05d74 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:21.152215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ca4ac59-0d05-4c90-a727-584225f05d74 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:21.335899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ca4ac59-0d05-4c90-a727-584225f05d74 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:21.344409 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ca4ac59-0d05-4c90-a727-584225f05d74 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1223 microversion: 2.1 time: 0.205359 Apr 02 20:53:21.348788 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 307/527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:21 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:21.356891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:21.363290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:21.381603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:21.382069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:21.382886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:21.383329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:21.432499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] HTTP exception thrown: Instance 014472c4-1c30-4532-b3c6-f008e2778674 could not be found. Apr 02 20:53:21.435448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Returning 404 to user: Instance 014472c4-1c30-4532-b3c6-f008e2778674 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:21.437977 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebe08cb3-30cd-4a6f-814b-fe10e3990b0b tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "DELETE /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 404 len: 111 microversion: 2.1 time: 0.086821 Apr 02 20:53:21.443999 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 308/528] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:21 2022] DELETE /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:21.457626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ab7ad683-3f90-434c-96a5-b8c1cf911a5f req-65b388fd-8681-499d-80e7-44db90a4402f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94aec714-8ebc-4f16-8b88-6cc60f848fa5", "tag": "0010195d-fd1b-4803-93c3-4bf1afaebdc0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:21.480070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ab7ad683-3f90-434c-96a5-b8c1cf911a5f req-65b388fd-8681-499d-80e7-44db90a4402f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:21.481012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ab7ad683-3f90-434c-96a5-b8c1cf911a5f req-65b388fd-8681-499d-80e7-44db90a4402f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:21.511298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ab7ad683-3f90-434c-96a5-b8c1cf911a5f req-65b388fd-8681-499d-80e7-44db90a4402f service nova] Creating event network-changed:0010195d-fd1b-4803-93c3-4bf1afaebdc0 for instance 94aec714-8ebc-4f16-8b88-6cc60f848fa5 on nch2-master-1 Apr 02 20:53:21.521851 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ab7ad683-3f90-434c-96a5-b8c1cf911a5f req-65b388fd-8681-499d-80e7-44db90a4402f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072725 Apr 02 20:53:21.524196 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 309/529] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:21.531716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:21.532797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:21.540986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:21.541913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:21.542927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:21.543621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.038202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:22.048814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:22.053437 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9722f89-e390-4fec-ba3c-d713482b6530 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 1.799271 Apr 02 20:53:22.054030 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 221/530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:20 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:22.065743 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5e45e8bf-bf2d-47d3-9dc7-425348aed3ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.539220 Apr 02 20:53:22.080314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:22.080927 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 310/531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:21 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:22.081273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] [instance: 014472c4-1c30-4532-b3c6-f008e2778674] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:22.088819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.089277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.092697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.093170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.109852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5f4637ed-65cc-4a23-b1d9-a563aeb9f3ea req-4ffcfaa7-d2ef-468a-b497-3077107d900e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23aa3120-1d16-4505-a3c5-0ba81a38c743", "tag": "c462078a-088f-40a2-8510-d6fb4357f7dc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:22.122270 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] HTTP exception thrown: Instance 014472c4-1c30-4532-b3c6-f008e2778674 could not be found. Apr 02 20:53:22.122886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] Returning 404 to user: Instance 014472c4-1c30-4532-b3c6-f008e2778674 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:22.123804 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-326d135e-a582-48b3-84b3-f73ac5c58934 tempest-DeleteServersAdminTestJSON-318202056 tempest-DeleteServersAdminTestJSON-318202056-project] 10.222.0.18 "GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674" status: 404 len: 111 microversion: 2.1 time: 0.059937 Apr 02 20:53:22.132707 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 222/532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:22 2022] GET /compute/v2.1/servers/014472c4-1c30-4532-b3c6-f008e2778674 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:22.153517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:22.154232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:22.155730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5f4637ed-65cc-4a23-b1d9-a563aeb9f3ea req-4ffcfaa7-d2ef-468a-b497-3077107d900e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.158900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5f4637ed-65cc-4a23-b1d9-a563aeb9f3ea req-4ffcfaa7-d2ef-468a-b497-3077107d900e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.165339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.171268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.172431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.173080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.224247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5f4637ed-65cc-4a23-b1d9-a563aeb9f3ea req-4ffcfaa7-d2ef-468a-b497-3077107d900e service nova] Creating event network-changed:c462078a-088f-40a2-8510-d6fb4357f7dc for instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 on nch2-master-1 Apr 02 20:53:22.246086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5f4637ed-65cc-4a23-b1d9-a563aeb9f3ea req-4ffcfaa7-d2ef-468a-b497-3077107d900e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159638 Apr 02 20:53:22.250369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 311/533] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:22.367553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:22.368619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:22.383590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.384286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.385333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:22.386494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:22.675957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:22.685880 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a8f8302-8310-4153-a018-e94ce34dbfc9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1283 microversion: 2.1 time: 0.321600 Apr 02 20:53:22.686609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 312/534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:22 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1283 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:23.033368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d4fed7e8-4972-44a9-9eaa-8a1a72cb7260 req-32763bbe-5368-47e0-aeea-13b4f700a6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "name": "network-vif-plugged", "status": "completed", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:23.042236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d4fed7e8-4972-44a9-9eaa-8a1a72cb7260 req-32763bbe-5368-47e0-aeea-13b4f700a6ba service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.042931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d4fed7e8-4972-44a9-9eaa-8a1a72cb7260 req-32763bbe-5368-47e0-aeea-13b4f700a6ba service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.072684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d4fed7e8-4972-44a9-9eaa-8a1a72cb7260 req-32763bbe-5368-47e0-aeea-13b4f700a6ba service nova] Creating event network-vif-plugged:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:53:23.082065 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d4fed7e8-4972-44a9-9eaa-8a1a72cb7260 req-32763bbe-5368-47e0-aeea-13b4f700a6ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058200 Apr 02 20:53:23.083337 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 313/535] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:53:23.094112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:23.095279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:23.131528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.136058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.153701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.154467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.649322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:23.658314 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46007d1e-f0a2-4f70-8d6c-0cc43eb4f917 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 0.572703 Apr 02 20:53:23.659408 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 314/536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:23 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:23.664805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:23.667673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:23.669233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:23.678829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c715137-ff7d-4d96-a01d-d1562b769c9d tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 1.529196 Apr 02 20:53:23.680080 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 223/537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:22 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:23.690786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.692287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.694931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.695644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.704062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:23.705428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:23.717670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.718031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.718865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:23.719306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:23.933414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:23.950939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d0ec177-4bf1-41c2-9325-c35654b2b4f1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1281 microversion: 2.1 time: 0.249980 Apr 02 20:53:23.952984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 224/538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:23 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:24.236359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:24.283633 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-37e30a2e-fad1-41fe-9bc1-10783d026c73 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.622481 Apr 02 20:53:24.285346 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 315/539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:23 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:24.340356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b9544590-22ac-45e4-ba60-6a09968bb4d9 req-ff102fed-f21c-49e3-bde4-c9aa7041cde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c0c36e-2bc2-43ab-96c0-1582c8b94e00", "tag": "9682d761-627f-435b-8889-b0b79b5a3c78"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:24.356756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b9544590-22ac-45e4-ba60-6a09968bb4d9 req-ff102fed-f21c-49e3-bde4-c9aa7041cde9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:24.357308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b9544590-22ac-45e4-ba60-6a09968bb4d9 req-ff102fed-f21c-49e3-bde4-c9aa7041cde9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:24.381470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b9544590-22ac-45e4-ba60-6a09968bb4d9 req-ff102fed-f21c-49e3-bde4-c9aa7041cde9 service nova] Creating event network-changed:9682d761-627f-435b-8889-b0b79b5a3c78 for instance 61c0c36e-2bc2-43ab-96c0-1582c8b94e00 on nch1-master-1 Apr 02 20:53:24.395965 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b9544590-22ac-45e4-ba60-6a09968bb4d9 req-ff102fed-f21c-49e3-bde4-c9aa7041cde9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059123 Apr 02 20:53:24.397773 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 225/540] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:24.679646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:24.683192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:24.695939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:24.699226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:24.700757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:24.702105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:24.705048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:24.706114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:24.711978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:24.712442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:24.713455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:24.719801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:25.090944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:25.101636 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb72afc4-ea66-4e6b-9dd4-574010ec78f2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 0.429789 Apr 02 20:53:25.102286 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 316/541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:24 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:25.109544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:25.110433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:25.118024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:25.118973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:25.120134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:25.120795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:25.450408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:25.462531 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc4bbb66-55af-4a12-b037-576623240aa9 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.357668 Apr 02 20:53:25.464173 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 317/542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:25 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:25.487496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:25.488491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:25.499248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:25.500891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:25.502722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:25.503982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:26.020683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:26.037167 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f08e8a6c-d222-4eff-b764-58d83724a854 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1317 microversion: 2.1 time: 1.341432 Apr 02 20:53:26.038179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:26.041172 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 226/543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:24 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1317 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:26.063106 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a16045b1-7590-46af-98ed-fbbd352d610f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.597058 Apr 02 20:53:26.064820 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 318/544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:25 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:26.122557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:26.124301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:26.136753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:26.138384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:26.139619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:26.140464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:26.304957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0949fc26-8378-4e5a-8ef1-9884ab45fc94 req-e8da605e-a58a-45d6-8e54-c8430a7bcdde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6c04cc-d558-4512-a7cf-6306a624af7b", "tag": "38aff574-c6a0-4aad-aadc-b0fdbe398a3b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:26.324988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0949fc26-8378-4e5a-8ef1-9884ab45fc94 req-e8da605e-a58a-45d6-8e54-c8430a7bcdde service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:26.325439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0949fc26-8378-4e5a-8ef1-9884ab45fc94 req-e8da605e-a58a-45d6-8e54-c8430a7bcdde service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:26.407122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0949fc26-8378-4e5a-8ef1-9884ab45fc94 req-e8da605e-a58a-45d6-8e54-c8430a7bcdde service nova] Creating event network-changed:38aff574-c6a0-4aad-aadc-b0fdbe398a3b for instance 0f6c04cc-d558-4512-a7cf-6306a624af7b on nch2-master-1 Apr 02 20:53:26.422717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0949fc26-8378-4e5a-8ef1-9884ab45fc94 req-e8da605e-a58a-45d6-8e54-c8430a7bcdde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122818 Apr 02 20:53:26.433835 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 319/545] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:26.493776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c96f9cd9-1556-425b-83ee-792ab0818930 req-597265a4-d140-47a8-a089-c1ccc08eb4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a121f5-71aa-45c3-9a40-c1534709b364", "tag": "7452f163-14e5-4e33-a069-7a4221cce019"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:26.505379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c96f9cd9-1556-425b-83ee-792ab0818930 req-597265a4-d140-47a8-a089-c1ccc08eb4f6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:26.505901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c96f9cd9-1556-425b-83ee-792ab0818930 req-597265a4-d140-47a8-a089-c1ccc08eb4f6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:26.551153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c96f9cd9-1556-425b-83ee-792ab0818930 req-597265a4-d140-47a8-a089-c1ccc08eb4f6 service nova] Creating event network-changed:7452f163-14e5-4e33-a069-7a4221cce019 for instance 98a121f5-71aa-45c3-9a40-c1534709b364 on nch2-master-1 Apr 02 20:53:26.570701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c96f9cd9-1556-425b-83ee-792ab0818930 req-597265a4-d140-47a8-a089-c1ccc08eb4f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094474 Apr 02 20:53:26.571632 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 320/546] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 02 20:53:26.585421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:26.589380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:26.605162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:26.605878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:26.606870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:26.607470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:27.415479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:27.424650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19928ca6-d7c2-4e24-9d66-8d79b8f2f12f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.851261 Apr 02 20:53:27.425785 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 321/547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:26 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:27.431411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:27.432258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:27.440205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:27.441188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:27.442396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:27.443625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:27.913301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:27.929537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6d0b7ca-1013-44d7-91f9-3fbc86d1fb29 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 1.814057 Apr 02 20:53:27.930285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 227/548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:26 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:27.935967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:27.937230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:27.954250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:27.954499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:27.955317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:27.955751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:28.401285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:28.415230 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c602e22-d454-4737-83dd-fc32e1801837 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1467 microversion: 2.1 time: 0.988040 Apr 02 20:53:28.416274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 322/549] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:27 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1467 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:28.432608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-41cdc5df-8685-42a2-aea2-3991afe6062b req-689dc197-e296-4c12-a1e0-937e0f07e75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94aec714-8ebc-4f16-8b88-6cc60f848fa5", "name": "network-vif-plugged", "status": "completed", "tag": "0010195d-fd1b-4803-93c3-4bf1afaebdc0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:28.489765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-41cdc5df-8685-42a2-aea2-3991afe6062b req-689dc197-e296-4c12-a1e0-937e0f07e75e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:28.491202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-41cdc5df-8685-42a2-aea2-3991afe6062b req-689dc197-e296-4c12-a1e0-937e0f07e75e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:28.509520 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-41cdc5df-8685-42a2-aea2-3991afe6062b req-689dc197-e296-4c12-a1e0-937e0f07e75e service nova] Creating event network-vif-plugged:0010195d-fd1b-4803-93c3-4bf1afaebdc0 for instance 94aec714-8ebc-4f16-8b88-6cc60f848fa5 on nch2-master-1 Apr 02 20:53:28.517194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-41cdc5df-8685-42a2-aea2-3991afe6062b req-689dc197-e296-4c12-a1e0-937e0f07e75e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099149 Apr 02 20:53:28.522305 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 323/550] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:28.570813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1780308666", "metadata": {"image_type": "test"}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:28.575919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:28.601380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:28.602143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:28.603379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:28.605956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:28.660287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Getting quotas for project ee534be172494c1b842d8749d1dfe969. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:28.665863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Getting quotas for user 481d41af70a54782ad2d569d058d6fdc and project ee534be172494c1b842d8749d1dfe969. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:28.863562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:28.871717 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-edc44faf-1db3-4085-b901-af55f330f799 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.940178 Apr 02 20:53:28.881603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 228/551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:27 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:28.894661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:28.895548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:28.903774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:28.904606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:28.905589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:28.906201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:29.102909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21188ab9-fcfc-4ce8-994e-9fd3fd77edcc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "POST /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d/action" status: 202 len: 0 microversion: 2.1 time: 0.578979 Apr 02 20:53:29.103805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 324/552] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:53:28 2022] POST /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 20:53:29.303346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce36f023-9414-4715-b3b4-8b048d943b24 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-723604993", "id": 1851678742, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:29.309446 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:29.309446 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:29.339314 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce36f023-9414-4715-b3b4-8b048d943b24 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.231662 Apr 02 20:53:29.341783 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 325/553] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:29 2022] POST /compute/v2.1/flavors => generated 429 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:29.365476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:29.366510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:29.381520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:29.383256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:29.384233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:29.385114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:29.820142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:29.844361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:29.862792 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad701bdc-ac92-4e0d-a5e2-f7b201743b95 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.979852 Apr 02 20:53:29.863876 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c27ae25-6fb6-4c30-a961-84339050ad0b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 0.488452 Apr 02 20:53:29.864402 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 229/554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:28 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:29.870450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-feeb8483-42f8-4577-9a33-5a84caf2dc50 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d51660d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:29.874224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 326/555] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:29 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:29.882309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c48ff30f-0340-4d00-8d5e-fadeb62d2469 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:29.885565 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:29.885565 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:29.920310 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c48ff30f-0340-4d00-8d5e-fadeb62d2469 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1851678742" status: 202 len: 0 microversion: 2.1 time: 0.044906 Apr 02 20:53:29.921112 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 327/556] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:53:29 2022] DELETE /compute/v2.1/flavors/1851678742 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:29.928300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:29.929190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:29.941721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:29.942190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:29.943002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:29.945665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:29.960258 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-feeb8483-42f8-4577-9a33-5a84caf2dc50 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.093987 Apr 02 20:53:29.965951 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 230/557] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:29 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:29.976362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7117966a-6967-441d-a17b-c6c15ac426a0 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.012771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7117966a-6967-441d-a17b-c6c15ac426a0 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.050453 Apr 02 20:53:30.026210 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 231/558] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:29 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.032128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e36c157c-e51e-4b4d-8e48-ac6be7fafc46 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-449085152", "id": 222996386, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:30.034387 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:30.034387 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:53:30.054412 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e36c157c-e51e-4b4d-8e48-ac6be7fafc46 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.026731 Apr 02 20:53:30.065103 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 232/559] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:30 2022] POST /compute/v2.1/flavors => generated 413 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:30.073040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee7666fa-4324-4676-9ea9-70cdf8b25dbe tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.102481 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee7666fa-4324-4676-9ea9-70cdf8b25dbe tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.034956 Apr 02 20:53:30.103791 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 233/560] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.118333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4231904-e9dc-4a43-a4cf-d7f50c42b404 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.119286 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:30.119286 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:53:30.140998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e4231904-e9dc-4a43-a4cf-d7f50c42b404 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/222996386" status: 202 len: 0 microversion: 2.1 time: 0.026526 Apr 02 20:53:30.141791 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 234/561] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:53:30 2022] DELETE /compute/v2.1/flavors/222996386 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:53:30.152690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6af2dfb-2f19-4584-be20-760170fc0d1a tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.182296 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6af2dfb-2f19-4584-be20-760170fc0d1a tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035747 Apr 02 20:53:30.183491 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 235/562] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.199818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdaaea56-4662-4800-84ef-08ef0f23feca tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1841502771", "id": 2003358401, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:30.223495 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bdaaea56-4662-4800-84ef-08ef0f23feca tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.027750 Apr 02 20:53:30.225121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 236/563] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:30 2022] POST /compute/v2.1/flavors => generated 429 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:30.240983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-59777800-fa39-4b42-b0c1-7fb596680b54 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.262064 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-59777800-fa39-4b42-b0c1-7fb596680b54 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2003358401" status: 202 len: 0 microversion: 2.1 time: 0.025764 Apr 02 20:53:30.263395 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 237/564] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:53:30 2022] DELETE /compute/v2.1/flavors/2003358401 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:30.272253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f75f77e5-1488-4694-8ccd-ff341db00556 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.296112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f75f77e5-1488-4694-8ccd-ff341db00556 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028701 Apr 02 20:53:30.297323 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 238/565] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.313070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ffe523d-3e45-4a73-80b2-ba38c68dc333 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1122003083", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:30.338020 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ffe523d-3e45-4a73-80b2-ba38c68dc333 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028813 Apr 02 20:53:30.344811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 239/566] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:30 2022] POST /compute/v2.1/flavors => generated 507 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:53:30.350871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4aa95424-d541-4ffe-acf0-6c8fce4163ce tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.361336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:30.372007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4aa95424-d541-4ffe-acf0-6c8fce4163ce tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/c55c0ae4-e7b6-4459-8ef2-03da8e1f13af" status: 202 len: 0 microversion: 2.1 time: 0.025664 Apr 02 20:53:30.373001 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 240/567] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:30 2022] DELETE /compute/v2.1/flavors/c55c0ae4-e7b6-4459-8ef2-03da8e1f13af => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:30.377146 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fb5b4f0f-b8a3-4ac0-83b6-f697dca7f475 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.452277 Apr 02 20:53:30.381550 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 328/568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:29 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.385089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01149af9-0707-4ddb-b6ad-80c6ec8bb88a tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.412867 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01149af9-0707-4ddb-b6ad-80c6ec8bb88a tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035294 Apr 02 20:53:30.414569 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 241/569] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.429852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aeab789e-c330-420d-91d8-175a74e28202 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-293419959", "id": "53e34615-f316-4c42-8304-7711a91c7bf9", "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:30.432830 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:30.432830 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:30.466930 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aeab789e-c330-420d-91d8-175a74e28202 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.040697 Apr 02 20:53:30.469464 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 329/570] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:30 2022] POST /compute/v2.1/flavors => generated 506 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:30.479788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-387c12fb-7838-48e5-9ab4-8bf09279052b tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.499585 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-387c12fb-7838-48e5-9ab4-8bf09279052b tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/53e34615-f316-4c42-8304-7711a91c7bf9" status: 202 len: 0 microversion: 2.1 time: 0.023276 Apr 02 20:53:30.500171 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 242/571] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:30 2022] DELETE /compute/v2.1/flavors/53e34615-f316-4c42-8304-7711a91c7bf9 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:30.509546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cd014c4-0983-4c7d-980c-5565bb3c3777 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.533570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b779264e-501d-42df-92d5-82e5505329fe req-b539007a-8a94-4cdf-a2a1-1e0279b52a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23aa3120-1d16-4505-a3c5-0ba81a38c743", "name": "network-vif-plugged", "status": "completed", "tag": "c462078a-088f-40a2-8510-d6fb4357f7dc"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:30.540067 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cd014c4-0983-4c7d-980c-5565bb3c3777 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.035404 Apr 02 20:53:30.544668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b779264e-501d-42df-92d5-82e5505329fe req-b539007a-8a94-4cdf-a2a1-1e0279b52a5f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:30.545123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b779264e-501d-42df-92d5-82e5505329fe req-b539007a-8a94-4cdf-a2a1-1e0279b52a5f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:30.547536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 330/572] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.558546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7f9de9f0-166a-451a-aec1-80befce08cd4 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-912993761", "id": 1830233819, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:30.566956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b779264e-501d-42df-92d5-82e5505329fe req-b539007a-8a94-4cdf-a2a1-1e0279b52a5f service nova] Creating event network-vif-plugged:c462078a-088f-40a2-8510-d6fb4357f7dc for instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 on nch2-master-1 Apr 02 20:53:30.578974 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7f9de9f0-166a-451a-aec1-80befce08cd4 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.023989 Apr 02 20:53:30.579578 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 331/573] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:30 2022] POST /compute/v2.1/flavors => generated 413 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:53:30.581451 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b779264e-501d-42df-92d5-82e5505329fe req-b539007a-8a94-4cdf-a2a1-1e0279b52a5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051446 Apr 02 20:53:30.582273 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 243/574] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:53:30.590391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1b2a08f-8540-4e44-a70e-5c8a5bc9611d tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.600368 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1b2a08f-8540-4e44-a70e-5c8a5bc9611d tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1830233819" status: 200 len: 413 microversion: 2.1 time: 0.013869 Apr 02 20:53:30.601639 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 244/575] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/1830233819 => generated 413 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:30.882775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.884983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:30.900415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:30.902043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-461ffaea-fb55-4313-8494-691deb9bd49e tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.903123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:30.905598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:30.906281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:30.929561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-461ffaea-fb55-4313-8494-691deb9bd49e tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.319022 Apr 02 20:53:30.930543 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 332/576] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:30.935713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:30.936559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:30.945787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:30.946520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:30.947468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:30.948072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:31.562604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:31.575130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5041b62-f1bb-4ecc-a324-6f48b49fbd81 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 0.643182 Apr 02 20:53:31.594607 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 333/577] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:31.601008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3406f779-e23a-4d25-9b03-a950451294ad tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:31.601778 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:31.601778 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:31.652846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:31.656476 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3406f779-e23a-4d25-9b03-a950451294ad tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1830233819" status: 202 len: 0 microversion: 2.1 time: 0.060321 Apr 02 20:53:31.661531 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 334/578] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:53:31 2022] DELETE /compute/v2.1/flavors/1830233819 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:31.665729 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7376b32c-178d-4448-a456-2ebca2090fd8 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.789371 Apr 02 20:53:31.666464 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 245/579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:30 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:31.669158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28caa843-06d7-4220-ba0b-8910de4b94d9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4f08040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:31.677433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:31.678839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:31.691345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:31.694650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:31.696058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:31.697821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:31.740218 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28caa843-06d7-4220-ba0b-8910de4b94d9 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.076562 Apr 02 20:53:31.741644 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 335/580] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:31 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:31.769437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cbe6dd76-3c97-4755-9edd-5f2e753d2f67 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:31.804599 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cbe6dd76-3c97-4755-9edd-5f2e753d2f67 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.057746 Apr 02 20:53:31.827583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 336/581] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:31.837961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-657781c8-d6c4-4573-ad8e-90a9f9d4c875 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1858467899", "id": 329497480, "os-flavor-access:is_public": "False"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:31.840661 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:31.840661 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:31.862390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-657781c8-d6c4-4573-ad8e-90a9f9d4c875 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.029100 Apr 02 20:53:31.868248 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 337/582] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:31 2022] POST /compute/v2.1/flavors => generated 427 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:31.873790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-510351a1-cb93-4c97-ad0b-3298cfdbe68e tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "329497480"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:31.894601 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-510351a1-cb93-4c97-ad0b-3298cfdbe68e tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] HTTP exception thrown: Flavor 329497480 could not be found. Apr 02 20:53:31.895576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-510351a1-cb93-4c97-ad0b-3298cfdbe68e tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] Returning 400 to user: Flavor 329497480 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:31.898306 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-510351a1-cb93-4c97-ad0b-3298cfdbe68e tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.028437 Apr 02 20:53:31.903223 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 338/583] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:31 2022] POST /compute/v2.1/servers => generated 80 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:53:31.917464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f38db85a-8d2f-426c-b94c-5d400543a55c tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:31.954918 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f38db85a-8d2f-426c-b94c-5d400543a55c tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/329497480" status: 202 len: 0 microversion: 2.1 time: 0.048813 Apr 02 20:53:31.960558 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 339/584] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:53:31 2022] DELETE /compute/v2.1/flavors/329497480 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:31.968273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-126054ab-467c-4b44-973d-1b0b933ddd59 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:31.973672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:31.985794 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6acb5377-1226-470f-a776-a67f3f1d4901 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.316640 Apr 02 20:53:31.990015 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 246/585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:31 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:32.022053 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-126054ab-467c-4b44-973d-1b0b933ddd59 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.059430 Apr 02 20:53:32.030184 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 340/586] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:31 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:32.045330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b3fff7d-9ebc-4e64-92a1-98ea19caa9af tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-609924508", "id": 1554714302, "os-flavor-access:is_public": "False"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:32.047981 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:32.047981 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:53:32.110409 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b3fff7d-9ebc-4e64-92a1-98ea19caa9af tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.069017 Apr 02 20:53:32.116873 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 247/587] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:32.128412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-279f9894-ce53-40d8-9e7f-15073c5a4b84 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1245673892", "id": 98819325, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:32.158703 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-279f9894-ce53-40d8-9e7f-15073c5a4b84 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.036160 Apr 02 20:53:32.164812 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 341/588] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:32.172427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d8d71e44-50f9-44ad-8165-6811b051898d tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.191315 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d8d71e44-50f9-44ad-8165-6811b051898d tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.024020 Apr 02 20:53:32.193596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 248/589] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:32.205342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-861187b8-4638-434d-9583-fe716d443be9 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.229160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-861187b8-4638-434d-9583-fe716d443be9 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.028698 Apr 02 20:53:32.230696 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 342/590] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:32.241511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8866c705-7ce9-43a0-915a-46743cd345a2 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.252117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8866c705-7ce9-43a0-915a-46743cd345a2 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.014603 Apr 02 20:53:32.265899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0fc9bf7-cc6a-4378-9481-0f36f9c70831 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.269463 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 249/591] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:32.277122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0fc9bf7-cc6a-4378-9481-0f36f9c70831 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.015532 Apr 02 20:53:32.285954 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 343/592] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:32.291481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-327cbdd9-61fb-4532-b1eb-fc579e0f1eb1 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.326968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-327cbdd9-61fb-4532-b1eb-fc579e0f1eb1 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6212 microversion: 2.1 time: 0.040229 Apr 02 20:53:32.328104 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 250/593] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6212 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:32.342648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48083a12-8ee9-4e30-8cdf-37be2e69ad39 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.366846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48083a12-8ee9-4e30-8cdf-37be2e69ad39 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6212 microversion: 2.1 time: 0.027501 Apr 02 20:53:32.380202 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 344/594] 10.222.0.18 () {58 vars in 1174 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6212 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:32.385922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb2a4c2a-7b7f-4085-9057-c5774f55c360 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.433043 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb2a4c2a-7b7f-4085-9057-c5774f55c360 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6212 microversion: 2.1 time: 0.049911 Apr 02 20:53:32.434011 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 251/595] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6212 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:32.464919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05213754-9b8c-4416-ab90-1ae18c1e2e04 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.500725 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05213754-9b8c-4416-ab90-1ae18c1e2e04 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6212 microversion: 2.1 time: 0.042761 Apr 02 20:53:32.502107 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 345/596] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6212 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:32.521811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ce8e517-54cc-42ca-8037-f254ca2d2596 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.523295 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:32.523295 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:53:32.545145 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ce8e517-54cc-42ca-8037-f254ca2d2596 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/98819325" status: 202 len: 0 microversion: 2.1 time: 0.029888 Apr 02 20:53:32.546823 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 252/597] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:53:32 2022] DELETE /compute/v2.1/flavors/98819325 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:32.555312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6724f453-ff36-4e73-b62c-d1e5526281f5 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.593720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.595353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:32.606394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:32.607124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:32.609888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:32.610518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:32.621157 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6724f453-ff36-4e73-b62c-d1e5526281f5 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.069526 Apr 02 20:53:32.622290 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 346/598] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:32.646521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f50cce85-9544-4723-bdba-1f003f1bf1b5 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.687561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f50cce85-9544-4723-bdba-1f003f1bf1b5 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1554714302" status: 202 len: 0 microversion: 2.1 time: 0.051659 Apr 02 20:53:32.690888 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 347/599] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:53:32 2022] DELETE /compute/v2.1/flavors/1554714302 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:32.702613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:32.704011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:32.717673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:32.718388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:32.719426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:32.720118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:33.123939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:33.125261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:33.136101 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a769cc17-8949-4c5f-bdff-5c8f51a1807b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1311 microversion: 2.1 time: 0.546730 Apr 02 20:53:33.140490 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9997958f-4129-4832-ba71-d2b534ef50f2 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.446355 Apr 02 20:53:33.148939 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 253/600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1311 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.151795 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 348/601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:32 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.161183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4aaf5407-28f8-4790-8508-d743d42e35fe tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4ee7430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.166366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f5bc9ac9-8561-440b-821c-a5f62da66f7c tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.226429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f5bc9ac9-8561-440b-821c-a5f62da66f7c tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.075314 Apr 02 20:53:33.229374 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 254/602] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.242890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.260549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:33.266119 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4aaf5407-28f8-4790-8508-d743d42e35fe tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.112950 Apr 02 20:53:33.270282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 349/603] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.287905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:33.289140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45c2a2b4-9126-4bd9-9704-f5f2b97bf6fc tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1408224946", "id": 1101768276, "os-flavor-access:is_public": "False"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:33.289811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:33.291432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:33.293613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:33.296062 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:33.296062 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:33.331389 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-45c2a2b4-9126-4bd9-9704-f5f2b97bf6fc tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.055444 Apr 02 20:53:33.342063 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 350/604] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:33 2022] POST /compute/v2.1/flavors => generated 415 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:33.351683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-320f67d9-4487-4e62-9886-57297a407aae tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.395348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-320f67d9-4487-4e62-9886-57297a407aae tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.051887 Apr 02 20:53:33.409094 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 351/605] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.413918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b1b8b9b8-ced4-4ec5-8f99-25dd006283e8 tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.462661 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b1b8b9b8-ced4-4ec5-8f99-25dd006283e8 tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.052211 Apr 02 20:53:33.474266 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 352/606] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.479441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b4e37d4-a2c4-40b6-8f35-c071a41f3949 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.480285 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:33.480285 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:33.499981 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b4e37d4-a2c4-40b6-8f35-c071a41f3949 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1101768276" status: 202 len: 0 microversion: 2.1 time: 0.024248 Apr 02 20:53:33.504568 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 353/607] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:53:33 2022] DELETE /compute/v2.1/flavors/1101768276 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:33.510391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4905a1d-2d4c-42d3-8c2f-7027a097d36c tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.751290 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4905a1d-2d4c-42d3-8c2f-7027a097d36c tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.244695 Apr 02 20:53:33.764005 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 354/608] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.773802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4a2618d-9774-46e0-b32d-51a224aecc14 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1577203712", "id": 1021833961, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:33.798878 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4a2618d-9774-46e0-b32d-51a224aecc14 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028837 Apr 02 20:53:33.804971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 355/609] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:33 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:33.810200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7fa89fe-605e-42a0-930b-78375cb50e80 tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.839178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7fa89fe-605e-42a0-930b-78375cb50e80 tempest-FlavorsAdminTestJSON-1582204156 tempest-FlavorsAdminTestJSON-1582204156-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.032798 Apr 02 20:53:33.849349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 356/610] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:33.866255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-964d602c-cea6-4f08-805c-6d17c33e2a87 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.911103 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-964d602c-cea6-4f08-805c-6d17c33e2a87 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1021833961" status: 202 len: 0 microversion: 2.1 time: 0.057728 Apr 02 20:53:33.912488 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 357/611] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:53:33 2022] DELETE /compute/v2.1/flavors/1021833961 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:33.932484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6c39181-b575-4ecc-bfd0-f9e16a149ef3 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:33.941355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:33.961139 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ebd521a0-6d00-40eb-9461-0282d795c545 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.720135 Apr 02 20:53:33.963695 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 255/612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:33.988936 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6c39181-b575-4ecc-bfd0-f9e16a149ef3 tempest-FlavorsAdminTestJSON-1217289059 tempest-FlavorsAdminTestJSON-1217289059-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.069069 Apr 02 20:53:33.993039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 358/613] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:53:33 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:34.157081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:34.158581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:34.160014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:34.162262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:34.171321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.172303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:34.173241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.173682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:34.178670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.182581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:34.184064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.189814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:34.632071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:34.640824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e553287-b4e3-4739-b86f-0af60bb3fdf1 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.488495 Apr 02 20:53:34.657310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 359/614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:34 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:34.669539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a13f48b-4965-4ba7-9164-224113bb1638 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4f920d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:34.771879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:34.772247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a13f48b-4965-4ba7-9164-224113bb1638 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.110993 Apr 02 20:53:34.772247 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 360/615] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:34 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:34.792622 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dbb386cf-efa3-4df6-b1d5-90db6dd0577e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1494 microversion: 2.1 time: 0.640705 Apr 02 20:53:34.794153 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 256/616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:34 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1494 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:34.819637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:34.820349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:34.838060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.838531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:34.839340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.839791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:34.979785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:34.980607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:34.995701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:34.999688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:35.000940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:35.001610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:35.131439 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c66d1d0c-8be0-4513-83d6-8ed9c418c78c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1645 microversion: 2.1 time: 0.324900 Apr 02 20:53:35.145315 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 361/617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:34 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1645 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:35.329786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:35.339141 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fcf61858-39bb-409b-918a-cc7ccb866cbb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.363221 Apr 02 20:53:35.341509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 257/618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:34 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:35.350173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:35.354161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:35.367783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:35.369621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:35.371032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:35.372831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:35.430006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30055a56-2316-4a90-8d8e-74730d42719e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Action: 'create', calling method: .version_select at 0x7f54d4f928b0>, body: {"keypair": {"name": "tempest-keypair-558302494"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:35.482600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-30055a56-2316-4a90-8d8e-74730d42719e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Getting quotas for project 8d12a2c8ad9a43f2bded1c2804915030. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:35.492652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-30055a56-2316-4a90-8d8e-74730d42719e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Getting quotas for user 67d48665a950454aa634b35c21bbb279 and project 8d12a2c8ad9a43f2bded1c2804915030. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:35.631130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-30055a56-2316-4a90-8d8e-74730d42719e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Getting quotas for project 8d12a2c8ad9a43f2bded1c2804915030. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:35.632807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-30055a56-2316-4a90-8d8e-74730d42719e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Getting quotas for user 67d48665a950454aa634b35c21bbb279 and project 8d12a2c8ad9a43f2bded1c2804915030. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:35.649106 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30055a56-2316-4a90-8d8e-74730d42719e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.512567 Apr 02 20:53:35.650753 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 362/619] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:53:35 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:35.672518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:35.673489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:35.680803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:35.681634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:35.682663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:35.683329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:35.955810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6c05c84-d83c-4049-a410-fc30218b657c tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1645 microversion: 2.1 time: 0.611119 Apr 02 20:53:35.957186 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 258/620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:35 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1645 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:35.979413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64bc05f2-e9e3-4614-a095-4642f4d80876 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4ffc940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:36.078610 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64bc05f2-e9e3-4614-a095-4642f4d80876 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.120147 Apr 02 20:53:36.079219 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 259/621] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:35 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:36.095741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fad98a36-75c8-460f-8879-3d95c51530bd tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:36.100510 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:36.100510 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:53:36.103706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad98a36-75c8-460f-8879-3d95c51530bd tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.105480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:36.108416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad98a36-75c8-460f-8879-3d95c51530bd tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.111932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad98a36-75c8-460f-8879-3d95c51530bd tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.113586 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa18707b-8ce8-410d-8de4-2f7d41a8b2db tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.445629 Apr 02 20:53:36.113980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad98a36-75c8-460f-8879-3d95c51530bd tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.119647 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 363/622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:35 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:36.194125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fad98a36-75c8-460f-8879-3d95c51530bd tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.102827 Apr 02 20:53:36.197210 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 260/623] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:53:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:36.216948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:36.219591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:36.280222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.282566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.287173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.292732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.358474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:36.359720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:36.372522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.385134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.389918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.393557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.548130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c9e0795d-5606-4196-b67f-23294d12dc14 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743/action" status: 202 len: 0 microversion: 2.1 time: 0.344284 Apr 02 20:53:36.551369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 364/624] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:53:36 2022] POST /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:53:36.585480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:36.586264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:36.611035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.611489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.612690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:36.613302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:36.965020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ddb55cd7-c7d8-468d-b6ad-997efdd986ab tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1650 microversion: 2.1 time: 0.401984 Apr 02 20:53:36.977598 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 365/625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:36 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1650 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:37.104141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-897adb9b-f5f3-4d2b-bb76-f9323cfee4dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4f68820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:37.209133 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-897adb9b-f5f3-4d2b-bb76-f9323cfee4dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.121001 Apr 02 20:53:37.211591 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 366/626] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:37 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:37.230433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:37.231056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:37.266130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:37.266805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:37.269950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:37.286181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:37.308481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:37.331348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45f85cae-dbd9-4836-bc19-d0d0b99bcf67 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.968832 Apr 02 20:53:37.334119 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 261/627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:36 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:53:37.349779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f7bfebbc-9341-4d66-96b9-217d8c5c726e req-0d42a6cf-c8ef-4ba2-9c7f-f747ec68ad39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c0c36e-2bc2-43ab-96c0-1582c8b94e00", "name": "network-vif-plugged", "status": "completed", "tag": "9682d761-627f-435b-8889-b0b79b5a3c78"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:37.411060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7bfebbc-9341-4d66-96b9-217d8c5c726e req-0d42a6cf-c8ef-4ba2-9c7f-f747ec68ad39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:37.427165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7bfebbc-9341-4d66-96b9-217d8c5c726e req-0d42a6cf-c8ef-4ba2-9c7f-f747ec68ad39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:37.471838 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f7bfebbc-9341-4d66-96b9-217d8c5c726e req-0d42a6cf-c8ef-4ba2-9c7f-f747ec68ad39 service nova] Creating event network-vif-plugged:9682d761-627f-435b-8889-b0b79b5a3c78 for instance 61c0c36e-2bc2-43ab-96c0-1582c8b94e00 on nch1-master-1 Apr 02 20:53:37.479720 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f7bfebbc-9341-4d66-96b9-217d8c5c726e req-0d42a6cf-c8ef-4ba2-9c7f-f747ec68ad39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133739 Apr 02 20:53:37.480973 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 262/628] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:37.996409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:37.997154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:38.016907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:38.017466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:38.025598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:38.026088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:38.518400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:38.528739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f6c33b1-1c90-4d20-b97c-cb4b2bbd5772 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 1.314262 Apr 02 20:53:38.543673 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 367/629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:37 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:38.557021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f9016ae5-43e4-46fc-ae89-d327fc2bd794 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d509bca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:38.975806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f9016ae5-43e4-46fc-ae89-d327fc2bd794 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.430737 Apr 02 20:53:38.976745 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 368/630] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:38 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:38.988405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:38.994323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:39.012224 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db5dfb26-a6ab-4656-beec-4dff19899ddf tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1630 microversion: 2.1 time: 1.020477 Apr 02 20:53:39.021855 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 263/631] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:37 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1630 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:39.035758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:39.037429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:39.045112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:39.045671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:39.047190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:39.048378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:39.089189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:39.095865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:39.096828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:39.102841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:39.256763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lazy-loading 'flavor' on Instance uuid 23aa3120-1d16-4505-a3c5-0ba81a38c743 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:53:39.302723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Going to try to live migrate instance to nch1-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:53:39.785373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:39.810333 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07af1611-3b6c-4805-bf5e-c05188b88b79 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1323 microversion: 2.1 time: 0.821085 Apr 02 20:53:39.813469 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 369/632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:38 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1323 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:39.843705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:39.846520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:39.883964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:39.893536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:39.895426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:39.901899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:40.440719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:40.465362 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f6f9d0d6-f709-43f4-a49e-c9d6c686fa41 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.644209 Apr 02 20:53:40.467598 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 370/633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:39 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:40.494755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ec078f34-11f7-4ff1-bf42-0e4c64920347 req-1118bd45-2ae6-4a43-90ed-a88f9bab6a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6c04cc-d558-4512-a7cf-6306a624af7b", "name": "network-vif-plugged", "status": "completed", "tag": "38aff574-c6a0-4aad-aadc-b0fdbe398a3b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:40.570973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ec078f34-11f7-4ff1-bf42-0e4c64920347 req-1118bd45-2ae6-4a43-90ed-a88f9bab6a05 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:40.572305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ec078f34-11f7-4ff1-bf42-0e4c64920347 req-1118bd45-2ae6-4a43-90ed-a88f9bab6a05 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:40.634886 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ec078f34-11f7-4ff1-bf42-0e4c64920347 req-1118bd45-2ae6-4a43-90ed-a88f9bab6a05 service nova] Creating event network-vif-plugged:38aff574-c6a0-4aad-aadc-b0fdbe398a3b for instance 0f6c04cc-d558-4512-a7cf-6306a624af7b on nch2-master-1 Apr 02 20:53:40.647698 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ec078f34-11f7-4ff1-bf42-0e4c64920347 req-1118bd45-2ae6-4a43-90ed-a88f9bab6a05 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168734 Apr 02 20:53:40.654738 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 371/634] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:40.678392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0855667-2d14-431b-9ec5-c8ae436f552f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d509baf0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:40.841670 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0855667-2d14-431b-9ec5-c8ae436f552f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.180282 Apr 02 20:53:40.843637 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 372/635] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:40 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:40.857714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:40.866370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:40.913933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:40.917804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:40.919097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:40.922942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:41.318803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:41.335493 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f09cacec-09e6-4f45-bbbc-6d899ada5d56 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1516 microversion: 2.1 time: 0.488235 Apr 02 20:53:41.336410 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 373/636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:40 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1516 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:41.360123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:41.362200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:41.383354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:41.385551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:41.386565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:41.390163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:41.987608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:42.004573 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-323262f6-1d64-46fe-9c3a-7bf87fd40b4f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5" status: 200 len: 1516 microversion: 2.1 time: 0.647264 Apr 02 20:53:42.006037 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 374/637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:41 2022] GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5 => generated 1516 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:42.053156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:42.058920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:42.075191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:42.076030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:42.078264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:42.079934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:42.666176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5bf59dce-d2e4-4a8c-bb1e-5caced3d4a11 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743/action" status: 202 len: 0 microversion: 2.1 time: 3.626068 Apr 02 20:53:42.667205 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 264/638] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:53:39 2022] POST /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743/action => generated 0 bytes in 3628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:53:42.672931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91a01553-7f48-4368-bcd7-51264d141fb6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d504caf0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:42.898891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:42.919126 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91a01553-7f48-4368-bcd7-51264d141fb6 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.250765 Apr 02 20:53:42.919950 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 265/639] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:42 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:42.932913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:42.933438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d90ac6a-25b4-4431-938b-47469e68740c tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1323 microversion: 2.1 time: 0.905020 Apr 02 20:53:42.940520 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 375/640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:42 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1323 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:42.948273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:42.956875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ed04ed65-fba2-4ea7-a7ef-233d1e3869f4"}], "security_groups": [{"name": "tempest-securitygroup--1557229410"}], "key_name": "tempest-keypair-558302494", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:42.982839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:42.983739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:42.986969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:42.991862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:43.209162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] validate_networks() for [('ed04ed65-fba2-4ea7-a7ef-233d1e3869f4', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:53:43.517229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:43.533812 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34ac59fc-fe1b-4c79-aa41-11cff87d73cf tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 200 len: 1323 microversion: 2.1 time: 0.612567 Apr 02 20:53:43.558748 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 266/641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:42 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:43.577476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:43.579528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:43.595143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:43.595988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:43.597043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:43.602002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.085732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:53:44.086570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:53:44.087216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:53:44.087809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:53:44.088390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:53:44.104275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.105103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.114019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.117807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.173130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Getting quotas for project 8d12a2c8ad9a43f2bded1c2804915030. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:44.183725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Getting quotas for user 67d48665a950454aa634b35c21bbb279 and project 8d12a2c8ad9a43f2bded1c2804915030. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:44.211518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:53:44.219708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:44.324223 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1745ad03-e3c7-4bc5-ac07-d11831d2fb87 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.377969 Apr 02 20:53:44.324929 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 376/642] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:53:44.341790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5a47a981-f863-424b-abe3-078c41a515b7 req-eabf7785-e6c6-4bb3-bec0-f2be99065014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "name": "network-vif-plugged", "status": "completed", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}, {"server_uuid": "98a121f5-71aa-45c3-9a40-c1534709b364", "name": "network-vif-plugged", "status": "completed", "tag": "7452f163-14e5-4e33-a069-7a4221cce019"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:44.368532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5a47a981-f863-424b-abe3-078c41a515b7 req-eabf7785-e6c6-4bb3-bec0-f2be99065014 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.368532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5a47a981-f863-424b-abe3-078c41a515b7 req-eabf7785-e6c6-4bb3-bec0-f2be99065014 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.400637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5a47a981-f863-424b-abe3-078c41a515b7 req-eabf7785-e6c6-4bb3-bec0-f2be99065014 service nova] Creating event network-vif-plugged:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:53:44.402351 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5a47a981-f863-424b-abe3-078c41a515b7 req-eabf7785-e6c6-4bb3-bec0-f2be99065014 service nova] Creating event network-vif-plugged:7452f163-14e5-4e33-a069-7a4221cce019 for instance 98a121f5-71aa-45c3-9a40-c1534709b364 on nch2-master-1 Apr 02 20:53:44.423945 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5a47a981-f863-424b-abe3-078c41a515b7 req-eabf7785-e6c6-4bb3-bec0-f2be99065014 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096974 Apr 02 20:53:44.428375 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 377/643] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:44.738343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:44.748221 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0823427c-98ec-49d8-8a4f-457979282bc7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1504 microversion: 2.1 time: 1.188156 Apr 02 20:53:44.755879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Calling method '.version_select at 0x7f54d4f920d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:44.757997 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:44.757997 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:44.759621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.761041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.761692 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 267/644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:43 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1504 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:44.789742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9267a099-3671-4955-941c-bd37b6242d71 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4fbaaf0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:44.807753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.810918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.908227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.918546 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9267a099-3671-4955-941c-bd37b6242d71 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.141293 Apr 02 20:53:44.919903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 268/645] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:44 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:44.924733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:44.928180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.931558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:44.946976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.949311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.954839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.959573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:44.960588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:44.962132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.082637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.103017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.125443 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05f0fbf5-9803-426e-9497-919a4599eadc tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2231 microversion: 2.53 time: 0.695392 Apr 02 20:53:45.136664 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 378/646] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Apr 2 20:53:44 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2231 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:53:45.147104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2fd144e7-d388-49b9-9eb5-de5167349b41 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:45.151778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2fd144e7-d388-49b9-9eb5-de5167349b41 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:45.312224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2fd144e7-d388-49b9-9eb5-de5167349b41 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:45.320372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2fd144e7-d388-49b9-9eb5-de5167349b41 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1225 microversion: 2.1 time: 0.182401 Apr 02 20:53:45.325033 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 379/647] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:45 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1225 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:45.335971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:45.339255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:45.354203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.355157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.361124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.362306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.584603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:45.595692 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-681e8b00-507f-4a84-a787-7cbf7d21da36 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1473 microversion: 2.1 time: 0.671718 Apr 02 20:53:45.599901 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 269/648] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:44 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1473 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:45.606789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:45.610897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:45.625916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.627644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.641439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.642425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.729268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:53:45.761195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:45.776006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-484e0dba-469e-410f-9a6e-5c95d6eb7c2f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 200 len: 1323 microversion: 2.1 time: 0.445535 Apr 02 20:53:45.778729 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 380/649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:45 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:45.795524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Calling method '.version_select at 0x7f54d581b670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:45.806017 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:45.806017 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:45.812446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.816497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:45.908495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:45.910482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.016102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.031639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.043587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4fd2ec6-4582-4a12-8b6e-0e172eaa2cd3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "DELETE /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 204 len: 0 microversion: 2.1 time: 0.440927 Apr 02 20:53:46.046679 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 270/650] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:45 2022] DELETE /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:53:46.077884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.078518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.084841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:46.085767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:46.112752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.136116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.137511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.138268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.200575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:46.207588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:46.207588 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf8c3a5f-d725-4967-adff-d17f9867fecc tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.156983 Apr 02 20:53:46.207588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 271/651] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:53:46 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b/diagnostics => generated 117 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:46.215033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.215774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.219101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:46.224654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:46.237788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.240070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.241033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.242944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.248298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c42c550-1634-47d9-9a3e-1d4a45dc1f76 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1002 microversion: 2.53 time: 0.464994 Apr 02 20:53:46.250793 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 381/652] 10.222.0.18 () {60 vars in 1221 bytes} [Sat Apr 2 20:53:45 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1002 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:53:46.269397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69a1b114-1fc7-4361-bd18-210b0ca3aa4e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4f68b80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:46.433814 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69a1b114-1fc7-4361-bd18-210b0ca3aa4e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1424 microversion: 2.1 time: 0.181712 Apr 02 20:53:46.472913 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 382/653] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:46 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1424 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:46.495073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:46.497181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:46.545325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.550609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.551658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:46.553245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:46.737079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:53:47.329600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-40618c90-63e3-4575-91cf-e6c8893c8afd tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 204 len: 0 microversion: 2.1 time: 0.850593 Apr 02 20:53:47.330458 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 383/654] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:46 2022] DELETE /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 0 bytes in 857 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:53:47.356142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7f9f2b9e-8b05-41ef-b6f1-817d5346a215 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Calling method '.version_select at 0x7f54d4f08ee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:47.364671 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:53:47.364671 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:53:47.386274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b9e-8b05-41ef-b6f1-817d5346a215 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:47.387642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b9e-8b05-41ef-b6f1-817d5346a215 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:47.460133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b9e-8b05-41ef-b6f1-817d5346a215 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:47.460954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f9f2b9e-8b05-41ef-b6f1-817d5346a215 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:47.501976 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7f9f2b9e-8b05-41ef-b6f1-817d5346a215 tempest-HypervisorAdminV253TestBase-866191306 tempest-HypervisorAdminV253TestBase-866191306-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/a0306909-6cc3-4dee-9d5f-ca634ddaa448" status: 200 len: 792 microversion: 2.53 time: 0.166396 Apr 02 20:53:47.526408 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 384/655] 10.222.0.18 () {60 vars in 1297 bytes} [Sat Apr 2 20:53:47 2022] GET /compute/v2.1/os-hypervisors/a0306909-6cc3-4dee-9d5f-ca634ddaa448 => generated 792 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:53:47.551342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:47.554037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:47.575987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:47.577878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:47.579947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:47.584757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:47.744336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:47.757844 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-40efec56-706a-4e2a-a3e1-e8d642b8c871 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1283 microversion: 2.1 time: 0.226317 Apr 02 20:53:47.767307 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 385/656] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:47 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1283 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:47.807818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1819989049", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "52101737", "adminPass": "***", "networks": [{"uuid": "ad76fa2d-1a20-484e-b4bb-76fd756272b5"}], "security_groups": [{"name": "tempest-securitygroup--1045426101"}], "key_name": "tempest-keypair-1511390929", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:48.112945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] validate_networks() for [('ad76fa2d-1a20-484e-b4bb-76fd756272b5', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:53:48.113055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:48.131685 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04347faa-032a-4ef2-8f8a-1a8763fce41e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1504 microversion: 2.1 time: 1.922638 Apr 02 20:53:48.138318 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 272/657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:46 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1504 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:48.164748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:48.165849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:48.172828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:48.176875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:48.177984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:48.184149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:49.513165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:53:49.513727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:53:49.514062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:53:49.514479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:53:49.514899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:53:49.551813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:49.556836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:49.558317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:49.558946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:49.629786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for project fde6bd005e3a4a25b63639832027ab85. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:53:49.636033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Getting quotas for user c42119999e6f40b487a7174dc5a7d617 and project fde6bd005e3a4a25b63639832027ab85. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:53:49.657439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:53:49.663431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:53:49.786594 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81817a79-ede1-4573-851f-f11c1eec0a9b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.014760 Apr 02 20:53:49.791870 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 386/658] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:53:49.811552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e20484ef-2867-42f4-a11f-270497d4c8cd req-e877f3bf-307d-4c16-95a0-aea6d1b1acb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23aa3120-1d16-4505-a3c5-0ba81a38c743", "name": "network-vif-unplugged", "status": "completed", "tag": "c462078a-088f-40a2-8510-d6fb4357f7dc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:49.846955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e20484ef-2867-42f4-a11f-270497d4c8cd req-e877f3bf-307d-4c16-95a0-aea6d1b1acb9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:49.847662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e20484ef-2867-42f4-a11f-270497d4c8cd req-e877f3bf-307d-4c16-95a0-aea6d1b1acb9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:49.877674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e20484ef-2867-42f4-a11f-270497d4c8cd req-e877f3bf-307d-4c16-95a0-aea6d1b1acb9 service nova] Creating event network-vif-unplugged:c462078a-088f-40a2-8510-d6fb4357f7dc for instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 on nch2-master-1 Apr 02 20:53:49.897682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e20484ef-2867-42f4-a11f-270497d4c8cd req-e877f3bf-307d-4c16-95a0-aea6d1b1acb9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095786 Apr 02 20:53:49.898758 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 387/659] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:49.921582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:49.926603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:49.947525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:49.947525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:49.948313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:49.950997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:50.213360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:50.225836 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9cd8b41-21bd-4bc1-93c1-732d2f4dc0d5 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 200 len: 1516 microversion: 2.1 time: 2.086304 Apr 02 20:53:50.244296 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 273/660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:48 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 1516 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:50.286331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bc82e3d-73dc-4434-a40c-6fde43b1ca89 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d5166820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:50.451705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:50.467295 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0785139-b60f-475d-b513-05aa7bbd7800 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1479 microversion: 2.1 time: 0.567477 Apr 02 20:53:50.468068 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 388/661] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:49 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1479 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:50.477001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:50.481206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:50.493402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:50.494053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:50.495025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:50.495615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:50.787943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:50.800387 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba256bae-c948-4738-a34b-b256715aa12b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.330969 Apr 02 20:53:50.801928 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 389/662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:50 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:50.809089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:50.817352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:50.833103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:50.833564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:50.834365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:50.834809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.114253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:51.132213 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f2b8152e-a1ff-4a80-939e-e206c04da655 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1504 microversion: 2.1 time: 0.328530 Apr 02 20:53:51.146054 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 390/663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:50 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:51.157399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:51.158312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:51.168150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.168921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.169935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.170847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.290851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:51.302245 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d26b3ac-2108-474c-99f0-89008345d7f2 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1257 microversion: 2.1 time: 0.152697 Apr 02 20:53:51.303114 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 391/664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:51 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:51.309286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:51.309978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:51.320319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.321095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.322142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.322745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.367846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:53:51.535161 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b686f057-d3d4-446c-ad8a-0021395055ba tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 204 len: 0 microversion: 2.1 time: 0.230057 Apr 02 20:53:51.543292 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 392/665] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:53:51 2022] DELETE /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:53:51.553330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:51.564256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:51.586293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.587105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.588099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.588754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.859869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:51.874975 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b73f3024-f13a-420b-b68e-e790f8764fab tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1479 microversion: 2.1 time: 0.329868 Apr 02 20:53:51.880330 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 393/666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:51 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1479 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:51.897265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:51.902978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:51.940184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.943480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:51.947833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:51.948350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:52.199079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:52.207234 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a431f68f-5f67-4f8a-b2e2-c6085b8cca89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 200 len: 1522 microversion: 2.1 time: 0.323105 Apr 02 20:53:52.208832 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 394/667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:51 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:52.214950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:52.215629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:52.225421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:52.225895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:52.226662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:52.227168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:52.607699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:52.615682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-572538fa-d954-4c04-9a9a-6cc7b9c8d0fe tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.405800 Apr 02 20:53:52.618009 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 395/668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:52 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:52.622909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:52.624002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:52.630473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:52.631238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:52.632544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:52.633218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:52.871669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:52.881640 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-462ae58d-6b09-41c7-a24b-55cd3b6b8033 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1504 microversion: 2.1 time: 0.262343 Apr 02 20:53:52.888838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 396/669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:52 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:52.894290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:52.897954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:52.914133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:52.914968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:52.916292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:52.916988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:53.074972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:53.087160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb438551-6bee-47fa-a1c0-8260f85c42b9 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1319 microversion: 2.1 time: 0.196769 Apr 02 20:53:53.093020 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 397/670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:52 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:53.098784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ac48c719-e15e-4f7c-b3c1-a5236abcc134 req-3044e6e4-26b8-49f9-9e61-326f56d40db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23aa3120-1d16-4505-a3c5-0ba81a38c743", "tag": "c462078a-088f-40a2-8510-d6fb4357f7dc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:53.137393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ac48c719-e15e-4f7c-b3c1-a5236abcc134 req-3044e6e4-26b8-49f9-9e61-326f56d40db7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:53.139034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ac48c719-e15e-4f7c-b3c1-a5236abcc134 req-3044e6e4-26b8-49f9-9e61-326f56d40db7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:53.169623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ac48c719-e15e-4f7c-b3c1-a5236abcc134 req-3044e6e4-26b8-49f9-9e61-326f56d40db7 service nova] Creating event network-changed:c462078a-088f-40a2-8510-d6fb4357f7dc for instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 on nch2-master-1 Apr 02 20:53:53.182936 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ac48c719-e15e-4f7c-b3c1-a5236abcc134 req-3044e6e4-26b8-49f9-9e61-326f56d40db7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087687 Apr 02 20:53:53.196533 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 398/671] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:53.227390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:53.237498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:53.257644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:53.264112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:53.265229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:53.266816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:53.757253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:53.765486 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b003670e-e0ff-429e-8f60-d81e37eca842 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1479 microversion: 2.1 time: 0.567294 Apr 02 20:53:53.785253 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 399/672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:53 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1479 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:53.790835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-003179e2-b73f-4e00-ae00-7b4c62527e81 req-718b39fe-37da-490f-b6bb-12c1aad3ca24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e6da4-1b09-4731-9332-98dce9466b87", "name": "network-vif-unplugged", "status": "completed", "tag": "94129b94-caea-4aa7-bc27-5f3cfd83ebcb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:53.810036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-003179e2-b73f-4e00-ae00-7b4c62527e81 req-718b39fe-37da-490f-b6bb-12c1aad3ca24 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:53.810493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-003179e2-b73f-4e00-ae00-7b4c62527e81 req-718b39fe-37da-490f-b6bb-12c1aad3ca24 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:53.838367 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-003179e2-b73f-4e00-ae00-7b4c62527e81 req-718b39fe-37da-490f-b6bb-12c1aad3ca24 service nova] Creating event network-vif-unplugged:94129b94-caea-4aa7-bc27-5f3cfd83ebcb for instance 807e6da4-1b09-4731-9332-98dce9466b87 on nch1-master-1 Apr 02 20:53:53.847596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-003179e2-b73f-4e00-ae00-7b4c62527e81 req-718b39fe-37da-490f-b6bb-12c1aad3ca24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060423 Apr 02 20:53:53.856323 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 400/673] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:53.861931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:53.862636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:53.888953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:53.890125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:53.891122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:53.891733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:54.687076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:54.702214 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03dd24e8-c393-4e2b-8541-d8163b257ae1 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 200 len: 1522 microversion: 2.1 time: 0.843077 Apr 02 20:53:54.711531 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 401/674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:53 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:54.715434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:54.719042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:54.735900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:54.736369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:54.739605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:54.740057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:55.085255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:55.096844 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2d9bbfc-0c59-4336-92aa-0c537f0d6c52 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.388948 Apr 02 20:53:55.098742 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 402/675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:54 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:55.109835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:55.111319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:55.129856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:55.132645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:55.133660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:55.135389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:55.721061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:55.732653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c96051ed-a5f6-45fb-b0df-a179af1b2252 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1504 microversion: 2.1 time: 0.628601 Apr 02 20:53:55.734128 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 403/676] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:55 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:55.750099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:55.750729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:55.766208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:55.766976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:55.768365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:55.769209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:55.928667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:55.939375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5dbce42d-dee6-448a-a376-d5917a4686b7 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1319 microversion: 2.1 time: 0.203165 Apr 02 20:53:55.950239 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 404/677] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:55 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:55.961077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0bf03ff6-0dc9-4c0c-ab1b-306aca041825 req-30590def-9382-420c-98ed-8c555619e1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a121f5-71aa-45c3-9a40-c1534709b364", "name": "network-vif-deleted", "tag": "7452f163-14e5-4e33-a069-7a4221cce019"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:55.971626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0bf03ff6-0dc9-4c0c-ab1b-306aca041825 req-30590def-9382-420c-98ed-8c555619e1ce service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:55.975199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0bf03ff6-0dc9-4c0c-ab1b-306aca041825 req-30590def-9382-420c-98ed-8c555619e1ce service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.032715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0bf03ff6-0dc9-4c0c-ab1b-306aca041825 req-30590def-9382-420c-98ed-8c555619e1ce service nova] Creating event network-vif-deleted:7452f163-14e5-4e33-a069-7a4221cce019 for instance 98a121f5-71aa-45c3-9a40-c1534709b364 on nch2-master-1 Apr 02 20:53:56.040629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0bf03ff6-0dc9-4c0c-ab1b-306aca041825 req-30590def-9382-420c-98ed-8c555619e1ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088468 Apr 02 20:53:56.047367 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 405/678] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:56.075517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:56.076772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:56.085778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.090768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.092478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.093666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.181408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.182756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.184158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lazy-loading 'fault' on Instance uuid 0f6c04cc-d558-4512-a7cf-6306a624af7b {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:53:56.262736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c24dff48d3544e049af02871f27b2a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3659a4fe104604ab6161e28854b4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:56.270407 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-133b0708-f9fe-41d1-9c7f-cc0e9b29c798 tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 200 len: 1313 microversion: 2.1 time: 0.210664 Apr 02 20:53:56.271567 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 406/679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:56 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:56.278286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f8168d51-9524-47a1-b98e-6d010946a19d req-8258276d-f8ac-4802-9030-2db2763b3f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6c04cc-d558-4512-a7cf-6306a624af7b", "name": "network-vif-deleted", "tag": "38aff574-c6a0-4aad-aadc-b0fdbe398a3b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:56.293177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f8168d51-9524-47a1-b98e-6d010946a19d req-8258276d-f8ac-4802-9030-2db2763b3f65 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.294534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f8168d51-9524-47a1-b98e-6d010946a19d req-8258276d-f8ac-4802-9030-2db2763b3f65 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.342915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f8168d51-9524-47a1-b98e-6d010946a19d req-8258276d-f8ac-4802-9030-2db2763b3f65 service nova] Creating event network-vif-deleted:38aff574-c6a0-4aad-aadc-b0fdbe398a3b for instance 0f6c04cc-d558-4512-a7cf-6306a624af7b on nch2-master-1 Apr 02 20:53:56.359218 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f8168d51-9524-47a1-b98e-6d010946a19d req-8258276d-f8ac-4802-9030-2db2763b3f65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085670 Apr 02 20:53:56.370920 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 407/680] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:56.387966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:56.389698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:56.402977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.415379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.416365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.417003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.455067 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] HTTP exception thrown: Instance 98a121f5-71aa-45c3-9a40-c1534709b364 could not be found. Apr 02 20:53:56.474807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 404 to user: Instance 98a121f5-71aa-45c3-9a40-c1534709b364 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:56.487448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e26f1de4-3330-41f9-832d-24023ab9c01b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 404 len: 111 microversion: 2.1 time: 0.115170 Apr 02 20:53:56.492294 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 408/681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:56 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:56.518511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-93a41481-3b51-408c-9e32-9385d95c292b req-ca843782-1594-41f2-b00b-0303fc069ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6c04cc-d558-4512-a7cf-6306a624af7b", "name": "network-vif-unplugged", "status": "completed", "tag": "38aff574-c6a0-4aad-aadc-b0fdbe398a3b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:53:56.538268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-93a41481-3b51-408c-9e32-9385d95c292b req-ca843782-1594-41f2-b00b-0303fc069ceb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.544569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-93a41481-3b51-408c-9e32-9385d95c292b req-ca843782-1594-41f2-b00b-0303fc069ceb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.569163 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-93a41481-3b51-408c-9e32-9385d95c292b req-ca843782-1594-41f2-b00b-0303fc069ceb service nova] Creating event network-vif-unplugged:38aff574-c6a0-4aad-aadc-b0fdbe398a3b for instance 0f6c04cc-d558-4512-a7cf-6306a624af7b on nch2-master-1 Apr 02 20:53:56.580388 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-93a41481-3b51-408c-9e32-9385d95c292b req-ca843782-1594-41f2-b00b-0303fc069ceb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070620 Apr 02 20:53:56.588066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 409/682] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:56.594485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:56.597297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:56.609263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.609860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.610770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:56.611346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:56.952930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:56.966022 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe4a39a2-91f4-437b-a02a-cabcf333bb9c tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.372454 Apr 02 20:53:56.984015 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 410/683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:56 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:56.990911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:57.000382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:57.011886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:53:57.027057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.031920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.034578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.035369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.290565 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a41077c-8210-4087-b7c3-4cbcc16b4053 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.303952 Apr 02 20:53:57.297246 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 411/684] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Apr 2 20:53:56 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:53:57.297246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:57.297246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:57.308936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.309353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.310270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.310845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.733716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:57.733716 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d09c52a-b0a4-488a-9a0f-b9e07303f437 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1504 microversion: 2.1 time: 0.440448 Apr 02 20:53:57.753743 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 412/685] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:57 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:57.760143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:57.775937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:57.789101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.792387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.792387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.792387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.913454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:57.922147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b3895e5-075d-4617-bdb3-e90f3d6343d1 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1319 microversion: 2.1 time: 0.166487 Apr 02 20:53:57.930042 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 413/686] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:57 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:57.943509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:57.944378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] [instance: 0f6c04cc-d558-4512-a7cf-6306a624af7b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:57.963047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.963532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.964668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:57.965452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:57.998477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] HTTP exception thrown: Instance 0f6c04cc-d558-4512-a7cf-6306a624af7b could not be found. Apr 02 20:53:57.999821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] Returning 404 to user: Instance 0f6c04cc-d558-4512-a7cf-6306a624af7b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:58.001608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c4a6c14-d158-436f-bdc1-bb3a20b7bc8f tempest-ServerDiagnosticsNegativeTest-518155627 tempest-ServerDiagnosticsNegativeTest-518155627-project] 10.222.0.18 "GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b" status: 404 len: 111 microversion: 2.1 time: 0.070833 Apr 02 20:53:58.008771 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 414/687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:57 2022] GET /compute/v2.1/servers/0f6c04cc-d558-4512-a7cf-6306a624af7b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:53:58.014216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9dcc2ced-20f1-4226-aa32-c0b9b5555d08 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:58.016063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9dcc2ced-20f1-4226-aa32-c0b9b5555d08 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:53:58.020722 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9dcc2ced-20f1-4226-aa32-c0b9b5555d08 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010620 Apr 02 20:53:58.025217 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 415/688] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Apr 2 20:53:58 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:53:58.042144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:58.042944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:53:58.065931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:58.067120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:58.068207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:58.088213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:58.474384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:58.482559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3706782-81a6-439d-84dc-2ae746db40e5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.459710 Apr 02 20:53:58.496036 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 416/689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:53:58 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:53:58.511239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:53:58.517448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:53:58.527250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:53:58.551331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:58.553476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:58.554549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:53:58.567640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:53:58.891875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:53:59.248952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c33b235-8bdb-4afa-9816-175636fca80a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.751501 Apr 02 20:53:59.267788 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 417/690] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 20:53:58 2022] GET /compute/v2.1/servers => generated 683 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:53:59.868121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1353083164", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:04.046845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:04.048204 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bc82e3d-73dc-4434-a40c-6fde43b1ca89 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1433 microversion: 2.1 time: 13.801813 Apr 02 20:54:04.049972 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 274/691] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:53:50 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1433 bytes in 13804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:04.068367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3138d4a6-4024-4506-8788-750134b5d89a req-aaa4d7a1-ab50-4e9a-b1b4-b1210e4a436e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9702c7-3cb0-4764-bfad-98cdc6767f2d", "tag": "4037f3ad-46a9-4e66-8974-76920ca5320b"}, {"server_uuid": "807e6da4-1b09-4731-9332-98dce9466b87", "name": "network-vif-deleted", "tag": "94129b94-caea-4aa7-bc27-5f3cfd83ebcb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:04.081422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3138d4a6-4024-4506-8788-750134b5d89a req-aaa4d7a1-ab50-4e9a-b1b4-b1210e4a436e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.084268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3138d4a6-4024-4506-8788-750134b5d89a req-aaa4d7a1-ab50-4e9a-b1b4-b1210e4a436e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.103659 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3138d4a6-4024-4506-8788-750134b5d89a req-aaa4d7a1-ab50-4e9a-b1b4-b1210e4a436e service nova] Creating event network-changed:4037f3ad-46a9-4e66-8974-76920ca5320b for instance 0a9702c7-3cb0-4764-bfad-98cdc6767f2d on nch1-master-1 Apr 02 20:54:04.104618 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3138d4a6-4024-4506-8788-750134b5d89a req-aaa4d7a1-ab50-4e9a-b1b4-b1210e4a436e service nova] Creating event network-vif-deleted:94129b94-caea-4aa7-bc27-5f3cfd83ebcb for instance 807e6da4-1b09-4731-9332-98dce9466b87 on nch1-master-1 Apr 02 20:54:04.116498 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3138d4a6-4024-4506-8788-750134b5d89a req-aaa4d7a1-ab50-4e9a-b1b4-b1210e4a436e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063535 Apr 02 20:54:04.120935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 275/692] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:04.127446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:04.129342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:04.137068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.137384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.138261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.138703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.291946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:04.293200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:04.294012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:04.294784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:04.295350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:04.308475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.312439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.319279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.319997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.345925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:04.350710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for user c1d982c5db7e47a6ae521f2137af3204 and project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:04.363787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:04.366814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:04.405755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:04.415883 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0e262f8-c74a-4cc0-bcbf-4484efa3ca72 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1479 microversion: 2.1 time: 0.293437 Apr 02 20:54:04.416559 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 276/693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:04 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1479 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:04.422945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:04.423774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:04.431196 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef22cb37-1ea8-4f04-aa30-c70c846366ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.161850 Apr 02 20:54:04.432135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 418/694] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 5163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:54:04.441010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.443274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.444220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.444881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.460516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:04.465742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:04.466304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.servers [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Removing options 'limit' from query {{(pid=136518) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 02 20:54:04.467243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:04.478177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.480011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.483766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.484384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.523171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:54:04.576957 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6caf792a-aeec-4d6d-a581-5085f8ba5189 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.143418 Apr 02 20:54:04.582453 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 419/695] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Apr 2 20:54:04 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:04.590060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:04.590678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:04.608422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.608889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.609804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:04.610115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:04.679242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:04.720248 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62b58433-ef29-486d-bd72-75991d1bc320 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.300620 Apr 02 20:54:04.722794 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 277/696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:04 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:04.737812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60428225-844f-400d-8255-4903115cfd5a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4ffc310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:04.839771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60428225-844f-400d-8255-4903115cfd5a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 200 len: 1433 microversion: 2.1 time: 0.115608 Apr 02 20:54:04.849193 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 278/697] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:04 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 1433 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:04.991334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:05.003393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-491173de-6c4e-46e9-957e-05df462eb692 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.419612 Apr 02 20:54:05.009640 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 420/698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:04 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:05.015639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cc999a16-cfca-4f87-921d-d6ab62f9a5d7 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '.version_select at 0x7f54d54ca820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.018828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc999a16-cfca-4f87-921d-d6ab62f9a5d7 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.020546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc999a16-cfca-4f87-921d-d6ab62f9a5d7 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.044564 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cc999a16-cfca-4f87-921d-d6ab62f9a5d7 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.032314 Apr 02 20:54:05.045897 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 421/699] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:05.051569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c509d17-83ba-4e91-815c-a8afd29fedf8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.053020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5c509d17-83ba-4e91-815c-a8afd29fedf8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:05.118111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c509d17-83ba-4e91-815c-a8afd29fedf8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:05.126452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-491956406", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:05.127386 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c509d17-83ba-4e91-815c-a8afd29fedf8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1213 microversion: 2.1 time: 0.080181 Apr 02 20:54:05.129892 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 422/700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:05.136112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b2bbdfc-1c25-4ec8-af39-e3d700375260 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.139155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b2bbdfc-1c25-4ec8-af39-e3d700375260 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:05.140714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b2bbdfc-1c25-4ec8-af39-e3d700375260 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009678 Apr 02 20:54:05.141781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 423/701] 10.222.0.18 () {58 vars in 1141 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:54:05.152049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.153129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:05.161763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.162477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.163620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.164804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.224945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:05.420153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:05.434941 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ffc6b13-704b-4f38-af6e-e7b66911236a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1467 microversion: 2.1 time: 0.291850 Apr 02 20:54:05.444690 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 424/702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:05.447193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.447340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:05.463275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.465430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.466976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.467479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.512487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:05.513468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:05.513865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:05.514375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:05.515444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:05.528747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.529209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.530027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.530480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.550748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:05.555143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:05.570317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:05.573003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:05.636137 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cab284e3-934b-4a95-bdba-83556a8fc578 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785487 Apr 02 20:54:05.637361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 279/703] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:54:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:54:05.666602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d80370a8-63ed-4502-a881-87cb56f5acf9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.668219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d80370a8-63ed-4502-a881-87cb56f5acf9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:05.669087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d80370a8-63ed-4502-a881-87cb56f5acf9 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.030211 Apr 02 20:54:05.669621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 280/704] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:54:05.670008 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec85274b-5d75-46d9-ad16-96fb0eccfa0a tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1630 microversion: 2.1 time: 0.233131 Apr 02 20:54:05.670797 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 425/705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1630 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:05.682777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9be87f54-b7ad-4ce8-8b02-6afa1efa697f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d53de1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.726394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d32d40c3-0dd9-4335-912d-bcbd3d3544ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.727028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d32d40c3-0dd9-4335-912d-bcbd3d3544ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:05.740952 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9be87f54-b7ad-4ce8-8b02-6afa1efa697f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/9e007d99-9b87-492c-9398-c1bd6aff27cb" status: 200 len: 784 microversion: 2.1 time: 0.069619 Apr 02 20:54:05.747733 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 281/706] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/images/9e007d99-9b87-492c-9398-c1bd6aff27cb => generated 784 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:05.749640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b7a28fa-387f-4a87-8117-c3908545b8f6 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.754290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9b7a28fa-387f-4a87-8117-c3908545b8f6 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:05.755211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9b7a28fa-387f-4a87-8117-c3908545b8f6 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:05.762062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.servers [None req-9b7a28fa-387f-4a87-8117-c3908545b8f6 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Flavor 'non_existing_flavor' could not be found {{(pid=136517) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Apr 02 20:54:05.763302 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b7a28fa-387f-4a87-8117-c3908545b8f6 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019492 Apr 02 20:54:05.763822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 282/707] 10.222.0.18 () {58 vars in 1177 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:54:05.770712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.771534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:05.778157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.780737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.782377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.785879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.880245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d32d40c3-0dd9-4335-912d-bcbd3d3544ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:05.889144 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d32d40c3-0dd9-4335-912d-bcbd3d3544ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1216 microversion: 2.1 time: 0.206351 Apr 02 20:54:05.889950 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 426/708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1216 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:05.921641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34418d7e-9c32-4881-8321-2fd21a7112b5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.944432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34418d7e-9c32-4881-8321-2fd21a7112b5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053600 Apr 02 20:54:05.945096 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 427/709] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:05.956128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:05.962215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:05.963314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:05.969571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.969966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:05.970785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:05.971233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:06.097529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf22086a-2171-42d5-ba1c-0a48b48f7e7a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.150404 Apr 02 20:54:06.098329 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 428/710] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:54:06.108368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-921340600", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "83a57283-8e77-4048-913b-713f633ea68f"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:06.117585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:06.134916 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b7937bf-7b71-4697-bcd4-1ca301351da0 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.366862 Apr 02 20:54:06.137351 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 283/711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:05 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:06.157568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1ca29061-1bfd-453a-a04b-31b7b3b46498 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d5131040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:07.385405 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1ca29061-1bfd-453a-a04b-31b7b3b46498 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "DELETE /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 204 len: 0 microversion: 2.1 time: 1.246212 Apr 02 20:54:07.386328 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 284/712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:06 2022] DELETE /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:54:07.392146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:07.392824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:07.408307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:07.414457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] validate_networks() for [('83a57283-8e77-4048-913b-713f633ea68f', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:07.419688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:07.420637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:07.421479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:07.787738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:07.804521 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b946247d-f22b-44e9-80b5-81279d94c4ff tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.408905 Apr 02 20:54:07.812420 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 285/713] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:07 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:07.818302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:07.824277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:07.825898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:07.848090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:07.849026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:07.850394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:07.851828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:07.911310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:07.911992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:07.912669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:07.913084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:07.913500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:07.923144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:07.923745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:07.924721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:07.925442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:07.943873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:07.948145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for user a2e061bb9a054fb1945417baf444eaee and project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:07.959235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:07.961446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:08.006209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-694039a7-4d80-4cdc-abb6-dfdf274ee6f4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902991 Apr 02 20:54:08.011602 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 429/714] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:54:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:54:08.012347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:08.012992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:08.025913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.026752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.027758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.028413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.037982 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c591ceac-a1fd-4fc5-9ded-677be1f20b6a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.224033 Apr 02 20:54:08.038908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 286/715] 10.222.0.18 () {58 vars in 1183 bytes} [Sat Apr 2 20:54:07 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:54:08.045305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-11a68f34-7009-48b6-99d2-1d9500f3e1ce req-fecf9f97-d8a8-4cf7-a143-d676c32402bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ac4213-e19d-4d5a-bbd3-7b0cd30d9738", "tag": "a84128dc-caef-46d0-8071-fe3f7c4c4a81"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:08.056890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-11a68f34-7009-48b6-99d2-1d9500f3e1ce req-fecf9f97-d8a8-4cf7-a143-d676c32402bb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.057455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-11a68f34-7009-48b6-99d2-1d9500f3e1ce req-fecf9f97-d8a8-4cf7-a143-d676c32402bb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.073735 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-11a68f34-7009-48b6-99d2-1d9500f3e1ce req-fecf9f97-d8a8-4cf7-a143-d676c32402bb service nova] Creating event network-changed:a84128dc-caef-46d0-8071-fe3f7c4c4a81 for instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 on nch1-master-1 Apr 02 20:54:08.079410 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-11a68f34-7009-48b6-99d2-1d9500f3e1ce req-fecf9f97-d8a8-4cf7-a143-d676c32402bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039208 Apr 02 20:54:08.080208 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 287/716] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:08.086464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:08.087438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:08.096327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.097096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.098597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.099199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.200360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:08.211937 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1b0c585-471b-43ce-8d4c-d8762fff1b2f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1274 microversion: 2.1 time: 0.129724 Apr 02 20:54:08.221467 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 288/717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:08 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:08.221467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:08.221467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:08.228324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.229185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.230778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.231329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.493062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:08.502066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad341412-5297-44ba-ab07-b0a1b2277446 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.493721 Apr 02 20:54:08.502640 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 430/718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:08 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:08.508139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cd6cb50-0aa3-406c-aa7f-a0b2e2068f6e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4d08790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:08.530534 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0cd6cb50-0aa3-406c-aa7f-a0b2e2068f6e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] HTTP exception thrown: Image not found. Apr 02 20:54:08.531899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cd6cb50-0aa3-406c-aa7f-a0b2e2068f6e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:08.532352 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0cd6cb50-0aa3-406c-aa7f-a0b2e2068f6e tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 404 len: 62 microversion: 2.1 time: 0.028636 Apr 02 20:54:08.533126 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 431/719] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:08 2022] GET /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:54:08.694227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2306b78-56b8-4d34-ae7e-1ce214ead709 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Action: 'create', calling method: .version_select at 0x7f54d4d5d8b0>, body: {"keypair": {"name": "tempest-keypair-1414920512"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:08.698644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:08.707849 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ab0dbce-ee75-4e59-be88-810f65c872df tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.493720 Apr 02 20:54:08.715593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b2306b78-56b8-4d34-ae7e-1ce214ead709 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Getting quotas for project 6e2a80eb708d4a2b8aab54b268dc218d. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:08.718644 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 289/720] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:08 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:08.722275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b2306b78-56b8-4d34-ae7e-1ce214ead709 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Getting quotas for user cf5e0bd625644d9eabf92db0624219e9 and project 6e2a80eb708d4a2b8aab54b268dc218d. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:08.723855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:08.724490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:08.731746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.732423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.733616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.734573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.841581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b2306b78-56b8-4d34-ae7e-1ce214ead709 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Getting quotas for project 6e2a80eb708d4a2b8aab54b268dc218d. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:08.847066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b2306b78-56b8-4d34-ae7e-1ce214ead709 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Getting quotas for user cf5e0bd625644d9eabf92db0624219e9 and project 6e2a80eb708d4a2b8aab54b268dc218d. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:08.864137 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2306b78-56b8-4d34-ae7e-1ce214ead709 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.328837 Apr 02 20:54:08.865162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 432/721] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:54:08 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:08.875627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:08.876657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:08.880476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:08.881510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:08.890021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.890732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.891707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.892844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.906086 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-406fba4d-9efe-4726-9d56-fa3c5ccc8a0a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1262 microversion: 2.1 time: 0.186225 Apr 02 20:54:08.910492 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 290/722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:08 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1262 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:08.932493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-112354250"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:08.935113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:08.960768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.961261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:08.967727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:08.968297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:09.165033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:54:09.339207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:09.353044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:09.353503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:09.388390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9429cc93-e37f-4605-be76-d1e7ca6f62ea tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "POST /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d/action" status: 202 len: 0 microversion: 2.1 time: 0.471047 Apr 02 20:54:09.390079 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 291/723] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:54:08 2022] POST /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 20:54:09.401429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:09.402375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:09.409874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:09.411502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:09.413177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:09.413854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:09.721515 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abc50896-62e9-43aa-9fed-bef397a27377 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.855081 Apr 02 20:54:09.722433 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 433/724] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:54:08 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:09.741616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:09.743304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:09.751707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:09.752421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:09.754022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:09.754794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.138329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:10.153574 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d49af466-854b-4c55-ac07-e456a085b1b3 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.761995 Apr 02 20:54:10.154703 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 292/725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:09 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:10.163102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b3a82716-d6f4-4d70-ba8e-dfbf446b7114 req-d4d9884e-43d0-4955-b5e0-02e7500b79ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9702c7-3cb0-4764-bfad-98cdc6767f2d", "name": "network-vif-plugged", "status": "completed", "tag": "4037f3ad-46a9-4e66-8974-76920ca5320b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:10.189239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:10.199868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b3a82716-d6f4-4d70-ba8e-dfbf446b7114 req-d4d9884e-43d0-4955-b5e0-02e7500b79ec service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.200622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b3a82716-d6f4-4d70-ba8e-dfbf446b7114 req-d4d9884e-43d0-4955-b5e0-02e7500b79ec service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.207800 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-458afea9-ce17-4a14-9cc2-ddff07e72831 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.482851 Apr 02 20:54:10.209293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 434/726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:09 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:10.218805 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b3a82716-d6f4-4d70-ba8e-dfbf446b7114 req-d4d9884e-43d0-4955-b5e0-02e7500b79ec service nova] Creating event network-vif-plugged:4037f3ad-46a9-4e66-8974-76920ca5320b for instance 0a9702c7-3cb0-4764-bfad-98cdc6767f2d on nch1-master-1 Apr 02 20:54:10.220900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4f0b4d4-f92d-424f-8ce7-db1622f9e50a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4ee79d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:10.230450 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b3a82716-d6f4-4d70-ba8e-dfbf446b7114 req-d4d9884e-43d0-4955-b5e0-02e7500b79ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074344 Apr 02 20:54:10.233170 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 293/727] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:10.249354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:10.250768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:10.270957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.274742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.277154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.281828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.310511 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4f0b4d4-f92d-424f-8ce7-db1622f9e50a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.099690 Apr 02 20:54:10.311582 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 435/728] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:10 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:10.317655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:10.318490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:10.327141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.327799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.329013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.329630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.653957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:10.664231 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c66b8792-0fc7-4a88-b23d-e0761266861b tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.351372 Apr 02 20:54:10.665639 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 436/729] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:10 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:10.679919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11d840a6-20e2-46af-9a3a-8e0b8439b31f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:10.685069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11d840a6-20e2-46af-9a3a-8e0b8439b31f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:10.686674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11d840a6-20e2-46af-9a3a-8e0b8439b31f tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010652 Apr 02 20:54:10.687389 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 437/730] 10.222.0.18 () {58 vars in 1177 bytes} [Sat Apr 2 20:54:10 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:54:10.699090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:10.699928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:10.707016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.707708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.710114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.710769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.811599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:10.819960 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a94957a7-e8c4-454b-84e5-0a9716ed4e03 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.584831 Apr 02 20:54:10.820718 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 294/731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:10 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:10.828740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3371fb60-e95e-4d23-be42-78e56dacc362 req-ec43c1e7-2dc9-4b4a-b9ff-35d76f58f1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28074b2-b820-4fa1-8693-1ff7cf91a474", "tag": "26f419c3-bf0c-45a0-a419-019238f49182"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:10.839317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3371fb60-e95e-4d23-be42-78e56dacc362 req-ec43c1e7-2dc9-4b4a-b9ff-35d76f58f1df service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.840859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3371fb60-e95e-4d23-be42-78e56dacc362 req-ec43c1e7-2dc9-4b4a-b9ff-35d76f58f1df service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.857801 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3371fb60-e95e-4d23-be42-78e56dacc362 req-ec43c1e7-2dc9-4b4a-b9ff-35d76f58f1df service nova] Creating event network-changed:26f419c3-bf0c-45a0-a419-019238f49182 for instance c28074b2-b820-4fa1-8693-1ff7cf91a474 on nch2-master-1 Apr 02 20:54:10.867183 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3371fb60-e95e-4d23-be42-78e56dacc362 req-ec43c1e7-2dc9-4b4a-b9ff-35d76f58f1df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044459 Apr 02 20:54:10.868114 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 295/732] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:10.873887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:10.877666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:10.879185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Searching by: {'deleted': False, 'project_id': '89b61101b5644010bc714c2cdeba96eb'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:10.885326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.885933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.886737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:10.887174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:10.923047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:54:11.036000 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a2543e80-4239-403f-9153-47a727c39611 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.166012 Apr 02 20:54:11.037083 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 296/733] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 20:54:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:11.048619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.049366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:11.056033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.056596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.057445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.058102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.073887 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] HTTP exception thrown: Instance 98a121f5-71aa-45c3-9a40-c1534709b364 could not be found. Apr 02 20:54:11.075241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 404 to user: Instance 98a121f5-71aa-45c3-9a40-c1534709b364 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:11.077326 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a90cde4-1d5b-418c-a9a2-31cfeea219cb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 404 len: 111 microversion: 2.1 time: 0.032509 Apr 02 20:54:11.078069 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 297/734] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:54:11 2022] DELETE /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:11.088559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.089231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:11.099547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.101646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.102941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.103965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:11.105016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.116739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd2a0650-342d-4b70-b6ff-ed4c412d6167 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.422011 Apr 02 20:54:11.117846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 438/735] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:10 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:11.133797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:54:11.179658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.189822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:11.211250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.211749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.212692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.215299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.297252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9af60179-8e75-48d5-8fed-4495cdaaef3c tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "DELETE /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5" status: 204 len: 0 microversion: 2.1 time: 0.209640 Apr 02 20:54:11.303016 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 298/736] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:54:11 2022] DELETE /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:54:11.310633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.311353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:11.321020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.321412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.322707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.323418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.810360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:11.820153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-75b39a8f-a30e-448c-8e53-7104dbe50109 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.652052 Apr 02 20:54:11.828064 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 439/737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:11 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:11.836666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.837717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:11.844585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.845249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.846222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:11.846828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:11.885704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:11.890980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:54:11.893327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f1a9137-88cf-4fc5-9258-e4b93061b8a3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.588988 Apr 02 20:54:11.896786 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 299/738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:11 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:11.902799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1471f84-fdcb-4323-9811-2948864371fc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4fdb700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.974686 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1471f84-fdcb-4323-9811-2948864371fc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.076402 Apr 02 20:54:11.975694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 300/739] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:11 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:11.986555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:11.988326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:12.002482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.003173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.004183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.007428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.045189 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ccf7ed9f-b239-493c-9525-129ce865d4f2 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "DELETE /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 204 len: 0 microversion: 2.1 time: 0.215033 Apr 02 20:54:12.046081 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 440/740] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:54:11 2022] DELETE /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:54:12.059952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:12.061908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:12.073416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.074260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.075376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.076285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.337463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:12.358003 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e4515ee-52db-4885-a9b2-8a654b4ed234 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.374402 Apr 02 20:54:12.364341 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 301/741] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:11 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:12.382725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:12.385116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 98a121f5-71aa-45c3-9a40-c1534709b364] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:12.404516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.414701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.415745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.420884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.437683 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] HTTP exception thrown: Instance 98a121f5-71aa-45c3-9a40-c1534709b364 could not be found. Apr 02 20:54:12.439108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 404 to user: Instance 98a121f5-71aa-45c3-9a40-c1534709b364 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:12.441289 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a546a0e5-5f3c-4fd6-9a95-cf0c638fbc89 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364" status: 404 len: 111 microversion: 2.1 time: 0.075024 Apr 02 20:54:12.442544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 302/742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:12 2022] GET /compute/v2.1/servers/98a121f5-71aa-45c3-9a40-c1534709b364 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:12.448805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:12.449780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:12.458082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.458801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.459710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.460249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.481087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:12.488944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-64b7508b-627b-46de-ade1-48417c29178e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.441639 Apr 02 20:54:12.489535 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 441/743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:12 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:12.500015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-6749fe35-6ae0-444b-8fa3-217e9338188f req-e523f485-e933-49b7-a7f6-4dc0e2bba5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "name": "network-vif-unplugged", "status": "completed", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:12.511023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6749fe35-6ae0-444b-8fa3-217e9338188f req-e523f485-e933-49b7-a7f6-4dc0e2bba5ff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.511603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6749fe35-6ae0-444b-8fa3-217e9338188f req-e523f485-e933-49b7-a7f6-4dc0e2bba5ff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.528079 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-6749fe35-6ae0-444b-8fa3-217e9338188f req-e523f485-e933-49b7-a7f6-4dc0e2bba5ff service nova] Creating event network-vif-unplugged:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:54:12.533954 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-6749fe35-6ae0-444b-8fa3-217e9338188f req-e523f485-e933-49b7-a7f6-4dc0e2bba5ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037418 Apr 02 20:54:12.534876 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 442/744] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:12.540136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-aafbcc72-bdf1-4bf4-926f-695350622704 req-a6c8904d-ce84-41ba-b6f1-8c39217e57bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b118f37c-0f35-46b9-81d4-a4c7f161dd5a", "tag": "621c3ce8-97a3-47b2-8fb2-3a484d590744"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:12.563098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-aafbcc72-bdf1-4bf4-926f-695350622704 req-a6c8904d-ce84-41ba-b6f1-8c39217e57bc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.565099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-aafbcc72-bdf1-4bf4-926f-695350622704 req-a6c8904d-ce84-41ba-b6f1-8c39217e57bc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.580479 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-aafbcc72-bdf1-4bf4-926f-695350622704 req-a6c8904d-ce84-41ba-b6f1-8c39217e57bc service nova] Creating event network-changed:621c3ce8-97a3-47b2-8fb2-3a484d590744 for instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a on nch2-master-1 Apr 02 20:54:12.587269 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-aafbcc72-bdf1-4bf4-926f-695350622704 req-a6c8904d-ce84-41ba-b6f1-8c39217e57bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051074 Apr 02 20:54:12.593165 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 443/745] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:12.598907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:12.599680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:12.606813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.609237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.610217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.610940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.775097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:12.782551 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b467ae53-8285-4455-9f54-4d4d2a69ce7e tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5" status: 200 len: 1522 microversion: 2.1 time: 0.188147 Apr 02 20:54:12.783126 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 444/746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:12 2022] GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:12.787647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1678833011", "imageRef": "cfc8cb76-46ca-4c98-9fb7-0087b06fa17f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a4850a71-8145-40aa-b0f3-8efc7deb071e"}], "security_groups": [{"name": "tempest-securitygroup--34251400"}], "key_name": "tempest-keypair-1414920512", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:12.807508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:12.815595 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08d5b1d5-8218-4ed7-8581-4a1c3312dca3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.371749 Apr 02 20:54:12.817834 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 303/747] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:12 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:12.848389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:12.849267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:12.861875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.862582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.863998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:12.864445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:12.906697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] validate_networks() for [('a4850a71-8145-40aa-b0f3-8efc7deb071e', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:13.323922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:13.324375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:13.324949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:13.325365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:13.325780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:13.335682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.336048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.336894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.337332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.357849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Getting quotas for project 6e2a80eb708d4a2b8aab54b268dc218d. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:13.366640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Getting quotas for user cf5e0bd625644d9eabf92db0624219e9 and project 6e2a80eb708d4a2b8aab54b268dc218d. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:13.378975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:13.381433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cfc8cb76-46ca-4c98-9fb7-0087b06fa17f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:13.434545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b7ab2f47-ab1e-48b2-90ea-8a8ffa0e7be8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.650187 Apr 02 20:54:13.436732 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 445/748] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:54:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:54:13.441845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:13.442637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:13.449434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.450154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.450958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.451499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.470741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:13.485551 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6878b8f6-66ae-4967-9524-c469fed4b798 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.641441 Apr 02 20:54:13.496103 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 304/749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:12 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:13.515498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-71fef45b-5a96-4f78-ab0d-435038051f34 req-f121c710-69bb-433a-8c45-c61191495127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0adca561-7967-465d-a3e3-78a0dd5bb75d", "tag": "860f3b0f-e306-416d-a721-e0c5589bea14"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:13.524936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-71fef45b-5a96-4f78-ab0d-435038051f34 req-f121c710-69bb-433a-8c45-c61191495127 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.525741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-71fef45b-5a96-4f78-ab0d-435038051f34 req-f121c710-69bb-433a-8c45-c61191495127 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.538238 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-71fef45b-5a96-4f78-ab0d-435038051f34 req-f121c710-69bb-433a-8c45-c61191495127 service nova] Creating event network-changed:860f3b0f-e306-416d-a721-e0c5589bea14 for instance 0adca561-7967-465d-a3e3-78a0dd5bb75d on nch2-master-1 Apr 02 20:54:13.543974 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-71fef45b-5a96-4f78-ab0d-435038051f34 req-f121c710-69bb-433a-8c45-c61191495127 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049688 Apr 02 20:54:13.544779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 305/750] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:13.551351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20359d5d-e957-4826-a555-17f63ec3ae1c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4fd4160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:13.617651 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20359d5d-e957-4826-a555-17f63ec3ae1c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.071531 Apr 02 20:54:13.618762 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 306/751] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:13 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:13.627371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:13.628511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:13.636342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.636965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.637858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.638402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.720378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:13.731731 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d481d2f4-eeeb-46d0-a006-ed165bc6b981 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.293858 Apr 02 20:54:13.732547 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 446/752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:13 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:13.742920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0e7f6f2-a7cc-4eae-9494-dc6a05d2c369 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:13.743548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0e7f6f2-a7cc-4eae-9494-dc6a05d2c369 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:13.849944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0e7f6f2-a7cc-4eae-9494-dc6a05d2c369 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:13.858480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0e7f6f2-a7cc-4eae-9494-dc6a05d2c369 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1246 microversion: 2.1 time: 0.124503 Apr 02 20:54:13.862044 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 447/753] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:13 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:13.883091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:13.886702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:13.898100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.898556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:13.906160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:13.906642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.046669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:14.065097 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e03fcc84-fbfa-418d-9e0e-eaeddd84dae4 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.444446 Apr 02 20:54:14.071148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 307/754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:13 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:14.087102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:14.089038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:14.098177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.100635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.104572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.105602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.397905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:14.406252 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8ff7bd9-b5f6-4275-9c48-b6ab39854a24 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.542845 Apr 02 20:54:14.408815 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 448/755] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:13 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:14.414769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:14.419235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:14.427448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.436908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.441547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.442050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.540277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:14.553282 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-620bf77e-6397-462a-8005-03fe03f34d6b tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5" status: 200 len: 1522 microversion: 2.1 time: 0.471302 Apr 02 20:54:14.555100 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 308/756] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:14 2022] GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:14.569461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:14.570717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:14.585341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.585801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.586603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.587052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.730806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:14.739037 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-12b5bef5-f571-43d3-9b6e-5dd5c0b176cd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.327851 Apr 02 20:54:14.739940 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 449/757] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:14 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:14.744433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-47f7de51-f1d2-4f0d-b1d6-2984d08e2f19 req-7dd2cc85-423c-4cb5-b290-4b511ca0299b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ac4213-e19d-4d5a-bbd3-7b0cd30d9738", "name": "network-vif-plugged", "status": "completed", "tag": "a84128dc-caef-46d0-8071-fe3f7c4c4a81"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:14.752903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-47f7de51-f1d2-4f0d-b1d6-2984d08e2f19 req-7dd2cc85-423c-4cb5-b290-4b511ca0299b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.753375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-47f7de51-f1d2-4f0d-b1d6-2984d08e2f19 req-7dd2cc85-423c-4cb5-b290-4b511ca0299b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.764742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-47f7de51-f1d2-4f0d-b1d6-2984d08e2f19 req-7dd2cc85-423c-4cb5-b290-4b511ca0299b service nova] Creating event network-vif-plugged:a84128dc-caef-46d0-8071-fe3f7c4c4a81 for instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 on nch1-master-1 Apr 02 20:54:14.769696 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-47f7de51-f1d2-4f0d-b1d6-2984d08e2f19 req-7dd2cc85-423c-4cb5-b290-4b511ca0299b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028507 Apr 02 20:54:14.770625 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 450/758] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:14.775849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afff0be5-1d09-4bcd-b13e-dc3f1ffa9cb0 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4d18280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:14.779018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:14.787774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-badfa855-5e82-4b93-8c56-771cdea6d988 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.230639 Apr 02 20:54:14.797068 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 309/759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:14 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:14.797068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:14.797068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:14.799484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.799938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.801366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.801805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.827598 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afff0be5-1d09-4bcd-b13e-dc3f1ffa9cb0 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.055755 Apr 02 20:54:14.828615 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 451/760] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:14 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:14.878354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:14.879149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:14.886893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.887776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.888742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:14.889341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:14.992727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:15.014840 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b1d1948b-4023-4b9b-845a-876c737867ac tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1298 microversion: 2.1 time: 0.140629 Apr 02 20:54:15.015436 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 452/761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:14 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:15.087377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:15.087377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:15.099369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:15.100371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.101096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.102160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.102559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.113714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0bdfa6d-bbfb-4bc7-8b0f-26ae6ae78ae6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.324453 Apr 02 20:54:15.118135 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 310/762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:14 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:15.385120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:15.401349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-af42d468-d32a-4dad-8049-016e9f463745 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.317346 Apr 02 20:54:15.401949 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 453/763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:15 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:15.425437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:15.426311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:15.436088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.436762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.437879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.444886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.573368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:15.574199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 94aec714-8ebc-4f16-8b88-6cc60f848fa5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:15.588749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.593310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.594428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.594979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.621538 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] HTTP exception thrown: Instance 94aec714-8ebc-4f16-8b88-6cc60f848fa5 could not be found. Apr 02 20:54:15.623412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 404 to user: Instance 94aec714-8ebc-4f16-8b88-6cc60f848fa5 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:15.626556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3037993-6fb1-458d-8657-70d0a83c24af tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5" status: 404 len: 111 microversion: 2.1 time: 0.058012 Apr 02 20:54:15.627240 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 454/764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:15 2022] GET /compute/v2.1/servers/94aec714-8ebc-4f16-8b88-6cc60f848fa5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:15.638176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-56351b3b-8c42-4e04-8c63-54cbea387bb6 req-91e876e1-d3fc-48c8-946f-ba54685a511c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94aec714-8ebc-4f16-8b88-6cc60f848fa5", "name": "network-vif-deleted", "tag": "0010195d-fd1b-4803-93c3-4bf1afaebdc0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:15.660937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-56351b3b-8c42-4e04-8c63-54cbea387bb6 req-91e876e1-d3fc-48c8-946f-ba54685a511c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.663705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-56351b3b-8c42-4e04-8c63-54cbea387bb6 req-91e876e1-d3fc-48c8-946f-ba54685a511c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.691599 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-56351b3b-8c42-4e04-8c63-54cbea387bb6 req-91e876e1-d3fc-48c8-946f-ba54685a511c service nova] Creating event network-vif-deleted:0010195d-fd1b-4803-93c3-4bf1afaebdc0 for instance 94aec714-8ebc-4f16-8b88-6cc60f848fa5 on nch2-master-1 Apr 02 20:54:15.703101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-56351b3b-8c42-4e04-8c63-54cbea387bb6 req-91e876e1-d3fc-48c8-946f-ba54685a511c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068115 Apr 02 20:54:15.703368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:15.705152 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 455/765] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:15.714168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:15.717060 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f4634ad-b534-4e01-829f-0bcdf57cdb6a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.296298 Apr 02 20:54:15.717987 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 311/766] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:15 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:15.719091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:15.733527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.734137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.736837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.737398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.756003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:15.756686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:15.766116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.766576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:15.770443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:15.771142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.017527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:16.027005 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24c9efca-bb0b-4743-88f2-3a082c3da40b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.275394 Apr 02 20:54:16.033842 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 312/767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:15 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:16.041668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:16.044296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:16.054119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:16.061816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.062284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.063476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.064119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.065036 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7382b050-c8e5-4c64-871e-9f8f3a621deb tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1522 microversion: 2.1 time: 0.354228 Apr 02 20:54:16.077332 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 456/768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:15 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:16.082448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e138afbf-25ba-43ca-9f9f-47e583483e8f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4be09d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:16.193950 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e138afbf-25ba-43ca-9f9f-47e583483e8f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.115222 Apr 02 20:54:16.195102 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 457/769] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:16 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:16.205244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:16.218382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:16.233542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.234585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.242535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.244796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.343553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:16.355318 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9e037ce8-a82e-4ee5-94e2-1823894bb3d7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1351 microversion: 2.1 time: 0.317510 Apr 02 20:54:16.369217 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 313/770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:16 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1351 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:16.377368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:16.377996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:16.399711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.400178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.417265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.422681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.662021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:16.673981 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad3c03b9-5f68-4a14-baef-fcfc877b8b21 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.477496 Apr 02 20:54:16.674790 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 458/771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:16 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:16.691900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:16.692544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:16.714041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.714504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.715301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.715748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.781118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:16.793737 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d6436886-c217-410a-95bc-5d60b4a3d98d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.423002 Apr 02 20:54:16.803788 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 314/772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:16 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:16.803788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:16.804065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:16.835509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.836244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:16.838503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:16.838907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:17.063953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:17.085334 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-53004f5a-9f25-4980-b9ed-0752b2e9b48d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.285076 Apr 02 20:54:17.099144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 315/773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:16 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:17.138221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-08e3e40d-9125-4bcc-83fd-1d2508b9dd1d req-ff8df7e0-c1db-4b47-8cfe-d09066611cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28074b2-b820-4fa1-8693-1ff7cf91a474", "name": "network-vif-plugged", "status": "completed", "tag": "26f419c3-bf0c-45a0-a419-019238f49182"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:17.186329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:17.195791 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-057501c1-91cd-4962-9a79-b449287d3a18 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1387 microversion: 2.1 time: 0.519892 Apr 02 20:54:17.196007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-08e3e40d-9125-4bcc-83fd-1d2508b9dd1d req-ff8df7e0-c1db-4b47-8cfe-d09066611cc9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:17.197516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-08e3e40d-9125-4bcc-83fd-1d2508b9dd1d req-ff8df7e0-c1db-4b47-8cfe-d09066611cc9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:17.202413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 459/774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:16 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1387 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:17.220781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:17.221645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:17.248176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:17.250757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-08e3e40d-9125-4bcc-83fd-1d2508b9dd1d req-ff8df7e0-c1db-4b47-8cfe-d09066611cc9 service nova] Creating event network-vif-plugged:26f419c3-bf0c-45a0-a419-019238f49182 for instance c28074b2-b820-4fa1-8693-1ff7cf91a474 on nch2-master-1 Apr 02 20:54:17.253720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:17.254761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:17.269294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:17.282413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-08e3e40d-9125-4bcc-83fd-1d2508b9dd1d req-ff8df7e0-c1db-4b47-8cfe-d09066611cc9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181598 Apr 02 20:54:17.283385 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 316/775] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:17.304572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:17.305460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:17.328675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:17.331322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:17.335963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:17.337631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:17.887220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:17.895005 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-966f5114-bf11-483a-abb4-103027cefac2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.691290 Apr 02 20:54:17.907080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 460/776] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:17 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:17.926652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f7f0a17c-65e0-4d1a-b19d-eb9b2652eaa8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4bd38b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:18.013166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f7f0a17c-65e0-4d1a-b19d-eb9b2652eaa8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.104861 Apr 02 20:54:18.014070 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 461/777] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:17 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:18.044112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:18.044792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:18.062484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.063592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.064650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.065363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.242715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:18.270902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07a88b89-d159-4f29-8a04-76371f8a6fd8 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1522 microversion: 2.1 time: 0.986209 Apr 02 20:54:18.278388 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 317/778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:17 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1522 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:18.305079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:18.308270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:18.339216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.345798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.349494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.351713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.551206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:18.579485 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb78f937-61f5-426d-816c-1a6a5f4c6f22 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1541 microversion: 2.1 time: 0.554761 Apr 02 20:54:18.580375 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 462/779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:18 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1541 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:18.599456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:18.600488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:18.608506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.609319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.610688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.611349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.859842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:18.871697 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6fd64533-72cc-4c75-ae64-ad79209e4330 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.590172 Apr 02 20:54:18.872789 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 318/780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:18 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:18.892606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:18.893951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:18.909521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.909986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.910797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.916493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:18.937985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:18.953514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ba65550-70fa-4e81-94aa-0eb9c07adb03 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.354543 Apr 02 20:54:18.955234 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 463/781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:18 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:18.962436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-30914054-442e-40f5-9c26-ae45fa3bb41e req-49b1a9e3-ba49-4f09-8706-e36bd3cb807e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef4400c-3d15-43a5-89f9-79edac5020ce", "tag": "d783c05e-b460-4890-8989-48914b4b5820"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:18.982394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-30914054-442e-40f5-9c26-ae45fa3bb41e req-49b1a9e3-ba49-4f09-8706-e36bd3cb807e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:18.983613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-30914054-442e-40f5-9c26-ae45fa3bb41e req-49b1a9e3-ba49-4f09-8706-e36bd3cb807e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.017170 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-30914054-442e-40f5-9c26-ae45fa3bb41e req-49b1a9e3-ba49-4f09-8706-e36bd3cb807e service nova] Creating event network-changed:d783c05e-b460-4890-8989-48914b4b5820 for instance 6ef4400c-3d15-43a5-89f9-79edac5020ce on nch2-master-1 Apr 02 20:54:19.030369 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-30914054-442e-40f5-9c26-ae45fa3bb41e req-49b1a9e3-ba49-4f09-8706-e36bd3cb807e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073281 Apr 02 20:54:19.031475 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 464/782] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:19.038257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.057338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.067568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.068632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.070082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.070987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.187420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:19.196284 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acaa9c10-4cb4-4cc2-ae0b-099a90d07563 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.322212 Apr 02 20:54:19.198063 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 319/783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:18 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:19.202753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.203250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.210388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.210837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.211625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.212070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.269592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:19.277596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3464353c-e181-47ec-9992-47ef108149f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1585 microversion: 2.1 time: 0.244686 Apr 02 20:54:19.278686 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 465/784] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1585 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:19.297324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c9bff082-d85b-4b9b-8a4d-f4f7306a2107 req-dc89d85d-1c06-4ced-b01f-430f8b87d18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c0c36e-2bc2-43ab-96c0-1582c8b94e00", "name": "network-vif-deleted", "tag": "9682d761-627f-435b-8889-b0b79b5a3c78"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:19.312107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c9bff082-d85b-4b9b-8a4d-f4f7306a2107 req-dc89d85d-1c06-4ced-b01f-430f8b87d18a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.312853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c9bff082-d85b-4b9b-8a4d-f4f7306a2107 req-dc89d85d-1c06-4ced-b01f-430f8b87d18a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.324864 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c9bff082-d85b-4b9b-8a4d-f4f7306a2107 req-dc89d85d-1c06-4ced-b01f-430f8b87d18a service nova] Creating event network-vif-deleted:9682d761-627f-435b-8889-b0b79b5a3c78 for instance 61c0c36e-2bc2-43ab-96c0-1582c8b94e00 on nch1-master-1 Apr 02 20:54:19.331018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c9bff082-d85b-4b9b-8a4d-f4f7306a2107 req-dc89d85d-1c06-4ced-b01f-430f8b87d18a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Apr 02 20:54:19.331961 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 466/785] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:19.338979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.339890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.356485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fcabfb66-b32e-43d2-b7d8-34e454db0924 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157092 Apr 02 20:54:19.357768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 320/786] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:19.358825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.359466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.360306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.361121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.363277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3aff8257-49e0-4b6d-b912-314424df16d5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d50119d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.505704 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3aff8257-49e0-4b6d-b912-314424df16d5 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.146718 Apr 02 20:54:19.508117 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 321/787] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:19.520796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.522990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.544580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.549087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.551525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.561290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.633534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.635477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.636898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lazy-loading 'fault' on Instance uuid 61c0c36e-2bc2-43ab-96c0-1582c8b94e00 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:19.664055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:19.672710 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-835a2f1f-0b13-4642-b143-96f15a24065a tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.339196 Apr 02 20:54:19.673855 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 467/788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:19.679674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.680816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.700501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.700501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.700501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.701653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.748656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d0dd5279384016ba00c5688ce1d615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b61101b5644010bc714c2cdeba96eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:19.757128 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4fbd8ce7-4c34-4c8f-96fc-dc8c903bb59a tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 200 len: 1313 microversion: 2.1 time: 0.247737 Apr 02 20:54:19.757833 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 322/789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:19.762397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-be0f185b-d183-4dea-b32c-d78dc0c7c386 req-e89fddbb-0293-4530-8bad-ab88b4590bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "name": "network-vif-plugged", "status": "completed", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:19.771788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-be0f185b-d183-4dea-b32c-d78dc0c7c386 req-e89fddbb-0293-4530-8bad-ab88b4590bf6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.772243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-be0f185b-d183-4dea-b32c-d78dc0c7c386 req-e89fddbb-0293-4530-8bad-ab88b4590bf6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.786891 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-be0f185b-d183-4dea-b32c-d78dc0c7c386 req-e89fddbb-0293-4530-8bad-ab88b4590bf6 service nova] Creating event network-vif-plugged:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:54:19.792353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-be0f185b-d183-4dea-b32c-d78dc0c7c386 req-e89fddbb-0293-4530-8bad-ab88b4590bf6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Apr 02 20:54:19.795897 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 323/790] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:19.844112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f72e216d-0fc4-4c41-a5b5-8a75775fdba6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168883 Apr 02 20:54:19.844911 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 468/791] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:19.905875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.909629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.958799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.971238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:19.972166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:19.975605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.980606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.981947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.984556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.985211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:19.986181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:19.986789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:20.419259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:20.428209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f320057d-0e52-4980-936e-e52472b14f71 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 0.460694 Apr 02 20:54:20.428899 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 469/792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:20.475998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:20.476660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:20.494041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:20.498194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:20.501157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:20.501914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:21.045759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:21.057203 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-887259bb-6706-45fd-a421-7433f72aa36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1313 microversion: 2.1 time: 0.600802 Apr 02 20:54:21.058086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 470/793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:20 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:21.076210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f69dc060-2716-4dca-a351-28ece1601793 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4bd3700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:21.889681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:21.899404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9cbab192-c415-46e5-80c9-b04d6e5aafa9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 2.010361 Apr 02 20:54:21.904397 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 324/794] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:19 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:21.914528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:21.916157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:21.935443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:21.936308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:21.937248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:21.937799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:22.602375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:22.630098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a053da5-e4c7-4c3c-9cb2-f8e77bbda0c6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1310 microversion: 2.1 time: 0.725098 Apr 02 20:54:22.631036 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 325/795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:21 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1310 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:22.636829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:22.637909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] [instance: 61c0c36e-2bc2-43ab-96c0-1582c8b94e00] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:22.648797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:22.649989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:22.651013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:22.651673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:22.678151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] HTTP exception thrown: Instance 61c0c36e-2bc2-43ab-96c0-1582c8b94e00 could not be found. Apr 02 20:54:22.679261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] Returning 404 to user: Instance 61c0c36e-2bc2-43ab-96c0-1582c8b94e00 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:22.680748 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-95ce08fc-0072-4299-a98c-0d39776ea7a4 tempest-ListServersNegativeTestJSON-237216186 tempest-ListServersNegativeTestJSON-237216186-project] 10.222.0.18 "GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00" status: 404 len: 111 microversion: 2.1 time: 0.047902 Apr 02 20:54:22.685946 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 326/796] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:22 2022] GET /compute/v2.1/servers/61c0c36e-2bc2-43ab-96c0-1582c8b94e00 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:22.719194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:22.720623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:22.731296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:22.732287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:22.733934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:22.734871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:23.835481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:23.852692 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9803498a-6fc7-4e62-929c-7707e02dd843 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1316 microversion: 2.1 time: 1.164950 Apr 02 20:54:23.881964 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 327/797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:22 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1316 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:23.893845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f85b1657-5aed-4e55-9bc6-56837089eb45 req-24bc6168-2273-4894-bc2a-532ed8799b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b118f37c-0f35-46b9-81d4-a4c7f161dd5a", "name": "network-vif-plugged", "status": "completed", "tag": "621c3ce8-97a3-47b2-8fb2-3a484d590744"}, {"server_uuid": "0adca561-7967-465d-a3e3-78a0dd5bb75d", "name": "network-vif-plugged", "status": "completed", "tag": "860f3b0f-e306-416d-a721-e0c5589bea14"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:23.912210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f85b1657-5aed-4e55-9bc6-56837089eb45 req-24bc6168-2273-4894-bc2a-532ed8799b4e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:23.913818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f85b1657-5aed-4e55-9bc6-56837089eb45 req-24bc6168-2273-4894-bc2a-532ed8799b4e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:23.960841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f85b1657-5aed-4e55-9bc6-56837089eb45 req-24bc6168-2273-4894-bc2a-532ed8799b4e service nova] Creating event network-vif-plugged:621c3ce8-97a3-47b2-8fb2-3a484d590744 for instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a on nch2-master-1 Apr 02 20:54:23.962683 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f85b1657-5aed-4e55-9bc6-56837089eb45 req-24bc6168-2273-4894-bc2a-532ed8799b4e service nova] Creating event network-vif-plugged:860f3b0f-e306-416d-a721-e0c5589bea14 for instance 0adca561-7967-465d-a3e3-78a0dd5bb75d on nch2-master-1 Apr 02 20:54:23.977907 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f85b1657-5aed-4e55-9bc6-56837089eb45 req-24bc6168-2273-4894-bc2a-532ed8799b4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093079 Apr 02 20:54:23.987813 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 328/798] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:24.025644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:24.028168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:24.057649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:24.062127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:24.066106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:24.068287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:25.845050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:25.903149 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d37bdca-ec9e-4fe4-8cdd-2be83936170c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1463 microversion: 2.1 time: 1.900089 Apr 02 20:54:25.938837 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 329/799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:23 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1463 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:25.944576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:25.958154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:25.976834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:25.978253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:25.982457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:25.985225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:26.707067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:26.722744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e8d573d-703f-410c-b7a8-d65b9adc7feb tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.782348 Apr 02 20:54:26.724596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 330/800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:25 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:26.731551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:26.734189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:26.744724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:26.758370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:26.759304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:26.759718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:27.070324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:27.090760 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8030fcbe-9546-4050-8225-57a0fbfa2fad tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1494 microversion: 2.1 time: 0.364703 Apr 02 20:54:27.091435 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 331/801] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:26 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1494 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:27.101565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:27.126429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:27.146376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:27.159117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:27.160174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:27.161050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:27.761181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:27.777883 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9cedf587-b5ed-460a-861d-2f71e8221fd6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1465 microversion: 2.1 time: 0.677938 Apr 02 20:54:27.780652 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 332/802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:27 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1465 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:27.803469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-87d2bfa0-9ed2-4fbc-9078-1240cddeb3f2 req-209963fc-3b47-41fc-a653-9e4ac61bae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a9702c7-3cb0-4764-bfad-98cdc6767f2d", "tag": "4037f3ad-46a9-4e66-8974-76920ca5320b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:27.834529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-87d2bfa0-9ed2-4fbc-9078-1240cddeb3f2 req-209963fc-3b47-41fc-a653-9e4ac61bae5f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:27.839958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-87d2bfa0-9ed2-4fbc-9078-1240cddeb3f2 req-209963fc-3b47-41fc-a653-9e4ac61bae5f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:27.892814 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-87d2bfa0-9ed2-4fbc-9078-1240cddeb3f2 req-209963fc-3b47-41fc-a653-9e4ac61bae5f service nova] Creating event network-changed:4037f3ad-46a9-4e66-8974-76920ca5320b for instance 0a9702c7-3cb0-4764-bfad-98cdc6767f2d on nch1-master-1 Apr 02 20:54:27.925179 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-87d2bfa0-9ed2-4fbc-9078-1240cddeb3f2 req-209963fc-3b47-41fc-a653-9e4ac61bae5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137522 Apr 02 20:54:27.930447 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 333/803] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:28.407490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:28.408358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:28.430660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:28.432936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:28.435941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:28.436737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:29.421987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76cd3c4b-6924-401d-a996-64e23c879ab5 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1614 microversion: 2.1 time: 1.488584 Apr 02 20:54:29.422664 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 334/804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:27 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1614 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:29.434289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:29.440092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:29.466912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:29.467375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:29.468190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:29.468669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:29.895507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:29.909091 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f567863-d8c2-4661-b10c-3a55de706b3a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1585 microversion: 2.1 time: 0.484802 Apr 02 20:54:29.911608 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 335/805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:29 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1585 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:29.916842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:29.917987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:29.929472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:29.950735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:29.953389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:29.954157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:30.172899 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60074fcb-8c8b-4aa3-9d91-d246371685d0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1645 microversion: 2.1 time: 0.259895 Apr 02 20:54:30.175055 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 336/806] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:29 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1645 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:30.181978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:30.182820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:30.191109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:30.191573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:30.192374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:30.192876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:30.365979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:30.374021 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f1cf607-83c8-46ac-8840-fdd54a47cc8f tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.197733 Apr 02 20:54:30.375250 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 337/807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:30 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:30.554595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:30.559871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:30.568728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:30.569984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:30.571452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:30.572162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:30.926528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-770bd991-c34d-451d-baee-4987cf3cbe4c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1616 microversion: 2.1 time: 0.549945 Apr 02 20:54:30.928007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 338/808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:30 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1616 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:30.935437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:30.936286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:30.944439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:30.944731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:30.945633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:30.946261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.054720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '730601c0fd034bc481ccef6fc607dac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de86ae49fbdc45948aabfd4a403e326c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:31.055474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] flavor_id is None. Assuming migration. {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 02 20:54:31.056695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 20:54:31.159153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f69dc060-2716-4dca-a351-28ece1601793 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 10.089393 Apr 02 20:54:31.164747 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 471/809] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:21 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 10102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:31.262580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1555835866", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "94f39d0c-6b16-4126-bf38-935667858434"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:31.347698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] validate_networks() for [('94f39d0c-6b16-4126-bf38-935667858434', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:31.425738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d943eaa7-035f-4b37-8c4c-5e32b5b2fa4f tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474/action" status: 202 len: 0 microversion: 2.1 time: 0.495770 Apr 02 20:54:31.429725 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 339/810] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:54:30 2022] POST /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:31.435173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-785bba9c-97ff-4dcb-ae7f-61f1cf8c161f req-23f0ceb0-9537-4c09-b32f-aa854a5053b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ac4213-e19d-4d5a-bbd3-7b0cd30d9738", "tag": "a84128dc-caef-46d0-8071-fe3f7c4c4a81"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:31.444869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-785bba9c-97ff-4dcb-ae7f-61f1cf8c161f req-23f0ceb0-9537-4c09-b32f-aa854a5053b1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.445332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-785bba9c-97ff-4dcb-ae7f-61f1cf8c161f req-23f0ceb0-9537-4c09-b32f-aa854a5053b1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.465639 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-785bba9c-97ff-4dcb-ae7f-61f1cf8c161f req-23f0ceb0-9537-4c09-b32f-aa854a5053b1 service nova] Creating event network-changed:a84128dc-caef-46d0-8071-fe3f7c4c4a81 for instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 on nch1-master-1 Apr 02 20:54:31.474754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-785bba9c-97ff-4dcb-ae7f-61f1cf8c161f req-23f0ceb0-9537-4c09-b32f-aa854a5053b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043180 Apr 02 20:54:31.476087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 340/811] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:31.482960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5d34f36-48a5-4c39-ad57-204bea505153 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:31.484846 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:54:31.484846 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:54:31.487859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5d34f36-48a5-4c39-ad57-204bea505153 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.488332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5d34f36-48a5-4c39-ad57-204bea505153 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.489267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5d34f36-48a5-4c39-ad57-204bea505153 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.489839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5d34f36-48a5-4c39-ad57-204bea505153 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.523944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5d34f36-48a5-4c39-ad57-204bea505153 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046790 Apr 02 20:54:31.524934 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 341/812] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:54:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:31.537648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e53939c-7007-4692-bab1-87a4d7d5a0e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: .version_select at 0x7f54d4fd43a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-677873561", "policies": ["affinity"]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:31.558646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4e53939c-7007-4692-bab1-87a4d7d5a0e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:31.565590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4e53939c-7007-4692-bab1-87a4d7d5a0e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:31.640628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4e53939c-7007-4692-bab1-87a4d7d5a0e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:31.645475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4e53939c-7007-4692-bab1-87a4d7d5a0e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:31.658051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e53939c-7007-4692-bab1-87a4d7d5a0e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.132042 Apr 02 20:54:31.658693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 342/813] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:54:31 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:31.663765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:31.664533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:31.671230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.671726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.672820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.673274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.950602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:31.951430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:31.952837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:31.953335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:31.953865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:31.964708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.965301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:31.966339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:31.968315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:32.005175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Getting quotas for project 3a625f99f9cd42e783fdc952f5995fc9. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:32.012846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Getting quotas for user e61a673861c34644892513f98458bf5b and project 3a625f99f9cd42e783fdc952f5995fc9. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:32.042457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:32.045281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:32.068860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:32.080538 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55be49f9-7def-485b-afff-cd274666b005 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.419593 Apr 02 20:54:32.081382 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 343/814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:31 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:32.093349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:32.094001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:32.106672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:32.108593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:32.110892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:32.111033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:32.167209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59049163-e4d1-4de0-8171-c2a7a9dd9fd7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.005101 Apr 02 20:54:32.169707 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 472/815] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:54:32.181542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-142858123", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "00eec1e6-85d8-4b64-8502-6cc338754735"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:32.295876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:32.495521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:32.515386 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34214e68-ef3b-4f3b-a574-4f2a1040e5f5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1472 microversion: 2.1 time: 0.431698 Apr 02 20:54:32.520872 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 344/816] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:32 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:32.532813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58302ece-c452-43cd-9d9c-78b3d99b458a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d5260550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:32.643837 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58302ece-c452-43cd-9d9c-78b3d99b458a tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.120939 Apr 02 20:54:32.652657 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 345/817] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:32 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:32.658674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bac10972-3fe1-4a21-a4c7-bbe03a48b4e1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:32.659249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bac10972-3fe1-4a21-a4c7-bbe03a48b4e1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:32.762286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac10972-3fe1-4a21-a4c7-bbe03a48b4e1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:32.774240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac10972-3fe1-4a21-a4c7-bbe03a48b4e1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:32.778437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac10972-3fe1-4a21-a4c7-bbe03a48b4e1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:32.780093 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bac10972-3fe1-4a21-a4c7-bbe03a48b4e1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1262 microversion: 2.26 time: 0.126565 Apr 02 20:54:32.782770 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 346/818] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:32 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1262 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:32.892559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:32.893798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:32.894802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:32.895573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:32.896411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:32.963406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:32.964156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:32.965679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:32.969276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.012255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:33.021172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:33.047919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Going to run 2 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:33.054635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:33.104991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:33.106020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:33.124856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.125595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.129116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.129932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.154614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136518) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 02 20:54:33.194334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:33.214561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:33.279390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:33.304762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:33.342779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=818956c7-a348-4c41-a48b-9c74b8ddbc66,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:33.491104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:33.501033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:33.509206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:33.522534 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52eeaf62-96f7-4a95-874e-6c1af8d8b823 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.421994 Apr 02 20:54:33.526451 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 347/819] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:33 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:33.556146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:33.557369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:33.571959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.572906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.573976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.574670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.621687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:33.637433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:33.723329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-656ec083-a30b-4403-b45c-653ef5dc2bfb tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.551812 Apr 02 20:54:33.723949 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 473/820] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:54:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1553 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 02 20:54:33.731128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d771673e-78c6-423f-a416-1a1b29429739 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4be0c10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:33.818999 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d771673e-78c6-423f-a416-1a1b29429739 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.093140 Apr 02 20:54:33.821279 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 474/821] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:33 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:33.836687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:33.849851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:33.853659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Searching by: {'deleted': False, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:33.862200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:33.872878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1540410-7d1f-4a77-b3de-a1cfb01ab3ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1472 microversion: 2.1 time: 0.340079 Apr 02 20:54:33.875387 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 348/822] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:33 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:33.881130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:33.882327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:33.899544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.903516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.904715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.917229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.920259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.922594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:33.923568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:33.924025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:34.046975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:54:34.104518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:34.115754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:34.119217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:34.119905 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-88d80159-deb0-4340-b457-8fe4bab865ab tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.297313 Apr 02 20:54:34.120850 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 475/823] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 20:54:33 2022] GET /compute/v2.1/servers => generated 1001 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:34.121090 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a8c27100-a48f-48b1-b26f-593a1de7a93b tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1314 microversion: 2.26 time: 0.243780 Apr 02 20:54:34.122090 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 349/824] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:33 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:34.155575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c4eb9ce-dd74-4139-b0f4-b3f0abdcb5da tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:34.156427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c4eb9ce-dd74-4139-b0f4-b3f0abdcb5da tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:34.240879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c4eb9ce-dd74-4139-b0f4-b3f0abdcb5da tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:34.250155 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c4eb9ce-dd74-4139-b0f4-b3f0abdcb5da tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1218 microversion: 2.1 time: 0.112914 Apr 02 20:54:34.250926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 476/825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:34 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:34.547664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:34.548625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:34.557125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:34.558180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:34.559174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:34.559627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:34.835926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f955b35b-c47e-4929-9d19-96655b0e7d68 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4d5d820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:34.875915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:34.890690 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c99a316e-8460-47e4-a3dd-79ec244baccf tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.351128 Apr 02 20:54:34.891830 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 350/826] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:34 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:34.897949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:34.905420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:34.915570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:34.916502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:34.917560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:34.918169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.037803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f955b35b-c47e-4929-9d19-96655b0e7d68 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1428 microversion: 2.1 time: 0.207698 Apr 02 20:54:35.040976 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 477/827] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:34 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1428 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:35.145283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:35.146060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:35.156402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.156883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.157691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.159590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.421788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:35.431375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:35.433364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:35.435312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:35.436828 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d6c6e07a-942f-4727-97d0-2651cb547336 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1320 microversion: 2.26 time: 0.298117 Apr 02 20:54:35.439102 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d27c003c-a614-44f0-a7f3-3789ad8daa81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1472 microversion: 2.1 time: 0.546063 Apr 02 20:54:35.446268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 478/828] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:35 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:35.451380 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 351/829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:34 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:35.457331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:35.458057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:35.465258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df9cf386-bafd-4967-8b89-99831c61cab1", "device": "/dev/xvdb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:35.467143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:35.473756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.474215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.474376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.474981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.475352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.476220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.476873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.477179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.557515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:35.565738 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-150b907e-2349-4468-ba1c-fc41ea3dda6c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1270 microversion: 2.1 time: 0.118121 Apr 02 20:54:35.566407 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 479/830] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:35 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:35.884167 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-260e0848-97d7-43a5-9175-4b9b2811037f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "POST /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431152 Apr 02 20:54:35.886273 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 352/831] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 20:54:35 2022] POST /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:35.909549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:35.916011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:35.929008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.929878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:35.931071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:35.932256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.054956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e30425e-0bac-4f50-b57a-6f4315ce5ecc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d52605e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:36.149638 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e30425e-0bac-4f50-b57a-6f4315ce5ecc tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1437 microversion: 2.1 time: 0.099460 Apr 02 20:54:36.150237 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 353/832] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:36 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:36.176424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8268d385-d1d8-4abf-b34e-96195da0ea64 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4d8fca0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:36.265473 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8268d385-d1d8-4abf-b34e-96195da0ea64 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 200 len: 1437 microversion: 2.1 time: 0.101869 Apr 02 20:54:36.268761 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 354/833] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:54:36 2022] GET /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:36.273665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-70efef10-6a05-490d-a42c-a0daecc79b34 req-39d7a3fa-bc30-494b-9894-ced2378f7b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef4400c-3d15-43a5-89f9-79edac5020ce", "name": "network-vif-plugged", "status": "completed", "tag": "d783c05e-b460-4890-8989-48914b4b5820"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:36.323197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-70efef10-6a05-490d-a42c-a0daecc79b34 req-39d7a3fa-bc30-494b-9894-ced2378f7b5d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.323999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-70efef10-6a05-490d-a42c-a0daecc79b34 req-39d7a3fa-bc30-494b-9894-ced2378f7b5d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.357523 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-70efef10-6a05-490d-a42c-a0daecc79b34 req-39d7a3fa-bc30-494b-9894-ced2378f7b5d service nova] Creating event network-vif-plugged:d783c05e-b460-4890-8989-48914b4b5820 for instance 6ef4400c-3d15-43a5-89f9-79edac5020ce on nch2-master-1 Apr 02 20:54:36.369870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-70efef10-6a05-490d-a42c-a0daecc79b34 req-39d7a3fa-bc30-494b-9894-ced2378f7b5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098359 Apr 02 20:54:36.371035 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 355/834] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:36.398795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:36.417091 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d1c25b1f-4d03-4e73-8d1c-d27cc6925dce tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.512435 Apr 02 20:54:36.418555 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 480/835] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:35 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:36.427403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:36.428146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:36.436149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.436705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.440943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.441405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.463389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:36.464126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:36.486388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.486895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.487822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.488269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.795627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:36.809181 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-daf50d8f-3bef-4fcf-9b3f-1ca4d486123c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.356507 Apr 02 20:54:36.811422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 481/836] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:36 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:36.818627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:36.819528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:36.826911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.827849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:36.829226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:36.829988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:37.087494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:37.097546 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c8fc43bc-0218-425b-8f7b-1f2364b4792f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1467 microversion: 2.1 time: 0.724738 Apr 02 20:54:37.100037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 356/837] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:36 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1467 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:37.105311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:37.106130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:37.117520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:37.118148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:37.119953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:37.120097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:37.120756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:37.131255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:37.135114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:37.138103 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e21b0ca7-e432-45a8-887c-300fc13f4813 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.325489 Apr 02 20:54:37.144101 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 482/838] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:36 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:37.149596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8a8c2bb-ed51-48b1-959c-6eb5d0592fce tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4b6e280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:37.683392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:37.693787 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3afc1117-7c75-4177-b0f1-9436eaa1e484 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.592467 Apr 02 20:54:37.694787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 357/839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:37 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:37.701810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:37.702747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:37.710488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:37.711182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:37.712416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:37.713704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:37.992954 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8a8c2bb-ed51-48b1-959c-6eb5d0592fce tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "DELETE /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a" status: 204 len: 0 microversion: 2.1 time: 0.847085 Apr 02 20:54:37.994133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 483/840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:37 2022] DELETE /compute/v2.1/images/873071dd-c1a1-48b6-ac4b-e0101393416a => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:54:38.001052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:38.002014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:38.010518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.011238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.013897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.015087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.081433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:38.093050 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d41bb264-21dd-4082-acca-463f2c6256fd tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1370 microversion: 2.1 time: 0.392954 Apr 02 20:54:38.095102 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 358/841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:37 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:38.105110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08ad66ff-5457-4c97-a377-e5a50a3ce127 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '.version_select at 0x7f54d4d3fdc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:38.150522 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-08ad66ff-5457-4c97-a377-e5a50a3ce127 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] HTTP exception thrown: Image not found. Apr 02 20:54:38.151342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08ad66ff-5457-4c97-a377-e5a50a3ce127 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:38.152177 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08ad66ff-5457-4c97-a377-e5a50a3ce127 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "DELETE /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d" status: 404 len: 62 microversion: 2.1 time: 0.055417 Apr 02 20:54:38.156307 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 359/842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:38 2022] DELETE /compute/v2.1/images/85648e88-87b2-49e8-89e7-6a791e4d099d => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:54:38.161956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:38.162667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:38.170681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.171366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.172720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.173710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.207155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:54:38.370341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:38.378451 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49e91b8f-ce17-4bf5-ae0b-d0e840f1c5f8 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "DELETE /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 204 len: 0 microversion: 2.1 time: 0.219217 Apr 02 20:54:38.379697 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9153c646-fc5f-48ce-baec-dc3ab14a2f22 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.384210 Apr 02 20:54:38.383540 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 360/843] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:54:38 2022] DELETE /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:54:38.389474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:38.389794 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 484/844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:37 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:38.390412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:38.397325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8e0ddb17-d6bd-4a4b-a6a0-b58d23b28f66 req-a92ccbfa-09dc-47e6-8208-056fd23851a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47053086-045c-4cb8-a0ec-71f140b733c6", "tag": "b73e317b-4538-4a13-9497-eb28e80e06ff"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:38.397512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.397983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.398769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.399210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.408232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8e0ddb17-d6bd-4a4b-a6a0-b58d23b28f66 req-a92ccbfa-09dc-47e6-8208-056fd23851a3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.409548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8e0ddb17-d6bd-4a4b-a6a0-b58d23b28f66 req-a92ccbfa-09dc-47e6-8208-056fd23851a3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.422782 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8e0ddb17-d6bd-4a4b-a6a0-b58d23b28f66 req-a92ccbfa-09dc-47e6-8208-056fd23851a3 service nova] Creating event network-changed:b73e317b-4538-4a13-9497-eb28e80e06ff for instance 47053086-045c-4cb8-a0ec-71f140b733c6 on nch1-master-1 Apr 02 20:54:38.429115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8e0ddb17-d6bd-4a4b-a6a0-b58d23b28f66 req-a92ccbfa-09dc-47e6-8208-056fd23851a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036396 Apr 02 20:54:38.430397 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 485/845] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:38.435958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:38.437044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:38.454017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.454640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.456591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.458266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.731234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:38.742017 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11affece-3464-4f2c-9ac7-f9a3a22ab31c tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1473 microversion: 2.1 time: 0.310171 Apr 02 20:54:38.742945 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 486/846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:38 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1473 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:38.747678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:38.748288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:38.755482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.756165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.757185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.757789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.778651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:38.791995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:38.793540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:38.796879 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2195b612-3bb7-4ce2-a8f9-335c1cdcb03d tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.411612 Apr 02 20:54:38.800078 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 361/847] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:38 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:38.817930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a6ad3683-e923-4045-9d99-303cbb5525e8 req-c6dc0bbd-34a6-402d-b628-5e7d941dc264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7234847-6a5b-4386-8d22-448be13057dd", "tag": "5bc77ddd-a95f-43ce-8434-61e980388e81"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:38.827632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a6ad3683-e923-4045-9d99-303cbb5525e8 req-c6dc0bbd-34a6-402d-b628-5e7d941dc264 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:38.828405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a6ad3683-e923-4045-9d99-303cbb5525e8 req-c6dc0bbd-34a6-402d-b628-5e7d941dc264 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:38.856235 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a6ad3683-e923-4045-9d99-303cbb5525e8 req-c6dc0bbd-34a6-402d-b628-5e7d941dc264 service nova] Creating event network-changed:5bc77ddd-a95f-43ce-8434-61e980388e81 for instance a7234847-6a5b-4386-8d22-448be13057dd on nch2-master-1 Apr 02 20:54:38.874506 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a6ad3683-e923-4045-9d99-303cbb5525e8 req-c6dc0bbd-34a6-402d-b628-5e7d941dc264 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072783 Apr 02 20:54:38.875483 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 362/848] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:39.071439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:39.081445 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e55434c3-5705-42a1-915b-ac3102d2b69c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.337249 Apr 02 20:54:39.092339 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 487/849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:38 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:39.114819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:39.116232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:39.125705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.126358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.127940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.128652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.158325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-141a5af0-be4d-4f36-ba60-1fdd1e2fdba6 req-4f5cc124-4184-4e6f-bea2-477e00ecffe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "name": "network-vif-unplugged", "status": "completed", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:39.171591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-141a5af0-be4d-4f36-ba60-1fdd1e2fdba6 req-4f5cc124-4184-4e6f-bea2-477e00ecffe0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.172694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-141a5af0-be4d-4f36-ba60-1fdd1e2fdba6 req-4f5cc124-4184-4e6f-bea2-477e00ecffe0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.201960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-141a5af0-be4d-4f36-ba60-1fdd1e2fdba6 req-4f5cc124-4184-4e6f-bea2-477e00ecffe0 service nova] Creating event network-vif-unplugged:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:54:39.207720 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-141a5af0-be4d-4f36-ba60-1fdd1e2fdba6 req-4f5cc124-4184-4e6f-bea2-477e00ecffe0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054101 Apr 02 20:54:39.208889 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 488/850] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:39.399474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:39.400313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:39.406823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.407331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.408102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.409144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.540783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:39.549575 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dfd82627-9ae2-41b9-907c-36c2e9656c6c tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1556 microversion: 2.1 time: 0.441355 Apr 02 20:54:39.562093 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 363/851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:39 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1556 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:39.567577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:39.568282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:39.574856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.575479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.576480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.577088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.666237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:39.676320 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f16eef09-c420-4a47-8ef5-bf9c055ebebf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.283682 Apr 02 20:54:39.677808 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 489/852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:39 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:39.762401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:39.763159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:39.770380 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a0dab544-1d62-43bf-b051-26c8a6c5d8c1 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206498 Apr 02 20:54:39.771211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 364/853] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 20:54:39 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:39.772120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.772614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.773404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.773935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.815865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:39.816610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:39.822815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.823466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:39.824236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:39.824717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:40.196053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:40.198971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:40.204176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:40.206360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:40.207506 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acff9ab2-3868-41a1-a7a2-4b4dc7a5715f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.395994 Apr 02 20:54:40.209996 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5523e9cb-3791-4652-86bf-a917d454b802 tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1473 microversion: 2.1 time: 0.451968 Apr 02 20:54:40.211137 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 490/854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:39 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:40.214908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 365/855] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:39 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:40.219723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:40.220978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:40.229589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:40.230590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:40.231612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:40.232268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:40.455576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b7e158ff-abd7-4feb-ab67-fd16c89380ef req-6e408dd4-b772-488d-a96c-26a54191901f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818956c7-a348-4c41-a48b-9c74b8ddbc66", "tag": "70579e43-efe8-4449-87ed-602a9094f229"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:40.463924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b7e158ff-abd7-4feb-ab67-fd16c89380ef req-6e408dd4-b772-488d-a96c-26a54191901f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:40.464381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b7e158ff-abd7-4feb-ab67-fd16c89380ef req-6e408dd4-b772-488d-a96c-26a54191901f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:40.479143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b7e158ff-abd7-4feb-ab67-fd16c89380ef req-6e408dd4-b772-488d-a96c-26a54191901f service nova] Creating event network-changed:70579e43-efe8-4449-87ed-602a9094f229 for instance 818956c7-a348-4c41-a48b-9c74b8ddbc66 on nch2-master-1 Apr 02 20:54:40.484202 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b7e158ff-abd7-4feb-ab67-fd16c89380ef req-6e408dd4-b772-488d-a96c-26a54191901f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032216 Apr 02 20:54:40.484949 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 366/856] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:40.694202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:40.695192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:40.702850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:40.703846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:40.704908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:40.706131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:40.954341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:40.971944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-53868b16-2237-43b6-9974-09d8a22308b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.759300 Apr 02 20:54:40.972633 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 491/857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:40 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:41.136958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:41.146023 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-768eaacf-a84a-472f-9512-b78e4953574a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.455994 Apr 02 20:54:41.146946 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 367/858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:40 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:41.228931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:41.230237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:41.231212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:41.232261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:41.238606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.240538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.241006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.241791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.242387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.243420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.244736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.245431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.485004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '481d41af70a54782ad2d569d058d6fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee534be172494c1b842d8749d1dfe969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:41.493520 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3af87492-3031-4ca6-bef3-d0bbb550e26f tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 200 len: 1473 microversion: 2.1 time: 0.270213 Apr 02 20:54:41.494192 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 492/859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:41 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 1473 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:41.498955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:41.499636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:41.506082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.506638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.507492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.508054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.604041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:41.613958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:41.615573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:41.617151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d97fb4a-85f3-449d-9fe4-187643e4c0f0 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.389965 Apr 02 20:54:41.626380 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 368/860] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:41 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:41.696437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-cb0287cf-b271-4d11-83c1-cc19255acd97 req-f6c51bcd-55fb-4bf6-a283-552691d09219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef4400c-3d15-43a5-89f9-79edac5020ce", "tag": "d783c05e-b460-4890-8989-48914b4b5820"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:41.709442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cb0287cf-b271-4d11-83c1-cc19255acd97 req-f6c51bcd-55fb-4bf6-a283-552691d09219 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.709988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cb0287cf-b271-4d11-83c1-cc19255acd97 req-f6c51bcd-55fb-4bf6-a283-552691d09219 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.724729 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-cb0287cf-b271-4d11-83c1-cc19255acd97 req-f6c51bcd-55fb-4bf6-a283-552691d09219 service nova] Creating event network-changed:d783c05e-b460-4890-8989-48914b4b5820 for instance 6ef4400c-3d15-43a5-89f9-79edac5020ce on nch2-master-1 Apr 02 20:54:41.725610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f384c536-613b-4b9a-a34b-2a30434787ef tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1691 microversion: 2.1 time: 0.230098 Apr 02 20:54:41.726210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 493/861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:41 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:41.739802 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-cb0287cf-b271-4d11-83c1-cc19255acd97 req-f6c51bcd-55fb-4bf6-a283-552691d09219 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047687 Apr 02 20:54:41.741531 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 369/862] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:41.745492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:41.746964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:41.753511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.753972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.754763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:41.755211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:41.788053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lazy-loading 'flavor' on Instance uuid b118f37c-0f35-46b9-81d4-a4c7f161dd5a {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:41.807403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Going to try to live migrate instance to nch1-master-1 {{(pid=136518) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:54:41.991822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:41.992573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:42.004896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.005347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.009370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.010004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.390169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:42.404120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6d660ff4-08c0-4457-a282-3801b85c1c7c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.417792 Apr 02 20:54:42.415778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 370/863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:41 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:42.421421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:42.422087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:42.430915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.431384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.432170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.432702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.635638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:42.643785 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e14a536-38fd-4914-9895-de1051193b54 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.226483 Apr 02 20:54:42.644695 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 371/864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:42 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:42.659826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:42.660601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] [instance: 35b99e55-492a-476a-b17a-9a634f11e99d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:42.669883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.670345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.671681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.672128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.689105 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] HTTP exception thrown: Instance 35b99e55-492a-476a-b17a-9a634f11e99d could not be found. Apr 02 20:54:42.689903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] Returning 404 to user: Instance 35b99e55-492a-476a-b17a-9a634f11e99d could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:42.690764 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4af6d9eb-58e9-40cd-9bb3-7082e078a3dd tempest-ImagesOneServerTestJSON-1925867555 tempest-ImagesOneServerTestJSON-1925867555-project] 10.222.0.18 "GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d" status: 404 len: 111 microversion: 2.1 time: 0.044707 Apr 02 20:54:42.691333 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 372/865] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:42 2022] GET /compute/v2.1/servers/35b99e55-492a-476a-b17a-9a634f11e99d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:42.696027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-85ae4957-bb83-407e-9da7-43b76e9531be req-6db2ab12-747d-45b4-adb8-cb201f6b09b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35b99e55-492a-476a-b17a-9a634f11e99d", "name": "network-vif-deleted", "tag": "63bb602f-5c79-43d0-b981-f61c7d0d8c28"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:42.704255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-85ae4957-bb83-407e-9da7-43b76e9531be req-6db2ab12-747d-45b4-adb8-cb201f6b09b0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.704757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-85ae4957-bb83-407e-9da7-43b76e9531be req-6db2ab12-747d-45b4-adb8-cb201f6b09b0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.718420 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-85ae4957-bb83-407e-9da7-43b76e9531be req-6db2ab12-747d-45b4-adb8-cb201f6b09b0 service nova] Creating event network-vif-deleted:63bb602f-5c79-43d0-b981-f61c7d0d8c28 for instance 35b99e55-492a-476a-b17a-9a634f11e99d on nch1-master-1 Apr 02 20:54:42.724228 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-85ae4957-bb83-407e-9da7-43b76e9531be req-6db2ab12-747d-45b4-adb8-cb201f6b09b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031506 Apr 02 20:54:42.728481 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 373/866] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:42.733654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:42.734359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:42.742327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.742794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.743873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:42.744017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:42.932692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:42.941574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:42.942971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:42.944123 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d98d8c1d-44b5-4b36-9821-c9ca680ce153 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.214506 Apr 02 20:54:42.946509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 374/867] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:42 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:43.279191 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/action" status: 202 len: 0 microversion: 2.1 time: 1.534309 Apr 02 20:54:43.279880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 494/868] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:54:41 2022] POST /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/action => generated 0 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:43.301787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:43.304857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:43.322589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.322916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.323787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.324150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.424691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:43.425624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:43.455033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.455706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.456848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.457232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.573111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:43.582457 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c05fe5cc-8a13-42c8-98e5-908dc8fd1e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.296032 Apr 02 20:54:43.592526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 375/869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:43 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:43.622835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:43.631441 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de2b8532-a746-4a61-9057-ab66f803d0a6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.212834 Apr 02 20:54:43.633461 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 495/870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:43 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:43.662004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:43.663227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:43.673243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.674428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.675707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.677857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.932158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:43.940059 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ff55b70-f308-4270-bad2-341ba6619a66 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.283041 Apr 02 20:54:43.948612 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 376/871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:43 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:43.963896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:43.964777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:43.972754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.973253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:43.974989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:43.975867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:44.136849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:44.150860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:44.154079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:44.156348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86779f11-c832-412f-b277-143abfd4967a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.196318 Apr 02 20:54:44.167987 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 496/872] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:43 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:44.600222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:44.602278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:44.617624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:44.618736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:44.619830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:44.620873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:44.650726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:44.651965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:44.658718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:44.659377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:44.660664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:44.661265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:44.820584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:44.828770 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07227a2f-e8fc-48e6-98bf-a88df3f00d44 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.182875 Apr 02 20:54:44.831437 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 497/873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:44 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:44.905637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:44.919240 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-128b878b-d927-4386-9b78-08686360cb99 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.323797 Apr 02 20:54:44.930983 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 377/874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:44 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:44.958805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:44.959427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:44.972742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:44.973417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:44.974678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:44.975288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:45.138104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:45.147968 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-892c09bb-2dbe-46ed-80a9-40dee7c501ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.193410 Apr 02 20:54:45.149104 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 498/875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:44 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:45.183087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:45.184982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:45.195103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:45.195833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:45.196872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:45.197717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:45.320850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a492230c-8977-41f7-8615-6947d3ac7ddd tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4b6e040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1418416725", "description": "tempest-description-107328389"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:45.403618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:45.415521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:45.417592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:45.420470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb22a514-5fda-401d-b187-289957dd3f0a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.247066 Apr 02 20:54:45.422093 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 378/876] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:45 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:45.509216 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a492230c-8977-41f7-8615-6947d3ac7ddd tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.329183 Apr 02 20:54:45.517091 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 499/877] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:45.524488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f4c5290-a2e7-4b93-9fe7-ebc2c1165691 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4d8f1f0>, body: {"security_group_rule": {"parent_group_id": "3c9a175f-f7d2-4738-9110-dbb6b59dec42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:45.587763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-65651dd6-0dd8-4441-86c8-5133882319d0 req-8509a0a5-ba77-4f67-92b2-8d4e94dbdacf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47053086-045c-4cb8-a0ec-71f140b733c6", "name": "network-vif-plugged", "status": "completed", "tag": "b73e317b-4538-4a13-9497-eb28e80e06ff"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:45.598508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-65651dd6-0dd8-4441-86c8-5133882319d0 req-8509a0a5-ba77-4f67-92b2-8d4e94dbdacf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:45.598996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-65651dd6-0dd8-4441-86c8-5133882319d0 req-8509a0a5-ba77-4f67-92b2-8d4e94dbdacf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:45.610837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-65651dd6-0dd8-4441-86c8-5133882319d0 req-8509a0a5-ba77-4f67-92b2-8d4e94dbdacf service nova] Creating event network-vif-plugged:b73e317b-4538-4a13-9497-eb28e80e06ff for instance 47053086-045c-4cb8-a0ec-71f140b733c6 on nch1-master-1 Apr 02 20:54:45.618066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-65651dd6-0dd8-4441-86c8-5133882319d0 req-8509a0a5-ba77-4f67-92b2-8d4e94dbdacf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Apr 02 20:54:45.618866 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 500/878] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:45.741022 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f4c5290-a2e7-4b93-9fe7-ebc2c1165691 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.221852 Apr 02 20:54:45.742076 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 379/879] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 20:54:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:45.754223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d25e9135-5c65-4bb2-8125-0030219d5b72 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4a94e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1036399466", "description": "tempest-description-1111003295"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:45.847827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:45.848508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:45.854636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:45.855169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:45.855940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:45.856392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:45.895818 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d25e9135-5c65-4bb2-8125-0030219d5b72 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.146161 Apr 02 20:54:45.896534 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 501/880] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:45 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:45.908875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc5c49ce-9a82-47fa-90e5-819da064360a tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4a945e0>, body: {"security_group_rule": {"parent_group_id": "c02e59cd-7113-42ef-ad16-9d33449d8e63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:46.009517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:46.018115 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7796ea41-2a14-4440-a81a-92e251c0c30f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.174142 Apr 02 20:54:46.018693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 380/881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:45 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:46.023338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:46.024147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:46.034011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:46.034469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:46.035632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:46.036262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:46.096207 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc5c49ce-9a82-47fa-90e5-819da064360a tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.190939 Apr 02 20:54:46.097099 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 502/882] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 20:54:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:46.110063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-711029ee-a5ca-4720-a049-bf60f7d9c50b tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4a880d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2022230975", "description": "tempest-description-61845517"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:46.195505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:46.206791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a7a1737-1f18-4ecf-97ce-d79f6823dba9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.186805 Apr 02 20:54:46.214264 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 381/883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:46 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:46.214264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:46.214264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:46.219257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:46.219729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:46.220573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:46.221086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:46.280686 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-711029ee-a5ca-4720-a049-bf60f7d9c50b tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.174938 Apr 02 20:54:46.281316 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 503/884] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:46.293486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18e0f7e4-09d5-4fab-9d90-e2306a34f5fd tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4aadb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1125298193", "description": "tempest-description-283279634"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:46.375558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:46.386329 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f1be288-f5a6-4fb9-99bf-05eb4bf85d7b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.177397 Apr 02 20:54:46.397438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 382/885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:46 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:46.443002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:46.443656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:46.451050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:46.451435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:46.452358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:46.452900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:46.464555 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18e0f7e4-09d5-4fab-9d90-e2306a34f5fd tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.175591 Apr 02 20:54:46.465472 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 504/886] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:46.477154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5ddb8d82-60fa-40ed-9cb3-5f71af615922 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4a3b4c0>, body: {"security_group_rule": {"parent_group_id": "ccad9c79-69a7-4e68-a4de-c7dc8c72f855", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "49d47fe2-b33d-4d82-9f8c-c7a7a7d5e9a1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:46.598777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:46.606586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:46.608101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:46.609353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee70938b-bbdb-40cd-a58c-2e47ed152a3a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1362 microversion: 2.26 time: 0.172186 Apr 02 20:54:46.609993 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 383/887] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:46 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:46.726077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5ddb8d82-60fa-40ed-9cb3-5f71af615922 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.253339 Apr 02 20:54:46.726714 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 505/888] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 20:54:46 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:46.738736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78b33418-35e6-4bcd-81e5-e0933c32c4ff tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4d25a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1934807303", "description": "tempest-description-274702117"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:46.867089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78b33418-35e6-4bcd-81e5-e0933c32c4ff tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.132167 Apr 02 20:54:46.867728 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 384/889] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:46.879107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d1192c8-9757-4dad-a297-1d5550464efb tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4a943a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1429643240", "description": "tempest-description-425715108"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:47.014703 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d1192c8-9757-4dad-a297-1d5550464efb tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.139845 Apr 02 20:54:47.016023 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 506/890] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:47.027276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2b83b3a-618d-40cb-a222-d816cb7484f8 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4d25160>, body: {"security_group_rule": {"parent_group_id": "c89ccf72-49a8-4ee4-b86d-e39f9799707c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "27602f00-7a6e-46ea-9133-c7ec99ab5316"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:47.035189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.035923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:47.042699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.043186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.043965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.044410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.180769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:47.188422 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d241b122-713e-4c81-b9f3-001435b284aa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.157234 Apr 02 20:54:47.189018 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 507/891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:47 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:47.223081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.223703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:47.230474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.230945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.231859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.232367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.265548 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2b83b3a-618d-40cb-a222-d816cb7484f8 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.242145 Apr 02 20:54:47.266434 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 385/892] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 20:54:47 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:47.276935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8d0d01d-947d-4e0b-81ba-4fc4bf9f67e7 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4fdb0d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.384715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:47.394744 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-12262335-d024-4234-9ec0-872d86c744f9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.175409 Apr 02 20:54:47.395608 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 508/893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:47 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:47.404042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.404935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:47.411043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.411548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.412327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.412801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.500485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8d0d01d-947d-4e0b-81ba-4fc4bf9f67e7 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27602f00-7a6e-46ea-9133-c7ec99ab5316" status: 202 len: 0 microversion: 2.1 time: 0.227302 Apr 02 20:54:47.501613 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 386/894] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:47 2022] DELETE /compute/v2.1/os-security-groups/27602f00-7a6e-46ea-9133-c7ec99ab5316 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:54:47.510296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6c4ee28-b2db-44ea-be75-729113288dd7 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4d1d1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.561119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:47.570186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5e8516ad-d596-4e84-b489-2b8813748837 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.170354 Apr 02 20:54:47.571290 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 509/895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:47 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:47.579014 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6c4ee28-b2db-44ea-be75-729113288dd7 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/c89ccf72-49a8-4ee4-b86d-e39f9799707c" status: 200 len: 247 microversion: 2.1 time: 0.072724 Apr 02 20:54:47.579640 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 387/896] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:54:47 2022] GET /compute/v2.1/os-security-groups/c89ccf72-49a8-4ee4-b86d-e39f9799707c => generated 247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:47.591276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7f70992-f54c-4682-b500-13bb7a34aadc tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4ab8e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-716281307", "description": "tempest-description-1428218817"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:47.629320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.629954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:47.636308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.636837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.637628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.638075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.725391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7f70992-f54c-4682-b500-13bb7a34aadc tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.137852 Apr 02 20:54:47.727007 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 510/897] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 20:54:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:47.732133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2332d669-9b33-4837-91e3-c071a1de0fa8 req-6d1fa65b-7ab0-4be2-a07b-42a058ae2284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7234847-6a5b-4386-8d22-448be13057dd", "name": "network-vif-plugged", "status": "completed", "tag": "5bc77ddd-a95f-43ce-8434-61e980388e81"}, {"server_uuid": "818956c7-a348-4c41-a48b-9c74b8ddbc66", "name": "network-vif-plugged", "status": "completed", "tag": "70579e43-efe8-4449-87ed-602a9094f229"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:47.742855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2332d669-9b33-4837-91e3-c071a1de0fa8 req-6d1fa65b-7ab0-4be2-a07b-42a058ae2284 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.743345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2332d669-9b33-4837-91e3-c071a1de0fa8 req-6d1fa65b-7ab0-4be2-a07b-42a058ae2284 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.756115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2332d669-9b33-4837-91e3-c071a1de0fa8 req-6d1fa65b-7ab0-4be2-a07b-42a058ae2284 service nova] Creating event network-vif-plugged:5bc77ddd-a95f-43ce-8434-61e980388e81 for instance a7234847-6a5b-4386-8d22-448be13057dd on nch2-master-1 Apr 02 20:54:47.756746 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2332d669-9b33-4837-91e3-c071a1de0fa8 req-6d1fa65b-7ab0-4be2-a07b-42a058ae2284 service nova] Creating event network-vif-plugged:70579e43-efe8-4449-87ed-602a9094f229 for instance 818956c7-a348-4c41-a48b-9c74b8ddbc66 on nch2-master-1 Apr 02 20:54:47.763187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2332d669-9b33-4837-91e3-c071a1de0fa8 req-6d1fa65b-7ab0-4be2-a07b-42a058ae2284 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034754 Apr 02 20:54:47.764196 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 511/898] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:47.769366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a82c9bef-b7e2-4602-98e5-8c9445502a4a tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4bd3c10>, body: {"security_group_rule": {"parent_group_id": "6790b28d-6b70-44da-9ef5-2e8918ac5cb3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:47.780898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:47.792880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:47.794653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:47.796858 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-284d155c-5dcd-4ebc-b1ab-a041c8d3757c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1546 microversion: 2.26 time: 0.172085 Apr 02 20:54:47.809361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 388/899] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:47 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1546 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:54:47.817278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d7c940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.827043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.827611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.828169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:47.834999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.835463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.836245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.836718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.864526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.865243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.880767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.881926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:47.916994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:47.969145 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c782c1f3-f05d-41a4-8047-da1ec3c7e379 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-738225247" status: 201 len: 0 microversion: 2.26 time: 0.155561 Apr 02 20:54:47.969935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 389/900] 10.222.0.18 () {62 vars in 1376 bytes} [Sat Apr 2 20:54:47 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-738225247 => generated 0 bytes in 157 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Apr 02 20:54:47.982460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f7e6878-53cb-4d2c-a4d9-7ac2af2db559 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d1d0d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:47.992086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f7e6878-53cb-4d2c-a4d9-7ac2af2db559 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:47.992606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f7e6878-53cb-4d2c-a4d9-7ac2af2db559 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.004508 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f7e6878-53cb-4d2c-a4d9-7ac2af2db559 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-738225247" status: 204 len: 0 microversion: 2.26 time: 0.028850 Apr 02 20:54:48.005085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 390/901] 10.222.0.18 () {60 vars in 1357 bytes} [Sat Apr 2 20:54:47 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-738225247 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 02 20:54:48.015883 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a82c9bef-b7e2-4602-98e5-8c9445502a4a tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.250224 Apr 02 20:54:48.016518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 512/902] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 20:54:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:48.019165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d1d160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.027166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56d0dd68-0015-4550-9895-5d0861df6842 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Action: 'create', calling method: .version_select at 0x7f54d4ab8670>, body: {"security_group_rule": {"parent_group_id": "6790b28d-6b70-44da-9ef5-2e8918ac5cb3", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:48.029933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.030394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.030925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.038123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.038577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.039345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.039927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.061118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.061571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.077308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:48.092553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3287d8f-8cb3-43e2-bef4-59969f020807 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 204 len: 0 microversion: 2.26 time: 0.078685 Apr 02 20:54:48.093167 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 391/903] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:54:48.103431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e99eee17-695d-4481-8b01-cac35a86f90e tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d25280>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.110666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e99eee17-695d-4481-8b01-cac35a86f90e tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.111164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e99eee17-695d-4481-8b01-cac35a86f90e tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.119485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e99eee17-695d-4481-8b01-cac35a86f90e tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 200 len: 12 microversion: 2.26 time: 0.020132 Apr 02 20:54:48.120075 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 392/904] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 12 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:48.129193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d1df70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.136540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.136997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.137472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.143156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.143614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.144371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.144837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.169345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.169807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.178830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.179287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.201000 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56d0dd68-0015-4550-9895-5d0861df6842 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.175866 Apr 02 20:54:48.201978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 513/905] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 20:54:48 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:48.206352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:48.208604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.209512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.217957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.218443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.219224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.219664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.222774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7d52970-5286-470e-b8d4-0b615b91fd65 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-127489426" status: 201 len: 0 microversion: 2.26 time: 0.097340 Apr 02 20:54:48.223430 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 393/906] 10.222.0.18 () {62 vars in 1376 bytes} [Sat Apr 2 20:54:48 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-127489426 => generated 0 bytes in 99 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Apr 02 20:54:48.227887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3bdfc07-263b-410a-bf40-93b1020069f1 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4d3f040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.275758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3bdfc07-263b-410a-bf40-93b1020069f1 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/6790b28d-6b70-44da-9ef5-2e8918ac5cb3" status: 200 len: 664 microversion: 2.1 time: 0.051231 Apr 02 20:54:48.276567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 394/907] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/os-security-groups/6790b28d-6b70-44da-9ef5-2e8918ac5cb3 => generated 664 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:48.281406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1f44033a-7a26-4a06-b000-27584dd1f986 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d1ddc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.289597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f44033a-7a26-4a06-b000-27584dd1f986 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.290056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f44033a-7a26-4a06-b000-27584dd1f986 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.303127 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1f44033a-7a26-4a06-b000-27584dd1f986 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 200 len: 35 microversion: 2.26 time: 0.025508 Apr 02 20:54:48.304027 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 395/908] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 35 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:48.308769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c8bfdfa-7825-4576-bfcf-118e905fcfcd tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4d7c8b0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.368154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:48.375480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae9e6b56-cf7a-4c6d-bc4b-5cf070c37ee3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.172497 Apr 02 20:54:48.376049 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 514/909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:48.383732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4a94310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.391219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.391676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.392153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.398198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.398660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.399426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.399874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.421419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.421879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.453571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:48.459433 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c8bfdfa-7825-4576-bfcf-118e905fcfcd tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/4ecbc2d4-5b30-472c-a00e-df22fd86f926" status: 202 len: 0 microversion: 2.1 time: 0.154308 Apr 02 20:54:48.460026 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 396/910] 10.222.0.18 () {58 vars in 1286 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/os-security-group-rules/4ecbc2d4-5b30-472c-a00e-df22fd86f926 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:48.468667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.469273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.476150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.476664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.477879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.478350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.508230 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4999bbd4-6e16-49e0-8d8f-ffb8d8c5f1f5 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-127489426" status: 204 len: 0 microversion: 2.26 time: 0.131089 Apr 02 20:54:48.508864 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 515/911] 10.222.0.18 () {60 vars in 1360 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-127489426 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:54:48.515311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85b8524c-ccf7-4ac0-89ea-8d6333a74130 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4ad8310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.617437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:48.625328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f795baf1-31a8-4e7c-89be-eb8df82682ea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.160536 Apr 02 20:54:48.625902 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 397/912] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:48.631073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f7213950-44f2-45d6-b09a-e1fb027ca585 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d5385550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.638087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7213950-44f2-45d6-b09a-e1fb027ca585 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.638542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7213950-44f2-45d6-b09a-e1fb027ca585 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.647565 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f7213950-44f2-45d6-b09a-e1fb027ca585 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 200 len: 12 microversion: 2.26 time: 0.020696 Apr 02 20:54:48.652607 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 398/913] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 12 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:48.652607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.653168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.658729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.659171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.659944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.660385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.690566 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85b8524c-ccf7-4ac0-89ea-8d6333a74130 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/6790b28d-6b70-44da-9ef5-2e8918ac5cb3" status: 202 len: 0 microversion: 2.1 time: 0.180604 Apr 02 20:54:48.694415 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 516/914] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/os-security-groups/6790b28d-6b70-44da-9ef5-2e8918ac5cb3 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:48.700198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4a94ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.710352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.710868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.711297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.717315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.717768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.718557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.719021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.745096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.745591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.758636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:48.775613 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5667ea24-cb8b-4d55-909b-9f2114c08969 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 204 len: 0 microversion: 2.26 time: 0.079891 Apr 02 20:54:48.776223 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 517/915] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:54:48.781020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fdeca226-f1cb-4d7f-a258-3acfb5f5736e tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4ad8ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.802627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-fdeca226-f1cb-4d7f-a258-3acfb5f5736e tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27602f00-7a6e-46ea-9133-c7ec99ab5316 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:54:48.803236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-fdeca226-f1cb-4d7f-a258-3acfb5f5736e tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Neutron security group 27602f00-7a6e-46ea-9133-c7ec99ab5316 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 20:54:48.803597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:48.803752 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-fdeca226-f1cb-4d7f-a258-3acfb5f5736e tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] HTTP exception thrown: Security group 27602f00-7a6e-46ea-9133-c7ec99ab5316 does not exist Apr 02 20:54:48.803752 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-901456b9-ce27-439c-88a0-1fcfb368ea55'] Apr 02 20:54:48.804341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fdeca226-f1cb-4d7f-a258-3acfb5f5736e tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Returning 404 to user: Security group 27602f00-7a6e-46ea-9133-c7ec99ab5316 does not exist Apr 02 20:54:48.804341 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-901456b9-ce27-439c-88a0-1fcfb368ea55'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:48.805258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fdeca226-f1cb-4d7f-a258-3acfb5f5736e tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/27602f00-7a6e-46ea-9133-c7ec99ab5316" status: 404 len: 194 microversion: 2.1 time: 0.027841 Apr 02 20:54:48.805893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 518/916] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/os-security-groups/27602f00-7a6e-46ea-9133-c7ec99ab5316 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:48.810765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4a885e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.811963 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6139daff-8ee0-4ae0-a9d6-b99659d6be96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.162748 Apr 02 20:54:48.812859 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 399/917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:48 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:48.818835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-344db317-7371-48b2-aad7-042302e8fee1 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4d7cf70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.820344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.820826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.821337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.826601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.827053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.827813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.828253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.850678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.851131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.859666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.860130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.884994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:48.899960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61039b83-e344-4c48-b804-ce2e23942dea tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-205847844" status: 201 len: 0 microversion: 2.26 time: 0.093045 Apr 02 20:54:48.900637 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 519/918] 10.222.0.18 () {62 vars in 1376 bytes} [Sat Apr 2 20:54:48 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-205847844 => generated 0 bytes in 94 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Apr 02 20:54:48.909964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4a940d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:48.919862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.920619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.921110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:48.927503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.927957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.928787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.929225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.953330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.953826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.962487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:48.962942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:48.985445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.000870 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95c9027b-b510-4764-8b59-78eeb8604671 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-2042803708" status: 201 len: 0 microversion: 2.26 time: 0.094623 Apr 02 20:54:49.001787 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 520/919] 10.222.0.18 () {62 vars in 1379 bytes} [Sat Apr 2 20:54:48 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-2042803708 => generated 0 bytes in 96 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Apr 02 20:54:49.002584 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-344db317-7371-48b2-aad7-042302e8fee1 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c89ccf72-49a8-4ee4-b86d-e39f9799707c" status: 202 len: 0 microversion: 2.1 time: 0.188126 Apr 02 20:54:49.006213 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 400/920] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:48 2022] DELETE /compute/v2.1/os-security-groups/c89ccf72-49a8-4ee4-b86d-e39f9799707c => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:49.011535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4cb49d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.012070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abf5cbcb-3ec6-40ec-9da7-816320d2b727 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4a88430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.026923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.027387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.028061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.034079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.034773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.035844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.036293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.070550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.071015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.085840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.102561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd48a2a6-1fe1-423f-9945-ab3c959f538a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 204 len: 0 microversion: 2.26 time: 0.094949 Apr 02 20:54:49.103266 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 401/921] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:54:49.112354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89586bb8-2c9c-4d67-8ebe-555cf338b6c1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d3faf0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.119777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89586bb8-2c9c-4d67-8ebe-555cf338b6c1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.120230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89586bb8-2c9c-4d67-8ebe-555cf338b6c1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.129401 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89586bb8-2c9c-4d67-8ebe-555cf338b6c1 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 200 len: 12 microversion: 2.26 time: 0.021540 Apr 02 20:54:49.129989 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 402/922] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:54:49 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:49.139372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d259d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.146872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.147321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.147794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.153319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.153766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.154545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.154991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.176663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.177115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.187076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.203766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61470b21-65bf-468a-927a-a6ffe21e97e4 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 204 len: 0 microversion: 2.26 time: 0.067672 Apr 02 20:54:49.204393 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 403/923] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 02 20:54:49.209793 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abf5cbcb-3ec6-40ec-9da7-816320d2b727 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/49d47fe2-b33d-4d82-9f8c-c7a7a7d5e9a1" status: 202 len: 0 microversion: 2.1 time: 0.202111 Apr 02 20:54:49.210353 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 521/924] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/os-security-groups/49d47fe2-b33d-4d82-9f8c-c7a7a7d5e9a1 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:54:49.218429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4d7c820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.219620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2721aca8-f7a9-46c1-89f6-091de1040fbc tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4a88ee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.227885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.228416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.229299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.237221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.237804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.238664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.239180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.262375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.262867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.271309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.271802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.294632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.309744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39ec0021-90b3-4246-ab62-02742654c7ad tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-1396552707" status: 201 len: 0 microversion: 2.26 time: 0.099028 Apr 02 20:54:49.315005 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 404/925] 10.222.0.18 () {62 vars in 1379 bytes} [Sat Apr 2 20:54:49 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-1396552707 => generated 0 bytes in 105 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 02 20:54:49.321161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4cb4310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.328983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.329448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.329967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.335241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.335676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.336434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.336909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.360141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.360635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.369929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.370385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.392594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.409111 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a58a4992-54ed-4b10-8b07-fad858d93c4f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-962590711" status: 201 len: 0 microversion: 2.26 time: 0.092736 Apr 02 20:54:49.409430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2721aca8-f7a9-46c1-89f6-091de1040fbc tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/ccad9c79-69a7-4e68-a4de-c7dc8c72f855" status: 202 len: 0 microversion: 2.1 time: 0.194132 Apr 02 20:54:49.409782 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 405/926] 10.222.0.18 () {62 vars in 1376 bytes} [Sat Apr 2 20:54:49 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags/tempest-tag-962590711 => generated 0 bytes in 94 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Apr 02 20:54:49.413989 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 522/927] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/os-security-groups/ccad9c79-69a7-4e68-a4de-c7dc8c72f855 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:49.419268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-74cbb96a-dff0-4610-b959-391afc05ddd6 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4a94d30>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.429816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.430997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.445514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.445982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.446889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.447347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.592794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:49.600716 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85635ffa-1743-42e2-b38e-a328820b5021 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1318 microversion: 2.1 time: 0.189824 Apr 02 20:54:49.601275 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 406/928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:49 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:49.606481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Action: 'update_all', calling method: .version_select at 0x7f54d4d25670>, body: {"tags": ["tempest-tag-649205718", "tempest-tag-1059415753"]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:49.614598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.615045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.615519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.621420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.621865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.622621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.623054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.627586 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-74cbb96a-dff0-4610-b959-391afc05ddd6 tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c02e59cd-7113-42ef-ad16-9d33449d8e63" status: 202 len: 0 microversion: 2.1 time: 0.212038 Apr 02 20:54:49.628170 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 523/929] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/os-security-groups/c02e59cd-7113-42ef-ad16-9d33449d8e63 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:54:49.636088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-44966822-7bff-4cd2-b6a6-a4fae781cbce tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] Calling method '.version_select at 0x7f54d4d5daf0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.647652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.648104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.669780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.685820 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b18c950-9927-4719-b1f0-c561f962f428 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 200 len: 61 microversion: 2.26 time: 0.083525 Apr 02 20:54:49.686741 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 407/930] 10.222.0.18 () {62 vars in 1311 bytes} [Sat Apr 2 20:54:49 2022] PUT /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 61 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:49.691716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.692609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.698974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.699435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.700247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.700721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.834791 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-44966822-7bff-4cd2-b6a6-a4fae781cbce tempest-SecurityGroupRulesTestJSON-1074319922 tempest-SecurityGroupRulesTestJSON-1074319922-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3c9a175f-f7d2-4738-9110-dbb6b59dec42" status: 202 len: 0 microversion: 2.1 time: 0.202219 Apr 02 20:54:49.835961 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 524/931] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/os-security-groups/3c9a175f-f7d2-4738-9110-dbb6b59dec42 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:54:49.844018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-efe832e6-0015-476a-b780-c943203bca8f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d49f71f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.860571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:49.868783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efe832e6-0015-476a-b780-c943203bca8f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.871963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efe832e6-0015-476a-b780-c943203bca8f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.872542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9191821-9e9a-4b2b-8c0b-8ca839ec1478 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.184307 Apr 02 20:54:49.873792 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 408/932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:49 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:49.884432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-efe832e6-0015-476a-b780-c943203bca8f tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 200 len: 61 microversion: 2.26 time: 0.046136 Apr 02 20:54:49.886931 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 525/933] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Apr 2 20:54:49 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 61 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:49.888147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.888803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.895588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.896166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.896596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '.version_select at 0x7f54d4a88700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.896989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.897436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.904002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.904435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.905178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.910937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.911510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.912309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.912924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.935238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.935716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.952137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lazy-loading 'flavor' on Instance uuid 47053086-045c-4cb8-a0ec-71f140b733c6 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:54:49.978556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02244c28-0634-4e46-957b-31436a3816ec tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags" status: 204 len: 0 microversion: 2.26 time: 0.087143 Apr 02 20:54:49.979274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 526/934] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:54:49.989823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:49.990586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:49.998158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.998616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:49.999462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:49.999907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.026369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:54:50.048567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:50.056856 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58ce0f04-bef0-419d-a248-4ac36f3e84eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.172532 Apr 02 20:54:50.057438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 409/935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:49 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:50.115373 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2db15dbb-0270-4b04-9037-30f6346b54f7 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 204 len: 0 microversion: 2.26 time: 0.129295 Apr 02 20:54:50.116782 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 527/936] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 20:54:49 2022] DELETE /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:54:50.125022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:50.125803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:50.134206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.135011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.136932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.137489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.465389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:50.473310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:50.474843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:50.476010 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5baccd52-4935-4b00-9fdd-4e6e7e6e721a tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1552 microversion: 2.26 time: 0.355549 Apr 02 20:54:50.476593 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 410/937] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:50 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1552 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:50.618790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:50.619489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:50.625796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.626244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.627803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.628245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.747863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-db707d00-acc6-43de-b52e-c31dabc5a207 req-773c20bc-fecd-4d02-855a-31a4bd8e0a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b118f37c-0f35-46b9-81d4-a4c7f161dd5a", "name": "network-vif-unplugged", "status": "completed", "tag": "621c3ce8-97a3-47b2-8fb2-3a484d590744"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:50.757225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-db707d00-acc6-43de-b52e-c31dabc5a207 req-773c20bc-fecd-4d02-855a-31a4bd8e0a92 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.758549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-db707d00-acc6-43de-b52e-c31dabc5a207 req-773c20bc-fecd-4d02-855a-31a4bd8e0a92 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.770277 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-db707d00-acc6-43de-b52e-c31dabc5a207 req-773c20bc-fecd-4d02-855a-31a4bd8e0a92 service nova] Creating event network-vif-unplugged:621c3ce8-97a3-47b2-8fb2-3a484d590744 for instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a on nch2-master-1 Apr 02 20:54:50.776017 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-db707d00-acc6-43de-b52e-c31dabc5a207 req-773c20bc-fecd-4d02-855a-31a4bd8e0a92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031542 Apr 02 20:54:50.777387 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 411/938] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:50.792063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:50.801519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e84a385d-521a-41f3-9ba7-e8dc12e03e33 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1467 microversion: 2.1 time: 0.186872 Apr 02 20:54:50.802377 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 528/939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:50 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1467 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:50.820177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:50.821051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:50.829358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.829358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.829358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.829358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.890793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:50.891443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:50.898768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.899226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:50.900006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:50.900448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.049073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.060349 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-804066d3-470c-4f30-827a-8da3cf8e5587 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 200 len: 1468 microversion: 2.1 time: 0.245113 Apr 02 20:54:51.072156 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 412/940] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:50 2022] GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 1468 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:51.077796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:51.078579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:51.086865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.087517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.088555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.089151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.159085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.172405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99f399dd-a64c-4975-8bab-f0a85e65e680 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.285059 Apr 02 20:54:51.182907 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 529/941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:50 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:51.190919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:51.196981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.198062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Searching by: {'reservation_id': 'r-7qgblj9r', 'deleted': False, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:51.203657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.204270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.205675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.206117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.316592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:54:51.401782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.409045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.409588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.582879 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0331894-cb89-4084-a9cd-ce839629a7ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-7qgblj9r" status: 200 len: 2928 microversion: 2.1 time: 0.398605 Apr 02 20:54:51.585226 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 530/942] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Apr 2 20:54:51 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7qgblj9r => generated 2928 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:51.591272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:51.592064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:51.602891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.603960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.604144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.605062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.606813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.614681 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0adc3d37-9861-49b9-9652-8c9f09071745 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.540912 Apr 02 20:54:51.625219 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 413/943] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:51 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:51.641014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08901817-6aee-4168-a973-a733f0aea971 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:51.686227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.server_groups [None req-08901817-6aee-4168-a973-a733f0aea971 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Querying cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) for 2 instances {{(pid=136517) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 02 20:54:51.689119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08901817-6aee-4168-a973-a733f0aea971 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.690350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08901817-6aee-4168-a973-a733f0aea971 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.722208 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08901817-6aee-4168-a973-a733f0aea971 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/00eec1e6-85d8-4b64-8502-6cc338754735" status: 200 len: 265 microversion: 2.1 time: 0.095594 Apr 02 20:54:51.723432 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 414/944] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:54:51 2022] GET /compute/v2.1/os-server-groups/00eec1e6-85d8-4b64-8502-6cc338754735 => generated 265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:51.734173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:51.742763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:51.749623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.750227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.754949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:51.755427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:51.812867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.824004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.825819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e61a673861c34644892513f98458bf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a625f99f9cd42e783fdc952f5995fc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:51.827114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-53f828ab-fd92-4507-97ed-39143fbf588c tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 200 len: 1552 microversion: 2.26 time: 0.240525 Apr 02 20:54:51.827114 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 531/945] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:51 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 1552 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:52.016970 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c888ef58-bb7d-4e24-8d9f-4e592435addc tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 200 len: 1619 microversion: 2.1 time: 0.286302 Apr 02 20:54:52.018539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 415/946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:51 2022] GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 1619 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:52.034144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:52.037774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:52.044017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.044761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.045554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.046162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.190948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:52.191762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:52.197820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.198402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.199278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.199938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.217350 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-627e6b2f-ee48-473d-a17d-e96519d0cfef tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 200 len: 1618 microversion: 2.1 time: 0.187455 Apr 02 20:54:52.228548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 532/947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:52 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 1618 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:52.240879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7c768b2-02cc-42bd-9445-3b0bfaf4e01e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: .version_select at 0x7f54d4a880d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-400796769", "policies": ["anti-affinity"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:52.259434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7c768b2-02cc-42bd-9445-3b0bfaf4e01e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:52.264053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7c768b2-02cc-42bd-9445-3b0bfaf4e01e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:52.325598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7c768b2-02cc-42bd-9445-3b0bfaf4e01e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:52.330791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7c768b2-02cc-42bd-9445-3b0bfaf4e01e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:52.344549 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7c768b2-02cc-42bd-9445-3b0bfaf4e01e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.107358 Apr 02 20:54:52.345239 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 533/948] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 20:54:52 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:54:52.467056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:52.483209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5862195c-8980-4ac9-b435-7b90cceffbf9 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.297318 Apr 02 20:54:52.484428 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 416/949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:52 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:52.506816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1896547774", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "5f064ad4-7f4a-4ec0-91c2-9cb77201bda0"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:52.570941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:52.636612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:52.638370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:52.648098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.649386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.650396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.651396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.847489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:52.849181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:52.849699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:52.850197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:52.851282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:52.875592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.877526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.878596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.879816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.901429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:52.907241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:52.913115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:52.921415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Going to run 2 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:52.924568 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c00b1f81-7b6d-480c-b341-4f0b9fe9cc10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.293641 Apr 02 20:54:52.924875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:52.925720 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 417/950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:52 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:52.930418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5ccf3d5f-b52b-41e4-b5a3-5b77b101cee0 req-c2442b1f-8b55-4021-8568-6359ed90fc95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b118f37c-0f35-46b9-81d4-a4c7f161dd5a", "tag": "621c3ce8-97a3-47b2-8fb2-3a484d590744"}, {"server_uuid": "47053086-045c-4cb8-a0ec-71f140b733c6", "name": "network-vif-deleted", "tag": "b73e317b-4538-4a13-9497-eb28e80e06ff"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:52.941454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5ccf3d5f-b52b-41e4-b5a3-5b77b101cee0 req-c2442b1f-8b55-4021-8568-6359ed90fc95 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.942591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5ccf3d5f-b52b-41e4-b5a3-5b77b101cee0 req-c2442b1f-8b55-4021-8568-6359ed90fc95 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.963783 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5ccf3d5f-b52b-41e4-b5a3-5b77b101cee0 req-c2442b1f-8b55-4021-8568-6359ed90fc95 service nova] Creating event network-changed:621c3ce8-97a3-47b2-8fb2-3a484d590744 for instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a on nch2-master-1 Apr 02 20:54:52.964305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5ccf3d5f-b52b-41e4-b5a3-5b77b101cee0 req-c2442b1f-8b55-4021-8568-6359ed90fc95 service nova] Creating event network-vif-deleted:b73e317b-4538-4a13-9497-eb28e80e06ff for instance 47053086-045c-4cb8-a0ec-71f140b733c6 on nch1-master-1 Apr 02 20:54:52.974089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5ccf3d5f-b52b-41e4-b5a3-5b77b101cee0 req-c2442b1f-8b55-4021-8568-6359ed90fc95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046479 Apr 02 20:54:52.974712 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 418/951] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:52.980657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:52.981362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] [instance: 47053086-045c-4cb8-a0ec-71f140b733c6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:52.990481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.991308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.992553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:52.993198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:52.997356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:53.004645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:53.011920 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] HTTP exception thrown: Instance 47053086-045c-4cb8-a0ec-71f140b733c6 could not be found. Apr 02 20:54:53.012770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] Returning 404 to user: Instance 47053086-045c-4cb8-a0ec-71f140b733c6 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:53.014019 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b5bc8b19-942a-4b67-9dbe-81f7bb8a5d91 tempest-ServerTagsTestJSON-1781366528 tempest-ServerTagsTestJSON-1781366528-project] 10.222.0.18 "GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6" status: 404 len: 111 microversion: 2.26 time: 0.037943 Apr 02 20:54:53.015461 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 419/952] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:52 2022] GET /compute/v2.1/servers/47053086-045c-4cb8-a0ec-71f140b733c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:54:53.071140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:53.078662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:53.096103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=dbcd800d-a825-4c87-a87a-abb91db1128e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:53.163932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:53.168993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:53.223056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:53.227795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'server_group_members'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:53.275439 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b498ec0f-cfa3-4d6d-b63c-966fa3f68ec9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.773274 Apr 02 20:54:53.278209 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 534/953] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:54:52 2022] POST /compute/v2.1/servers => generated 32 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 02 20:54:53.296726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.301092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:53.301756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Searching by: {'deleted': False, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:54:53.320939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:53.321545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:53.322363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:53.322804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:53.337306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90534233-a0af-44a2-9f29-5e60a5a4cdeb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Calling method '.version_select at 0x7f54d4d25700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.357330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:54:53.364827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-90534233-a0af-44a2-9f29-5e60a5a4cdeb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff8e9a6d-01a3-44f4-b61a-3de195fa26a3 does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:54:53.365689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-90534233-a0af-44a2-9f29-5e60a5a4cdeb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Neutron security group ff8e9a6d-01a3-44f4-b61a-3de195fa26a3 not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 20:54:53.366989 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-90534233-a0af-44a2-9f29-5e60a5a4cdeb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] HTTP exception thrown: Security group ff8e9a6d-01a3-44f4-b61a-3de195fa26a3 does not exist Apr 02 20:54:53.366989 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-0fb79108-868e-4375-b0e3-8cc79fa74075'] Apr 02 20:54:53.367949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90534233-a0af-44a2-9f29-5e60a5a4cdeb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Returning 404 to user: Security group ff8e9a6d-01a3-44f4-b61a-3de195fa26a3 does not exist Apr 02 20:54:53.367949 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-0fb79108-868e-4375-b0e3-8cc79fa74075'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:53.369766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-90534233-a0af-44a2-9f29-5e60a5a4cdeb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/ff8e9a6d-01a3-44f4-b61a-3de195fa26a3" status: 404 len: 194 microversion: 2.1 time: 0.185746 Apr 02 20:54:53.375236 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 420/954] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:53 2022] DELETE /compute/v2.1/os-security-groups/ff8e9a6d-01a3-44f4-b61a-3de195fa26a3 => generated 194 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:54:53.380473 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6581e138-7361-45ac-a5fa-95fa22b066f1 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004247 Apr 02 20:54:53.381125 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 421/955] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Apr 2 20:54:53 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 02 20:54:53.392100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e140608-af35-4ba6-9ff1-424f2c358e6c tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Calling method '.version_select at 0x7f54d4cb4940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.394795 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c186d0b2-9d40-47f7-85e6-ab92a7d307e4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.109782 Apr 02 20:54:53.401791 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 535/956] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 20:54:53 2022] GET /compute/v2.1/servers => generated 1663 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:53.407739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-156d17f3-5dbf-4273-bc99-22055e1789ef tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.408959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-156d17f3-5dbf-4273-bc99-22055e1789ef tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:53.507583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-156d17f3-5dbf-4273-bc99-22055e1789ef tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:53.522763 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-156d17f3-5dbf-4273-bc99-22055e1789ef tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1219 microversion: 2.1 time: 0.119789 Apr 02 20:54:53.523508 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 536/957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:53 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:53.538428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.538945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:53.545661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:53.546292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:53.547669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:53.548141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:53.630906 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e140608-af35-4ba6-9ff1-424f2c358e6c tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.243937 Apr 02 20:54:53.631494 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 422/958] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:54:53 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:53.643249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1678b385-b5eb-4a6e-b8a9-6c4091c9a4bb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Calling method '.version_select at 0x7f54d4c32ee0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.782651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-1678b385-b5eb-4a6e-b8a9-6c4091c9a4bb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:54:53.784263 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1678b385-b5eb-4a6e-b8a9-6c4091c9a4bb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] HTTP exception thrown: Insufficient rights for removing default security group. Apr 02 20:54:53.784263 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-d613b7d8-2959-4c2f-81ad-e34bd8998ad1'] Apr 02 20:54:53.785294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1678b385-b5eb-4a6e-b8a9-6c4091c9a4bb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Returning 400 to user: Insufficient rights for removing default security group. Apr 02 20:54:53.785294 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-d613b7d8-2959-4c2f-81ad-e34bd8998ad1'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:53.786488 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1678b385-b5eb-4a6e-b8a9-6c4091c9a4bb tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/145b6bc6-344e-4312-8ee9-82e6c98687af" status: 400 len: 182 microversion: 2.1 time: 0.147524 Apr 02 20:54:53.788154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 423/959] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 20:54:53 2022] DELETE /compute/v2.1/os-security-groups/145b6bc6-344e-4312-8ee9-82e6c98687af => generated 182 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:54:53.801184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9bf04e63-e9a6-4f95-8f2f-9832f8e70d44 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Calling method '.version_select at 0x7f54d4c6c430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.827751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-9bf04e63-e9a6-4f95-8f2f-9832f8e70d44 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 160ac74e-d96c-47ad-98ad-ef2da441b2a0 does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:54:53.828383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-9bf04e63-e9a6-4f95-8f2f-9832f8e70d44 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Neutron security group 160ac74e-d96c-47ad-98ad-ef2da441b2a0 not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 20:54:53.828936 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-9bf04e63-e9a6-4f95-8f2f-9832f8e70d44 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] HTTP exception thrown: Security group 160ac74e-d96c-47ad-98ad-ef2da441b2a0 does not exist Apr 02 20:54:53.828936 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-5fb075c1-839e-4e67-a185-cd3a3d0c8ad1'] Apr 02 20:54:53.829532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9bf04e63-e9a6-4f95-8f2f-9832f8e70d44 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Returning 404 to user: Security group 160ac74e-d96c-47ad-98ad-ef2da441b2a0 does not exist Apr 02 20:54:53.829532 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-5fb075c1-839e-4e67-a185-cd3a3d0c8ad1'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:53.830402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9bf04e63-e9a6-4f95-8f2f-9832f8e70d44 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/160ac74e-d96c-47ad-98ad-ef2da441b2a0" status: 404 len: 194 microversion: 2.1 time: 0.034979 Apr 02 20:54:53.830971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 424/960] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:54:53 2022] GET /compute/v2.1/os-security-groups/160ac74e-d96c-47ad-98ad-ef2da441b2a0 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:54:53.840241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-98ec5b9a-ad88-408c-9ef9-2fc94bfefa48 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Action: 'update', calling method: .version_select at 0x7f54d4d25c10>, body: {"security_group": {"name": "tempest-sg-1706601978", "description": "tempest-description-1328519167"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:53.863364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-98ec5b9a-ad88-408c-9ef9-2fc94bfefa48 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4375dc07-a4e5-46e8-968c-352d8007d8ff does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 20:54:53.864044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-98ec5b9a-ad88-408c-9ef9-2fc94bfefa48 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Neutron security group 4375dc07-a4e5-46e8-968c-352d8007d8ff not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 20:54:53.864732 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-98ec5b9a-ad88-408c-9ef9-2fc94bfefa48 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] HTTP exception thrown: Security group 4375dc07-a4e5-46e8-968c-352d8007d8ff does not exist Apr 02 20:54:53.864732 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-1dcab940-9a25-4ef8-ae74-75ec23aa973d'] Apr 02 20:54:53.870512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-98ec5b9a-ad88-408c-9ef9-2fc94bfefa48 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] Returning 404 to user: Security group 4375dc07-a4e5-46e8-968c-352d8007d8ff does not exist Apr 02 20:54:53.870512 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-1dcab940-9a25-4ef8-ae74-75ec23aa973d'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:54:53.872832 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-98ec5b9a-ad88-408c-9ef9-2fc94bfefa48 tempest-SecurityGroupsNegativeTestJSON-17579885 tempest-SecurityGroupsNegativeTestJSON-17579885-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/4375dc07-a4e5-46e8-968c-352d8007d8ff" status: 404 len: 194 microversion: 2.1 time: 0.035481 Apr 02 20:54:53.873722 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 425/961] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Apr 2 20:54:53 2022] PUT /compute/v2.1/os-security-groups/4375dc07-a4e5-46e8-968c-352d8007d8ff => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:54:53.943503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:53.944594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:53.945355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:53.955985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:53.956540 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79e169e5-5aa3-4ed9-a574-69563626960d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.422116 Apr 02 20:54:53.957175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:53.966854 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 537/962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:53 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:53.983026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:53.983503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:54.145671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:54.154550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bf73f68a-a89d-4711-b326-a9377f94cb71 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.215201 Apr 02 20:54:54.155097 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 426/963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:53 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:54.539850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:54.540541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:54.547803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:54.549012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:54.550056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:54.551374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:54.634520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:54.656807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98b0c219-faac-43de-96e0-ffc2bef06802 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1271 microversion: 2.1 time: 0.120834 Apr 02 20:54:54.663127 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 538/964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:54 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:54.980437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:54.983842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:54.995180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:54.995927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:54.997038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:54.997639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:55.179042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:55.179042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:55.186732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:55.187269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:55.188538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:55.188996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:55.418852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:55.433531 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c78bced4-1202-480f-83ed-d3b61bfb8cd2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.461429 Apr 02 20:54:55.434170 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 427/965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:54 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:55.477457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:55.487790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7233e254-7573-4926-84b3-87bcf398203c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.319580 Apr 02 20:54:55.488830 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 539/966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:55 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:55.676822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:55.677774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:55.692106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:55.695731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:55.698075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:55.700834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:56.116087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:56.131007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ee6ca2a-7370-4879-a50a-283432b644b1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.458342 Apr 02 20:54:56.146011 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 428/967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:55 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:56.469985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:56.471499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:56.483064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:56.484284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:56.486484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:56.488022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:56.513073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:56.520143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:56.545836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:56.546715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:56.550379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:56.554531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:56.995100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:57.009614 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9cc3048e-d61c-47ff-90d6-36e6f7de3508 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.560105 Apr 02 20:54:57.010078 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 540/968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:56 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:57.159332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:57.169398 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cab068cb-e457-4a6d-8d3f-dd7769e54ef1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.668092 Apr 02 20:54:57.200750 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 429/969] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:56 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:54:57.219175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:57.225231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:57.238026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:57.238569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:57.252220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:57.252804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:57.277162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1633708947", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": "none"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:57.371871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:57.373358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:57.373780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:57.374198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:57.374651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:54:57.385464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:57.385998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:57.386808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:57.387244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:57.409651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Getting quotas for project b683458310c945dd9acbecfb8661a9f5. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:54:57.415174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Getting quotas for user 38ba365bc3b9486eac23e3eeae7af79f and project b683458310c945dd9acbecfb8661a9f5. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:54:57.429192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:54:57.431389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:54:57.506970 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b725b93-72e8-43f5-954f-886eeba38813 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.494488 Apr 02 20:54:57.507676 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 541/970] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:54:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:54:57.520191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a175de89-1f27-407c-8035-33f5cd99f22d req-d264f8a7-bd1e-48df-8ee7-18d4a40e632f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28db20e-e3fa-4bb8-8060-48e2e5026d99", "tag": "7bb57a04-3148-4720-b93e-5fc3a96b579e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:57.532132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a175de89-1f27-407c-8035-33f5cd99f22d req-d264f8a7-bd1e-48df-8ee7-18d4a40e632f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:57.532819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a175de89-1f27-407c-8035-33f5cd99f22d req-d264f8a7-bd1e-48df-8ee7-18d4a40e632f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:57.552194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a175de89-1f27-407c-8035-33f5cd99f22d req-d264f8a7-bd1e-48df-8ee7-18d4a40e632f service nova] Creating event network-changed:7bb57a04-3148-4720-b93e-5fc3a96b579e for instance b28db20e-e3fa-4bb8-8060-48e2e5026d99 on nch2-master-1 Apr 02 20:54:57.575750 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a175de89-1f27-407c-8035-33f5cd99f22d req-d264f8a7-bd1e-48df-8ee7-18d4a40e632f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058412 Apr 02 20:54:57.577083 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 542/971] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:57.593781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25deb409-c625-4f81-b068-d4e3e17859cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:57.594770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-25deb409-c625-4f81-b068-d4e3e17859cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:57.712998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-25deb409-c625-4f81-b068-d4e3e17859cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:57.715296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:57.722381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-25deb409-c625-4f81-b068-d4e3e17859cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:57.725734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-25deb409-c625-4f81-b068-d4e3e17859cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:57.727369 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25deb409-c625-4f81-b068-d4e3e17859cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1278 microversion: 2.57 time: 0.147581 Apr 02 20:54:57.736852 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f4bbff5-9539-4594-aebe-9bbf85a6fe8b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.528707 Apr 02 20:54:57.741021 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 543/972] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:57 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:57.748551 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 430/973] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:57 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:57.893823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-963e0ff7-b09c-43a7-8ba9-34c5b99ee677 req-0b484042-3a53-4050-9d36-388bec9e60ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbcd800d-a825-4c87-a87a-abb91db1128e", "tag": "40a52eb8-652d-48d4-9919-f80edab0a6d3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:57.912822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-963e0ff7-b09c-43a7-8ba9-34c5b99ee677 req-0b484042-3a53-4050-9d36-388bec9e60ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:57.913269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-963e0ff7-b09c-43a7-8ba9-34c5b99ee677 req-0b484042-3a53-4050-9d36-388bec9e60ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:57.940444 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-963e0ff7-b09c-43a7-8ba9-34c5b99ee677 req-0b484042-3a53-4050-9d36-388bec9e60ca service nova] Creating event network-changed:40a52eb8-652d-48d4-9919-f80edab0a6d3 for instance dbcd800d-a825-4c87-a87a-abb91db1128e on nch1-master-1 Apr 02 20:54:57.945440 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-963e0ff7-b09c-43a7-8ba9-34c5b99ee677 req-0b484042-3a53-4050-9d36-388bec9e60ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056473 Apr 02 20:54:57.947681 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 544/974] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:54:58.027777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:58.028446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:58.037261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.038195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.039480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.040582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.190539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:58.191236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:58.199643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.200394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.201424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.203040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.364830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:58.377424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-040bfb13-c194-42fa-b568-9d80d1e262f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.352582 Apr 02 20:54:58.389279 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 431/975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:58 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:58.605067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:58.613717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-133e1e88-cacd-4742-82a3-41a315febb33 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1477 microversion: 2.1 time: 0.427962 Apr 02 20:54:58.614409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 545/976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:58 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1477 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:58.747265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:58.747885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:58.754570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.755029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.755157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:58.755782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:58.755883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.756241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.762228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.763018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.764123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:58.764754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:58.833232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:58.842385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:58.844976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:58.847431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-216cebd0-55e1-4a00-86a8-0bdf874caff1 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1330 microversion: 2.57 time: 0.104007 Apr 02 20:54:58.849162 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 432/977] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:54:58 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:54:59.344130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:59.354022 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b30b0f3f-6628-4d6e-9b35-527bb8c3004a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.603188 Apr 02 20:54:59.366132 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 546/978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:58 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:59.398561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:59.400630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:59.420654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:59.421418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:59.422731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:59.423386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:59.572004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-10548401", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "610b7d58-f6e4-4742-864f-860397932ea4"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:54:59.627267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] validate_networks() for [('610b7d58-f6e4-4742-864f-860397932ea4', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:54:59.684807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:54:59.693791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c960368-9379-43c3-893b-350be983f7a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.302318 Apr 02 20:54:59.700826 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 433/979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:59 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:54:59.700826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:54:59.700826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:54:59.706843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:59.707301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:59.708097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:54:59.708576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:54:59.996519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:54:59.996951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:54:59.997435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:54:59.998488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:54:59.998918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:00.009248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.009763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.010576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.011013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.028074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Getting quotas for project 78889a02e6054dd49c29b72fc422e9c8. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:55:00.032255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Getting quotas for user 59d64769b0374642a462d10d4ff49f1b and project 78889a02e6054dd49c29b72fc422e9c8. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:55:00.043570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:55:00.046150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:55:00.094027 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-056d01c1-0381-4082-8863-966f2ce234e4 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574157 Apr 02 20:55:00.099635 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 547/980] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 20:55:00.099635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:00.099985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:00.106137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.106598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.107381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.107829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.177456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.186517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.188527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.190447 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f05ed33-98bb-4336-9299-bea95d860cfd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.094815 Apr 02 20:55:00.191108 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 548/981] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:00 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:00.196218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b6df883-24ab-4b22-bc2c-3725c8274c65 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:00.196857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2b6df883-24ab-4b22-bc2c-3725c8274c65 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:00.218338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.228092 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65772893-991c-4821-8d4a-b0d3cc0447c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1476 microversion: 2.1 time: 0.532142 Apr 02 20:55:00.228932 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 434/982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:54:59 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1476 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:00.251229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2b6df883-24ab-4b22-bc2c-3725c8274c65 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.258381 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2b6df883-24ab-4b22-bc2c-3725c8274c65 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1223 microversion: 2.1 time: 0.066051 Apr 02 20:55:00.259034 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 549/983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:00 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:00.301031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e8922ad9-5257-458d-931b-6a779812f2b9 req-1660084a-8481-4db4-93eb-c0dc9bbbee67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28074b2-b820-4fa1-8693-1ff7cf91a474", "name": "network-vif-unplugged", "status": "completed", "tag": "26f419c3-bf0c-45a0-a419-019238f49182"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:00.311152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e8922ad9-5257-458d-931b-6a779812f2b9 req-1660084a-8481-4db4-93eb-c0dc9bbbee67 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.311679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e8922ad9-5257-458d-931b-6a779812f2b9 req-1660084a-8481-4db4-93eb-c0dc9bbbee67 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.326863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e8922ad9-5257-458d-931b-6a779812f2b9 req-1660084a-8481-4db4-93eb-c0dc9bbbee67 service nova] Creating event network-vif-unplugged:26f419c3-bf0c-45a0-a419-019238f49182 for instance c28074b2-b820-4fa1-8693-1ff7cf91a474 on nch1-master-1 Apr 02 20:55:00.337766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-e8922ad9-5257-458d-931b-6a779812f2b9 req-1660084a-8481-4db4-93eb-c0dc9bbbee67 service nova] Instance c28074b2-b820-4fa1-8693-1ff7cf91a474 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:55:00.354105 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e8922ad9-5257-458d-931b-6a779812f2b9 req-1660084a-8481-4db4-93eb-c0dc9bbbee67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057847 Apr 02 20:55:00.355144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 435/984] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:00.375886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:00.377236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:00.387398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.387943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.388876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.390173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.588906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.607995 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5cb88395-8288-406e-b4f7-d0b96071538d tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.237495 Apr 02 20:55:00.619731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 550/985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:00 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:00.712976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:00.715985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:00.728017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.729081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.730715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:00.731961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:00.991043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:00.999025 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c103af1-2650-4231-b405-d0371a69cfcd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.290831 Apr 02 20:55:00.999599 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 436/986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:00 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:01.210278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:01.210892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:01.217054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.217502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.218594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.219033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.246492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:01.247365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:01.254133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.254808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.255790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.256392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.287375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:01.296391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:01.298894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:01.300218 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9277e4e8-445a-45af-a5cf-2d49e048df1b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.093803 Apr 02 20:55:01.300859 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 551/987] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:01 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:01.307321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:01.308154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:01.317616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.318076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.318873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.319493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.400351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:01.409089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb8b1848-1857-48a4-b653-ad5fe408409a tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1293 microversion: 2.1 time: 0.106766 Apr 02 20:55:01.409920 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 552/988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:01 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:01.511758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:01.519719 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-29b8ad2f-94ed-49a8-8c23-9eaa28003328 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1476 microversion: 2.1 time: 0.276609 Apr 02 20:55:01.520345 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 437/989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:01 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:01.626306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:01.627907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:01.634342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.634799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.635679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:01.636125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:01.771781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:01.779258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-005afafc-da80-49c9-a893-4a7fd7cf7288 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.156991 Apr 02 20:55:01.779854 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 553/990] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:01 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:02.015268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:02.015887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:02.024230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.024798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.025583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.026028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.319142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:02.319755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:02.325819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.326268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.327216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.327812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.337982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:02.346733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f421086-5a8a-4bf5-9450-759a39f16b87 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.335432 Apr 02 20:55:02.347946 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 438/991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:02 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:02.380602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f884bd21-1fc6-41e8-a6c0-9112bbf06d23 req-5b34f279-e306-4cbb-a23d-90fbd0197e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c28074b2-b820-4fa1-8693-1ff7cf91a474", "tag": "26f419c3-bf0c-45a0-a419-019238f49182"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:02.388871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f884bd21-1fc6-41e8-a6c0-9112bbf06d23 req-5b34f279-e306-4cbb-a23d-90fbd0197e12 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.389449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f884bd21-1fc6-41e8-a6c0-9112bbf06d23 req-5b34f279-e306-4cbb-a23d-90fbd0197e12 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.401952 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f884bd21-1fc6-41e8-a6c0-9112bbf06d23 req-5b34f279-e306-4cbb-a23d-90fbd0197e12 service nova] Creating event network-changed:26f419c3-bf0c-45a0-a419-019238f49182 for instance c28074b2-b820-4fa1-8693-1ff7cf91a474 on nch1-master-1 Apr 02 20:55:02.407411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-f884bd21-1fc6-41e8-a6c0-9112bbf06d23 req-5b34f279-e306-4cbb-a23d-90fbd0197e12 service nova] Instance c28074b2-b820-4fa1-8693-1ff7cf91a474 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:55:02.409954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:02.419031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:02.419771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f884bd21-1fc6-41e8-a6c0-9112bbf06d23 req-5b34f279-e306-4cbb-a23d-90fbd0197e12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043009 Apr 02 20:55:02.421416 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 439/992] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:02.421545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:02.422529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6de6d1c2-5b37-4784-acc7-4196a1e93c8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.107467 Apr 02 20:55:02.423230 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 554/993] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:02 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:02.440066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:02.441115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:02.458920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.460577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.461727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.462161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.540400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:02.541405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:02.548828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.549421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.550471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.550956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.810192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:02.813463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:02.818576 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a966066-c62a-4775-a5ec-92ca7d19315b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.395733 Apr 02 20:55:02.828202 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 440/994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:02 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:02.833330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:02.835854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:02.843191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.843656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.844046 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d7a087d-21cb-4912-92f2-27f93e75671d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.309106 Apr 02 20:55:02.844631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:02.854448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:02.856032 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 555/995] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:02 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:03.120150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:03.128485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a15753f0-4cf3-4d30-844f-03962cd000ed tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.307793 Apr 02 20:55:03.129304 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 441/996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:02 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:03.363596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:03.364327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:03.370635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.371086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.371847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.372288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.442547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:03.443949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:03.450820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.450820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.451617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.452055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.516547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:03.521872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:03.524908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:03.526455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:03.527591 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e35e6cb-6563-4b3a-8b6e-36eda7209311 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.090156 Apr 02 20:55:03.528151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 442/997] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:03 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:03.529787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b58a4d95-e0fe-4efb-93d5-a43a03decf45 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.170459 Apr 02 20:55:03.530350 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 556/998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:03 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:03.835836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:03.836593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:03.842595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.843056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.843829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.844269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.864023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:03.864672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:03.873139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.873866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.874644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:03.875269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:03.978867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:03.986276 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b356498-f0a9-4e12-9f2e-333f9cd293cf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.154252 Apr 02 20:55:03.986850 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 443/999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:03 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:04.019629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:04.026959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac1a5279-5917-4a96-865c-1bf04664ddce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.168177 Apr 02 20:55:04.027537 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 557/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:03 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:04.146389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:04.147110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:04.154508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.155092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.156042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.156540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.273970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-699eac61-d179-4c2d-a35a-6d2b28f8b3cc req-7dc731a9-ff32-49f4-9f36-bc5f284583c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28db20e-e3fa-4bb8-8060-48e2e5026d99", "name": "network-vif-plugged", "status": "completed", "tag": "7bb57a04-3148-4720-b93e-5fc3a96b579e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:04.281894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-699eac61-d179-4c2d-a35a-6d2b28f8b3cc req-7dc731a9-ff32-49f4-9f36-bc5f284583c1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.282340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-699eac61-d179-4c2d-a35a-6d2b28f8b3cc req-7dc731a9-ff32-49f4-9f36-bc5f284583c1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.294203 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-699eac61-d179-4c2d-a35a-6d2b28f8b3cc req-7dc731a9-ff32-49f4-9f36-bc5f284583c1 service nova] Creating event network-vif-plugged:7bb57a04-3148-4720-b93e-5fc3a96b579e for instance b28db20e-e3fa-4bb8-8060-48e2e5026d99 on nch2-master-1 Apr 02 20:55:04.295349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:04.299016 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-699eac61-d179-4c2d-a35a-6d2b28f8b3cc req-7dc731a9-ff32-49f4-9f36-bc5f284583c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028715 Apr 02 20:55:04.299890 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 558/1001] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:04.303897 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d4e1b18-013d-4dc5-8ac5-fdfe2d5b1c6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.161979 Apr 02 20:55:04.304931 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 444/1002] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:04 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:04.438156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-24d8e7d1-9717-42f9-9a59-3d8ce08296b0 req-4e445be4-57dc-44d6-bf83-1449e1e22892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787d3f16-a1b9-4630-a900-2f5421dd1214", "tag": "fa794201-c166-4b87-89ae-d05e98fa82ec"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:04.448931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-24d8e7d1-9717-42f9-9a59-3d8ce08296b0 req-4e445be4-57dc-44d6-bf83-1449e1e22892 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.449378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-24d8e7d1-9717-42f9-9a59-3d8ce08296b0 req-4e445be4-57dc-44d6-bf83-1449e1e22892 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.461087 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-24d8e7d1-9717-42f9-9a59-3d8ce08296b0 req-4e445be4-57dc-44d6-bf83-1449e1e22892 service nova] Creating event network-changed:fa794201-c166-4b87-89ae-d05e98fa82ec for instance 787d3f16-a1b9-4630-a900-2f5421dd1214 on nch1-master-1 Apr 02 20:55:04.465974 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-24d8e7d1-9717-42f9-9a59-3d8ce08296b0 req-4e445be4-57dc-44d6-bf83-1449e1e22892 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032181 Apr 02 20:55:04.466569 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 559/1003] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:04.547251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:04.547893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:04.548000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:04.549312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:04.555121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.555846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.555967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.556298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.556702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.557120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:04.557220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.557543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:04.621115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:04.629601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:04.631118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:04.632255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70f228ce-e8e0-4a6f-980b-d642ba38957a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.088619 Apr 02 20:55:04.632871 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 560/1004] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:04 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:04.692792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:04.701198 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-68aabcbe-dd77-4cb4-afec-1b131b6fb249 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.157837 Apr 02 20:55:04.701982 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 445/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:04 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:05.002571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:05.003109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:05.009523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.009975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.010743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.011217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.044639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:05.045265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:05.051961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.052412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.053209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.053650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.152663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.162062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a92d472c-c4c9-4b47-8e11-c0bb9cd10668 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.163370 Apr 02 20:55:05.162749 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 561/1006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:04 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:05.205792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.213325 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47fbcc4b-5366-40e4-9680-de3ed52d6384 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.172683 Apr 02 20:55:05.213890 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 446/1007] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:05 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:05.321270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:05.321924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:05.327924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.328393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.329200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.329645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.474104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.481564 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a2db3f5-35a2-4139-bc56-8883ff7a9d64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1319 microversion: 2.1 time: 0.164124 Apr 02 20:55:05.482151 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 562/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:05 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:05.650959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:05.651690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:05.657875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.658338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.659112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.659555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.718745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:05.719286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:05.722156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.725248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.725704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.726488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:05.726940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:05.732019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.732736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.733991 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ac020e7-55c3-4129-a872-b7abc343d44f tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.086936 Apr 02 20:55:05.734736 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 447/1009] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:05 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:05.985712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:05.994469 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d506c9e-2d6d-4b33-afe1-4e79b972ca22 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.279776 Apr 02 20:55:05.995090 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 563/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:05 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:06.179468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:06.180089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:06.188135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.188626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.190053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.190499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.230891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:06.231582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:06.238917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.239381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.240173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.240650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.333536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.341284 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c187886-f7e9-41b8-9ce5-0e2acbec2a35 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.165605 Apr 02 20:55:06.341966 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 448/1011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:06 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:06.347991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-94e9bfe3-8d4c-491d-abcb-ed9e01ebbfdc req-fb62f5fe-53be-46c6-8bbc-29e325470f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbcd800d-a825-4c87-a87a-abb91db1128e", "name": "network-vif-plugged", "status": "completed", "tag": "40a52eb8-652d-48d4-9919-f80edab0a6d3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:06.355851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-94e9bfe3-8d4c-491d-abcb-ed9e01ebbfdc req-fb62f5fe-53be-46c6-8bbc-29e325470f34 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.356331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-94e9bfe3-8d4c-491d-abcb-ed9e01ebbfdc req-fb62f5fe-53be-46c6-8bbc-29e325470f34 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.368823 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-94e9bfe3-8d4c-491d-abcb-ed9e01ebbfdc req-fb62f5fe-53be-46c6-8bbc-29e325470f34 service nova] Creating event network-vif-plugged:40a52eb8-652d-48d4-9919-f80edab0a6d3 for instance dbcd800d-a825-4c87-a87a-abb91db1128e on nch1-master-1 Apr 02 20:55:06.373569 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-94e9bfe3-8d4c-491d-abcb-ed9e01ebbfdc req-fb62f5fe-53be-46c6-8bbc-29e325470f34 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 Apr 02 20:55:06.374332 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 449/1012] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:06.383831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.391373 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69805005-b3a5-466c-88cb-258735b3c630 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.164305 Apr 02 20:55:06.391955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 564/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:06 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:06.499187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:06.499890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:06.506015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.506474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.507238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.507677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.644017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.651321 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ca5e635-4c22-470f-be54-022605f0e6f9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1469 microversion: 2.1 time: 0.156419 Apr 02 20:55:06.651885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 450/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:06 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:06.667513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:06.668118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:06.674472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.674925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.675684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.676120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.752743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:06.753279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:06.759403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.759866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.760675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:06.761132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:06.806791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.814450 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-512a260e-a1c5-469b-9e5d-457f34fe80a1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.150698 Apr 02 20:55:06.815025 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 565/1015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:06 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:06.822775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.831136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.832693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:06.833858 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc3ef87e-4e93-4185-9fe2-6a446f77714d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.085162 Apr 02 20:55:06.834410 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 451/1016] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:06 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:07.011116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:07.011654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:07.018230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.018686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.019481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.019921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.149426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.157193 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87bd1153-5c4f-4db0-b14e-04ab0af80bf1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.150018 Apr 02 20:55:07.157766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 566/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:07 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:07.358033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:07.358563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:07.365299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.365761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.366537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.366981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.409127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:07.409928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:07.416213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.416740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.417510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.417951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.500719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.508761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8675d0e-0549-4334-8398-8c7a755f3c20 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.154635 Apr 02 20:55:07.509340 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 452/1018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:07 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:07.553929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.561354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3210882f-4730-4b21-a9f5-a16b447ec64f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.156206 Apr 02 20:55:07.561928 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 567/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:07 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:07.831339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:07.831953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:07.837944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.838409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.839176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.839620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.852194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:07.852843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:07.859128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.859450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.860319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:07.860798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:07.924768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.932793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.934322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.935878 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d4d64c5-9f9d-4a92-9a3b-077ebd42bd53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.087137 Apr 02 20:55:07.938158 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 568/1020] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:07 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:07.977474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:07.984764 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-461e6c89-569d-4f25-86ca-19e8ec690711 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.157268 Apr 02 20:55:07.985513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 453/1021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:07 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:08.173435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:08.174645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:08.180620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.181077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.181848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.182290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.315525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:08.323405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a2dae02-160a-44c6-a095-400231fba112 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.153823 Apr 02 20:55:08.323975 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 569/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:08 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:08.525714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:08.526330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:08.533846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.534303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.535076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.535518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.579090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:08.580377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:08.586774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.587308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.588123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.588671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.668363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:08.675766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60bd4826-a4de-4adf-b204-d6cb73439da3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.154000 Apr 02 20:55:08.676347 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 454/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:08 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:08.725230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:08.732571 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-768c2629-e25c-4238-ada9-1d2a1520a4e3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.157345 Apr 02 20:55:08.733151 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 570/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:08 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:08.953933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:08.954539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:08.961100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.961553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:08.962311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:08.962745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.002868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:09.003484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:09.009545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.010006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.010821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.011267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.023848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.031788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.033333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.034465 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09a6615c-b0d2-49a0-9124-2863f69298ec tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.084413 Apr 02 20:55:09.035057 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 455/1025] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:08 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:09.145558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.152939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b06769eb-a0a4-4337-96a8-a7611690f034 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.154562 Apr 02 20:55:09.153507 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 571/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:08 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:09.341007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:09.341597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:09.347661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.348116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.348982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.349424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.483600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.492184 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca66b057-d626-4b3b-85ed-7bfa0d33dff8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.155143 Apr 02 20:55:09.492783 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 456/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:09 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:09.692921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:09.693570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:09.699939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.700395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.701201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.701644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.749618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:09.750241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:09.757033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.757494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.758271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:09.758712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:09.842857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.851984 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e85b721a-f1d9-460a-a899-ce2b7935878e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.162858 Apr 02 20:55:09.852760 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 572/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:09 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:09.894636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:09.901957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3354cebc-dcb7-46a6-81eb-d5d5199640bd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.156210 Apr 02 20:55:09.902526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 457/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:09 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:10.054106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:10.054621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:10.061021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.061469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.062269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.062977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.132447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:10.140472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:10.142001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:10.143834 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85859385-ae85-4faf-b7e9-24cc0b32fa71 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.093720 Apr 02 20:55:10.144398 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 573/1030] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:10 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:10.169622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:10.170244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:10.176418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.176914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.177692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.178137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.318662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:10.326836 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2e298aa-20d6-4685-bacb-2c69dd297b3a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.161104 Apr 02 20:55:10.327420 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 458/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:10 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:10.509852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:10.510464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:10.516496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.516957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.517733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.518177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.659810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:10.667981 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-946abea3-f659-4153-893a-a24d9bcf8ef4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.162587 Apr 02 20:55:10.668546 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 574/1032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:10 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:10.868756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:10.869303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:10.875970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.876420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.877915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.878353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.919090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:10.919699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:10.926603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.927073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:10.927870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:10.928303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.013372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.021067 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93d88585-8d41-4259-810a-20d0121a3380 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.156413 Apr 02 20:55:11.021646 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 459/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:10 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:11.064772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.073165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5de5b8bf-9db8-4f52-897f-fdd6d859a42e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.158028 Apr 02 20:55:11.073748 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 575/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:10 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:11.165400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:11.166053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:11.172119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:11.172611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.173386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:11.174457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.234403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.242736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.244261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.245433 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0dde3aa-04c7-4b67-8d57-12da707e6bf4 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.083973 Apr 02 20:55:11.245996 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 460/1035] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:11 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:11.344260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:11.344891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:11.351398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:11.351855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.352638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:11.353074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.486713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.494186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-463767a2-106f-4cc7-8c06-02739c1d1637 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.153694 Apr 02 20:55:11.494840 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 576/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:11 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:11.686229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:11.686761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:11.693679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:11.694132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.694898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:11.695335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:11.827475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:11.835885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f19b94f0-43c6-4ef1-804b-00a0f158446d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.153659 Apr 02 20:55:11.836470 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 461/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:11 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:12.037901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:12.038439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:12.044580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.045041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.045816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.046261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.089371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:12.089985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:12.096656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.097139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.098038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.098480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.182176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.190644 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86e8c22f-651d-47ac-a9ec-80c91fc962ff tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.156139 Apr 02 20:55:12.191246 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 577/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:12 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:12.234608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.242553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f4b1abe-bc0c-436b-bcab-13dd006b1617 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.157231 Apr 02 20:55:12.243118 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 462/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:12 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:12.263678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:12.264299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:12.270243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.270705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.271487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.271931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.333690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.341515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.343038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.344167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-120c1e0d-8342-4ac3-8323-c250b3aebde9 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.084430 Apr 02 20:55:12.344782 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 578/1040] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:12 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:12.510816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:12.511433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:12.517476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.517993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.518766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.519205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.648675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.655983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c115afbf-e70a-4200-88ce-21308c676f89 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.149002 Apr 02 20:55:12.656588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 463/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:12 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:12.853029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:12.853577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:12.859829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.860292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.861095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:12.861542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:12.991108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:12.999109 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef406173-2732-450b-9c3b-4f7145a70a53 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.150014 Apr 02 20:55:12.999684 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 579/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:12 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:13.207052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:13.207664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:13.215569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.216027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.216832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.217277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.259560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:13.260173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:13.266610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.267066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.268436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.268912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.353197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:13.361111 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8387b29b-a05c-4e5b-b2f1-b3e2dfbca673 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.157887 Apr 02 20:55:13.361695 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 464/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:13 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:13.366222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:13.366824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:13.372814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.373263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.374026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.374465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.405079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:13.412675 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c297deee-6f51-4dae-9200-be42ea3293a6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.156862 Apr 02 20:55:13.413255 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 580/1044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:13 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:13.435917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:13.444717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:13.446222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:13.447362 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2607bd94-da45-4c19-b390-d8627147ce8e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.084750 Apr 02 20:55:13.447935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 465/1045] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:13 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:13.674029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:13.674649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:13.680680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.681142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.681909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:13.682351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:13.815543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:13.822927 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e53e05a0-b53d-4cd0-89b2-b967f6871873 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.153014 Apr 02 20:55:13.823498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 581/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:13 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:14.016485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:14.017044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:14.023664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.024124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.024934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.025383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.165754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:14.174377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd06391d-3efa-4187-b90f-0efc8815cf0f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.161812 Apr 02 20:55:14.174980 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 466/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:14 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:14.378184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:14.378729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:14.385245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.385696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.386470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.386922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.430768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:14.431519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:14.440475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.441268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.442067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.442511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.587258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:14.595178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92a76255-f8af-48d7-bbc5-f01b1bfbcc97 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.221702 Apr 02 20:55:14.595764 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 582/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:14 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:14.601045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:14.601653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:14.607544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.607997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.608798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.609243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.673190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:14.681797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:14.683446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:14.684674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8408a2b-c0f3-4381-91d7-3afc0d8fa847 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.087793 Apr 02 20:55:14.685228 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 583/1049] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:14 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:14.840436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:14.841242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:14.848068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.848548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.849329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:14.849763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:14.990971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:14.998845 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e44bc69-a8ce-41d2-bc8e-6b98da79c941 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.162224 Apr 02 20:55:14.999587 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 584/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:14 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:15.131393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:15.138738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93fc213c-b72a-4251-8e6b-699c6258c1cb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.712187 Apr 02 20:55:15.139304 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 467/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:14 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:15.191485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:15.192027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:15.198137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:15.198630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:15.199438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:15.199887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:15.334175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:15.341906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1137f5a7-296c-4036-a677-e30a475f9d19 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.154576 Apr 02 20:55:15.342477 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 585/1052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:15 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:15.611088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:15.611704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:15.618341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:15.618788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:15.619547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:15.619985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:15.704000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:15.704640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:15.711918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:15.712312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:15.713156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:15.713598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:15.751472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:15.759763 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49998a1d-ce2d-4a20-b925-3a27581638b7 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.152505 Apr 02 20:55:15.760472 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 468/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:15 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:15.775356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:15.783238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:15.788368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:15.789439 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1112bdac-cf3e-4830-b360-838767d52037 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.089475 Apr 02 20:55:15.790010 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 586/1054] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:15 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:16.015822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:16.016356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:16.023020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.023486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.024266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.024782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.155771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:16.156384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:16.162304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.162768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.163623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.164070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.165440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.172890 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8224897-8b98-41a3-b24e-2edd16dc1b58 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.160939 Apr 02 20:55:16.173475 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 469/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:16 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:16.296515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.303830 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ce5bb47-b594-4cc5-a016-afc4a8bc5b10 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.151907 Apr 02 20:55:16.304400 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 587/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:16 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:16.359053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:16.359701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:16.365725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.366187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.366959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.367407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.506287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.514092 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52ce08a2-003e-4594-b8e0-e548a1206ed1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.158996 Apr 02 20:55:16.514660 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 470/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:16 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:16.777265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:16.777879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:16.784318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.784828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.785605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.786059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.809895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:16.810613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:16.819142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.819610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.820580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:16.821032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:16.886663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.894440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.895935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.897088 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cbe4edee-8efc-4983-95f2-7dd9b6628d70 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.091013 Apr 02 20:55:16.897648 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 471/1058] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:16 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:16.918969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:16.926910 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6558d4fe-000f-451e-961c-a9fdf47b958e tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.153507 Apr 02 20:55:16.927481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 588/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:16 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:17.190173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:17.190788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:17.196795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.197253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.198031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.198474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.320888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:17.321690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:17.327093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:17.327746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.328212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.329022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.329465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.334853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51d8acf3-4e5d-4b22-93f4-1e2a95b32cb3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.148813 Apr 02 20:55:17.335427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 472/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:17 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:17.463648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:17.471886 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b11f38ea-4667-4a24-a730-8a7a79924b4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.154176 Apr 02 20:55:17.472497 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 589/1061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:17 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:17.530990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:17.531603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:17.538095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.538555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.539326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.539771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.669462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:17.677415 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b17ecbef-6c97-4ba5-a4f7-a81504672c3e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.150381 Apr 02 20:55:17.677993 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 473/1062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:17 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:17.915163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:17.915772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:17.922139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.922584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.923348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.923783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.943928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:17.944576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:17.950882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.951342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.952116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:17.952590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:17.989076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:17.997286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:17.998780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:17.999920 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77cdd0cb-bc30-41ce-937b-9773b1cb7ced tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.088690 Apr 02 20:55:18.000539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 590/1063] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:17 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:18.088843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:18.096226 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8edeae39-4a46-4697-b4b5-10096c950b1c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.156779 Apr 02 20:55:18.096830 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 474/1064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:17 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:18.351069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:18.351603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:18.357933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:18.358430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:18.359214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:18.359662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:18.489666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:18.490275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:18.490508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:18.496349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:18.496850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:18.497630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:18.498070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:18.498349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33bf5425-7d5b-471c-8e1c-09fa0d06ef0f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.151221 Apr 02 20:55:18.498945 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 591/1065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:18 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:18.630126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:18.637433 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a29bd889-a88e-429a-970a-48b394decd18 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.152180 Apr 02 20:55:18.637994 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 475/1066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:18 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:18.694403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:18.695013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:18.700920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:18.701375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:18.702137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:18.702570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:18.836155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:18.844100 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6592eae5-88b0-4a5b-808a-954c87d8fe94 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.153480 Apr 02 20:55:18.844727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 592/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:18 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:19.019017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:19.019623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:19.026510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.026964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.027728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.028163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.090261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:19.098492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:19.100140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:19.101318 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ddd9fb77-59fe-479c-a12e-1c371b3c71eb tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.086160 Apr 02 20:55:19.101880 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 476/1068] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:19 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:19.112709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:19.113325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:19.119777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.120235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.121062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.121493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.253773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:19.261071 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f685994-9725-4371-b19c-c2cc5a77bf26 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.152791 Apr 02 20:55:19.261647 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 593/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:19 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:19.515043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:19.515653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:19.522218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.522667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.523464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.523898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.654337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:19.654979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:19.658297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:19.661436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.661892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.662662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.663129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.666414 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a220cfe-2d73-46be-90db-7c74017231fa tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.155203 Apr 02 20:55:19.666993 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 477/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:19 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:19.795157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:19.802545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56472f6d-344f-41c6-ad42-9004242e3091 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.152046 Apr 02 20:55:19.803133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 594/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:19 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:19.861677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:19.862302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:19.868276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.868776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:19.869556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:19.870002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.000683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.009350 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-96cc2ca0-d94f-4f44-9a36-91500a4d1186 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.151562 Apr 02 20:55:20.009935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 478/1072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:19 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:20.120183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:20.120823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:20.127610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.128090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.128879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.129319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.196752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.204534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.206705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.207825 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4cc44e47-2b03-4218-8149-b850a23b11f3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.091538 Apr 02 20:55:20.208381 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 595/1073] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:20 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:20.277782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:20.278335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:20.285177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.285640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.286418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.286867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.419514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.427433 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4096a070-6738-4761-bc5a-65c50daf0837 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.153588 Apr 02 20:55:20.428007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 479/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:20 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:20.683189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:20.683800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:20.690202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.690652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.691415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.691885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.819489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:20.820113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:20.824569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.826157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.826626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.827410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:20.827870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:20.831837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-614b17c1-3a97-48ea-9c96-16e77632db1a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.152624 Apr 02 20:55:20.832401 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 596/1075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:20 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:20.959474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:20.966901 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9428b46b-37b4-41aa-af44-ddd675be1382 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.151281 Apr 02 20:55:20.967468 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 480/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:20 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:21.026858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:21.027475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:21.034142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.034603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.035403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.035855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.166956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:21.174911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f58204f9-0bfb-41bc-a0d1-8f8605cd64c2 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.151899 Apr 02 20:55:21.175519 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 597/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:21 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:21.226808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:21.227428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:21.233484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.233949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.234727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.235175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.297782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:21.305689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:21.307222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:21.308360 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5dbeafe8-8502-466a-b483-00a6fc8f71cd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.085473 Apr 02 20:55:21.308960 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 481/1078] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:21 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:21.444999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:21.445539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:21.451548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.451992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.452798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.453234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.586590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:21.593806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa400e00-7931-414e-a972-4570149b1462 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.152711 Apr 02 20:55:21.594373 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 598/1079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:21 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:21.848655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:21.849193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:21.855349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.855840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.856650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.857096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.984286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:21.984919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:21.991424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.991882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.992244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:21.992687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:21.993137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:21.999551 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-787b3dcb-f4b6-4403-9061-e257ebb753e6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.154827 Apr 02 20:55:22.000125 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 482/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:21 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:22.124438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:22.132272 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b9c9047-041a-4e97-b6fe-10057b64801b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.151862 Apr 02 20:55:22.132876 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 599/1081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:21 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:22.191991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:22.192639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:22.198490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:22.198951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:22.199729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:22.200181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:22.327111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:22.327719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:22.333644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:22.334091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:22.334904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:22.335343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:22.397349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:22.405648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:22.407147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:22.408273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a10dfc71-c6d5-4873-84ee-ef555deab05e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1336 microversion: 2.57 time: 0.085079 Apr 02 20:55:22.408866 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 600/1082] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:22 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1336 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:22.593462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:22.602367 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d0ab9f9-5c54-4ef4-bb15-3b6bed7813a3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1550 microversion: 2.1 time: 0.414619 Apr 02 20:55:22.602963 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 483/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:22 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1550 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:22.610475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:22.611252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:22.617845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:22.618305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:22.619098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:22.619541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:22.756913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:22.764243 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-97d5a90e-99a7-4040-9390-19b4e0d3b291 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.157629 Apr 02 20:55:22.764870 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 601/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:22 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:23.016988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:23.017611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.024268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.024784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.025569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.026015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.149876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:23.150486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.157239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.157697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.158480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.158923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.285167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.293085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a047e463-4b37-4daf-ba9d-55034960efce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1319 microversion: 2.1 time: 0.279953 Apr 02 20:55:23.294489 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 484/1085] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:23 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:23.321609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.329257 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-39a31e42-38fb-4516-ab2b-09f2e3e9f3dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.183294 Apr 02 20:55:23.338140 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 602/1086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:23 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:23.428362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:23.429168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.435644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.436193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.437675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.445256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.556900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.565286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.567390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.568598 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8867dd4-480d-4db8-b073-3989982b1ea7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1357 microversion: 2.57 time: 0.145132 Apr 02 20:55:23.569172 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 485/1087] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:23 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:23.587070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:23.588817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.594670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.595129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.595911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.596356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.619923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:23.620667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.629523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.630067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.630923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.631638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.677519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:55:23.677952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:55:23.678433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:55:23.678848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:55:23.679266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:23.742996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.749283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.749755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.750559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.751012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.786846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d1e51d2-4c0c-4caf-ad45-c974f8e2345d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "POST /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e/action" status: 202 len: 1138 microversion: 2.57 time: 0.203567 Apr 02 20:55:23.798308 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 603/1088] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Apr 2 20:55:23 2022] POST /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e/action => generated 1138 bytes in 214 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 02 20:55:23.807143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:23.808397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.815396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.816190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.817026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.817476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.845985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.863986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f423ddc3-0ee6-4d38-8de6-61c742d309f7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1540 microversion: 2.1 time: 0.246979 Apr 02 20:55:23.864996 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 486/1089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:23 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1540 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:23.885924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:23.886645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:23.894342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.895044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.896238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:23.896917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:23.984322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.989646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:23.993058 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ba7a520-0ca1-4e40-b151-f00cbe99b37c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.193325 Apr 02 20:55:24.002551 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 604/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:23 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:24.002721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:24.002721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:24.003924 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a90e06f-8187-443a-afa8-e62792025c51 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.122990 Apr 02 20:55:24.004708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 487/1091] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:23 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:24.006449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73227e13-2826-406f-b4ba-cb9e0d0746c1 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '.version_select at 0x7f54d4914310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.008996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73227e13-2826-406f-b4ba-cb9e0d0746c1 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.009458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73227e13-2826-406f-b4ba-cb9e0d0746c1 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.019816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73227e13-2826-406f-b4ba-cb9e0d0746c1 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1564 microversion: 2.1 time: 0.017770 Apr 02 20:55:24.020422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 605/1092] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/os-migrations => generated 1564 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:24.031870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.032495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:24.039214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.039672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.040438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.040908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.289095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9a33503-edaf-4598-ac66-400e9f4d2334 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1691 microversion: 2.1 time: 0.247653 Apr 02 20:55:24.293147 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 488/1093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:24.305794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.306357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:24.310311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.312129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:24.321761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.322292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.323379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.323848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.330111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.330750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.332416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.332891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.490372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-706158ea-caaa-4aff-9659-6a72dcbeb629 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1691 microversion: 2.1 time: 0.188420 Apr 02 20:55:24.491463 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 606/1094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:24.496031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.496675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:24.502884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.504245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.504711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.505159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.605411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:24.612929 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5544e95-3d82-4c86-84b1-b3e875009c64 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1469 microversion: 2.1 time: 0.306427 Apr 02 20:55:24.624092 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 489/1095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1469 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:24.634123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.634899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:24.640573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:24.641409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.641873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.642660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.643101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.650364 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07f3221a-df6e-4b23-a30a-8b463009e712 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1474 microversion: 2.1 time: 0.157809 Apr 02 20:55:24.660575 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 607/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:24.660575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.668860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:24.670903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Searching by: {'reservation_id': 'r-0030augu', 'deleted': False, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:55:24.678325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.679085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.680105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.680763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.817592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:55:24.822613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lazy-loading 'services' on Instance uuid b118f37c-0f35-46b9-81d4-a4c7f161dd5a {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:55:24.886555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:24.893545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.894030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.944120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-703a4ace-2669-4ace-9046-00d6904957b4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments/df9cf386-bafd-4967-8b89-99831c61cab1" status: 202 len: 0 microversion: 2.1 time: 0.314104 Apr 02 20:55:24.944770 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 490/1097] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 20:55:24 2022] DELETE /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments/df9cf386-bafd-4967-8b89-99831c61cab1 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:55:24.954206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:24.955502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:24.962395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.962938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.964002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:24.965073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:24.997920 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a685f0b-5509-420f-b9f6-76025ff2c082 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048154 Apr 02 20:55:24.998496 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 491/1098] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:25.010598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.011301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.017265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.017800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.018588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.019062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.034568 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31bd4a4c-c9dd-47b8-bff4-4ba56ee6d5ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-0030augu" status: 200 len: 2931 microversion: 2.1 time: 0.380105 Apr 02 20:55:25.035185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 608/1099] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Apr 2 20:55:24 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0030augu => generated 2931 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:25.039874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.040503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.046639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.047144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.047845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.048625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.114358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:25.122358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:25.124011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:25.125228 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1b229a2-1172-4e69-b441-521c6a1737dd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.089112 Apr 02 20:55:25.125906 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 609/1100] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:25.136212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-af25b323-7299-496e-b9e2-2b3e991d818c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.150320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_groups [None req-af25b323-7299-496e-b9e2-2b3e991d818c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Querying cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) for 2 instances {{(pid=136518) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 02 20:55:25.151190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af25b323-7299-496e-b9e2-2b3e991d818c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.151643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af25b323-7299-496e-b9e2-2b3e991d818c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.166406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:25.173787 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a74cb44-9955-4dd4-955f-c3fc3041dda2 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.167036 Apr 02 20:55:25.174365 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 492/1101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:25.181296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-af25b323-7299-496e-b9e2-2b3e991d818c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/5f064ad4-7f4a-4ec0-91c2-9cb77201bda0" status: 200 len: 270 microversion: 2.1 time: 0.048568 Apr 02 20:55:25.182027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 610/1102] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/os-server-groups/5f064ad4-7f4a-4ec0-91c2-9cb77201bda0 => generated 270 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:25.192183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.192822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.198715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.199271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.200053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.200518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.332524 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07adbf35-cfd3-49c7-9d78-1e7c47662274 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1620 microversion: 2.1 time: 0.143953 Apr 02 20:55:25.333110 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 493/1103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1620 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:25.348221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.348856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.355173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.355623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.356383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.356849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.491986 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03f1bf32-b296-4807-9803-f0ab09bb8360 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1620 microversion: 2.1 time: 0.147421 Apr 02 20:55:25.492581 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 611/1104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1620 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:25.598026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-986807096", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "0adca561-7967-465d-a3e3-78a0dd5bb75d"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:25.647057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:55:25.666937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.667548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.673431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.673893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.674669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.675111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.808599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:25.817205 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0524ac8-f52f-4ea1-a828-a7edd20d4e4f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1471 microversion: 2.1 time: 0.154056 Apr 02 20:55:25.817812 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 612/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:25.833479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:25.833926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.839881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.840441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.841302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.841840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.864582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:55:25.865299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:55:25.865982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:55:25.867036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:55:25.867453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:25.877038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.877622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.878494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.879484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.897383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:55:25.902166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:55:25.906909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ad5b466-e3bf-49fd-9550-e5f171b6cdcc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474/action" status: 204 len: 0 microversion: 2.1 time: 0.077241 Apr 02 20:55:25.907623 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 613/1106] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:55:25 2022] POST /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:55:25.913999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:55:25.915913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.916361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:55:25.916772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:25.922785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.923268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.924027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:25.924546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:25.976807 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0a5dd36-bf01-49d5-a2d5-d41172b3bd32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.382478 Apr 02 20:55:25.977489 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 494/1107] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:55:25.987341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d981dcaf-4251-46c6-861e-fc4502c6650e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:25.988550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d981dcaf-4251-46c6-861e-fc4502c6650e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:26.045453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d981dcaf-4251-46c6-861e-fc4502c6650e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:26.053882 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d981dcaf-4251-46c6-861e-fc4502c6650e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1216 microversion: 2.1 time: 0.070338 Apr 02 20:55:26.054859 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 495/1108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:26.060505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:26.061485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:26.072292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:26.072843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:26.073636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:26.074074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:26.111479 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b030ac39-a34a-48bb-90a3-e6e26c80d150 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054118 Apr 02 20:55:26.112624 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 496/1109] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 20:55:26 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:26.144771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:26.145664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:26.153310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:26.153879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:26.154809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:26.155357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:26.197871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:26.218541 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc5fd6ca-b153-462c-97c7-563fb7250766 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1471 microversion: 2.1 time: 0.305892 Apr 02 20:55:26.220102 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 614/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:25 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1471 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:26.259046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:26.259574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:26.282009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:26.294310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:26.294958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:26.296247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:26.298780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:26.301092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:26.305422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:26.309792 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57f110c7-7160-4ce9-aa8f-62eb1acaae84 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.169336 Apr 02 20:55:26.316663 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 497/1111] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:26 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:26.515840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:26.531489 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2a0c659-3023-4ff6-85e5-441fe0e12528 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.296430 Apr 02 20:55:26.532929 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 615/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:26 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:27.072731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:27.073515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:27.080246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.080743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.081588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.082545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.123967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:27.125359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:27.132637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.133165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.133949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.134387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.147243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:27.158398 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34ad8d98-02d0-4fad-9604-2019eb52e42c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1268 microversion: 2.1 time: 0.089912 Apr 02 20:55:27.159916 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 498/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:27 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1268 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:27.165866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b6a491d-fa3d-47cf-a035-929e0bcf80e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045825 Apr 02 20:55:27.166597 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 616/1114] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 20:55:27 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 20:55:27.238044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:27.238664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:27.249777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.251507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.252519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.254809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.329083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:27.329913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:27.339004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.339689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.340774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.350819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.426459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:27.436408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:27.438445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:27.439852 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4de32373-98cf-4e0b-82f4-9bd816949831 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.114746 Apr 02 20:55:27.441746 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 617/1115] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:27 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:27.559129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:27.559788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:27.561871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:27.571254 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ecfbd7e-e90f-4cf1-bf53-246f0dd492dc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1471 microversion: 2.1 time: 0.337339 Apr 02 20:55:27.588870 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 499/1116] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:27 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:27.592685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.593281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.594131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.594579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.681727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-21c5d1d2-5bd2-487b-b703-19b9eaefe999 req-147c7a4a-eb40-4518-9c19-a739d2e6c0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28074b2-b820-4fa1-8693-1ff7cf91a474", "name": "network-vif-plugged", "status": "completed", "tag": "26f419c3-bf0c-45a0-a419-019238f49182"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:27.710713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-21c5d1d2-5bd2-487b-b703-19b9eaefe999 req-147c7a4a-eb40-4518-9c19-a739d2e6c0f5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:27.717218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-21c5d1d2-5bd2-487b-b703-19b9eaefe999 req-147c7a4a-eb40-4518-9c19-a739d2e6c0f5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:27.758109 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-21c5d1d2-5bd2-487b-b703-19b9eaefe999 req-147c7a4a-eb40-4518-9c19-a739d2e6c0f5 service nova] Creating event network-vif-plugged:26f419c3-bf0c-45a0-a419-019238f49182 for instance c28074b2-b820-4fa1-8693-1ff7cf91a474 on nch1-master-1 Apr 02 20:55:27.767291 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-21c5d1d2-5bd2-487b-b703-19b9eaefe999 req-147c7a4a-eb40-4518-9c19-a739d2e6c0f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088768 Apr 02 20:55:27.769871 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 500/1117] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:27.945303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:27.954728 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-511d6b7a-3a4d-4d6a-b86b-620f8e55d454 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.407990 Apr 02 20:55:27.957264 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 618/1118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:27 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:28.180471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:28.183685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:28.198360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.200206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.201092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.201615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.460056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:28.460720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:28.474422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.475124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.476108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.477320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.559657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:28.567869 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-013792ca-0658-4720-b07c-f6d063609de4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.396018 Apr 02 20:55:28.571456 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 501/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:28 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:28.588130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:28.589133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:28.599622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.601949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.602925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.607402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.710154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:28.724970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:28.728591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:28.733507 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8be2fcf-4806-4157-b537-5dd590e4f2bc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.277993 Apr 02 20:55:28.734320 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 619/1120] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:28 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:28.976380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:28.977948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:28.990312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.991119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:28.992736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:28.995191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.214398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:29.222422 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-06a71605-fb12-48ff-ac8e-59a939185833 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1463 microversion: 2.1 time: 0.637811 Apr 02 20:55:29.224625 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 502/1121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:28 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1463 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:29.243821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:29.246477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:29.267237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.267720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.268579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.274011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.535898 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41373f51-f1d2-4866-8149-e0c673ff82ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1614 microversion: 2.1 time: 0.300225 Apr 02 20:55:29.550094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 503/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:29 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1614 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:29.571703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e521b298-dbef-43d7-bb62-9a05e8a75eb4 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '.version_select at 0x7f54d4c164c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:29.575039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e521b298-dbef-43d7-bb62-9a05e8a75eb4 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.575825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e521b298-dbef-43d7-bb62-9a05e8a75eb4 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.587261 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e521b298-dbef-43d7-bb62-9a05e8a75eb4 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.025371 Apr 02 20:55:29.588883 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 504/1123] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:55:29 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:29.594707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:29.595656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:29.603398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.604210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.605354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.606012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.679559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:29.694800 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c94c250-6fa5-48ed-b27d-82c68e78eacf tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.724875 Apr 02 20:55:29.706899 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 620/1124] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:28 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:29.756207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:29.758817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:29.769891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.771245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.772854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:29.774636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:29.885328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:29.898970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:29.900562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:29.902608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b30f983d-9345-46bd-ace7-b3686c075cdf tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.150660 Apr 02 20:55:29.904273 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 621/1125] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:29 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:29.911455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-283183860", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:29.913106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:29.920668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-54b6df19-d0e2-49c1-97f3-28e0b4b4b0a5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.330508 Apr 02 20:55:29.921255 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 505/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:29 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:29.973873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:55:29.999422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-836c93c3-abbe-4647-b685-e813c7f9c1ca req-7f5bd723-fb0e-45dc-b1b8-267d92f9b026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd846a15-f5e0-4225-86ac-1616ce4995b2", "tag": "e5923ad5-b88a-4951-8f88-e4d0130bec3f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:30.012294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-836c93c3-abbe-4647-b685-e813c7f9c1ca req-7f5bd723-fb0e-45dc-b1b8-267d92f9b026 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.016642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-836c93c3-abbe-4647-b685-e813c7f9c1ca req-7f5bd723-fb0e-45dc-b1b8-267d92f9b026 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.031215 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-836c93c3-abbe-4647-b685-e813c7f9c1ca req-7f5bd723-fb0e-45dc-b1b8-267d92f9b026 service nova] Creating event network-changed:e5923ad5-b88a-4951-8f88-e4d0130bec3f for instance bd846a15-f5e0-4225-86ac-1616ce4995b2 on nch1-master-1 Apr 02 20:55:30.037039 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-836c93c3-abbe-4647-b685-e813c7f9c1ca req-7f5bd723-fb0e-45dc-b1b8-267d92f9b026 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041194 Apr 02 20:55:30.039156 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 506/1127] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:30.341765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:55:30.342231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:55:30.342715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:55:30.343133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:55:30.343554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:30.354261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.354721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.355542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.356069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.379603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:55:30.386703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for user c1d982c5db7e47a6ae521f2137af3204 and project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:55:30.401569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:55:30.405275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:55:30.464736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0486766d-eba5-4c3f-99f9-c93a71bd86f3"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:30.471225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b4a47fa-a56b-4f74-8b8e-237223d67b35 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564806 Apr 02 20:55:30.471885 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 622/1128] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:55:30.479086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:30.483227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-472ac9ab-6cc5-4fbd-a18b-955ab7e19196 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:30.483967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-472ac9ab-6cc5-4fbd-a18b-955ab7e19196 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:30.523182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.534586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.535737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.536338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.567656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-472ac9ab-6cc5-4fbd-a18b-955ab7e19196 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:30.577653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-472ac9ab-6cc5-4fbd-a18b-955ab7e19196 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1212 microversion: 2.1 time: 0.097833 Apr 02 20:55:30.579760 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 623/1129] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:30 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:30.715525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:30.716258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:30.725707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.726666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.727788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.728770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.908431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b276f39-88c8-4ca9-a687-dd912c5824c6 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "POST /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448634 Apr 02 20:55:30.911821 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 507/1130] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 20:55:30 2022] POST /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:30.929374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:30.930392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:30.943348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.944770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.946362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:30.947527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:30.988370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:30.996488 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c6aaef0-d5dd-4919-8a94-20d52a01d6ec tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.287232 Apr 02 20:55:30.997075 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 624/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:30 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:31.007455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:31.008078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:31.037521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:31.038024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:31.038950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:31.039272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:31.084544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:31.097662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:31.099375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:31.102518 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b5f6c73-a7ff-41d7-b5c9-ae1410c7df81 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.182622 Apr 02 20:55:31.106151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 508/1132] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:30 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:31.239106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:31.257980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d54c457-16a2-4c33-b29a-6d34e5c28af7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.255942 Apr 02 20:55:31.258573 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 625/1133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:30 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:31.514258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-62adae20-93e5-4f45-a5e2-f429861e031d req-dd583745-ee32-4a47-b821-283a29be238a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787d3f16-a1b9-4630-a900-2f5421dd1214", "name": "network-vif-plugged", "status": "completed", "tag": "fa794201-c166-4b87-89ae-d05e98fa82ec"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:31.529818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-62adae20-93e5-4f45-a5e2-f429861e031d req-dd583745-ee32-4a47-b821-283a29be238a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:31.530209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-62adae20-93e5-4f45-a5e2-f429861e031d req-dd583745-ee32-4a47-b821-283a29be238a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:31.544175 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-62adae20-93e5-4f45-a5e2-f429861e031d req-dd583745-ee32-4a47-b821-283a29be238a service nova] Creating event network-vif-plugged:fa794201-c166-4b87-89ae-d05e98fa82ec for instance 787d3f16-a1b9-4630-a900-2f5421dd1214 on nch1-master-1 Apr 02 20:55:31.553815 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-62adae20-93e5-4f45-a5e2-f429861e031d req-dd583745-ee32-4a47-b821-283a29be238a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044426 Apr 02 20:55:31.557411 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 509/1134] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:31.595038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:31.598915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:31.608793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:31.609555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:31.610497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:31.611096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:31.687036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:31.697280 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e902604a-aa63-49bc-93b0-d76e9bd03b97 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1264 microversion: 2.1 time: 0.105929 Apr 02 20:55:31.697873 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 626/1135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:31 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1264 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:32.016121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:32.016931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:32.023728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.024332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.025277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.026063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.126507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:32.127809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:32.135846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.136555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.137359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.137804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.229392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:32.235573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:32.242540 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2679ea03-c503-4c4e-9659-dce6bf5a27ed tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.231173 Apr 02 20:55:32.244865 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 510/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:32 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:32.247348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:32.248928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:32.250180 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e3c2c91-5550-4eda-9aeb-6d5e2320ee43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.128946 Apr 02 20:55:32.251057 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 627/1137] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:32 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:32.274516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:32.275276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:32.281768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.282732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.283858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.284335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.432272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:32.443290 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d753f29e-239e-49cc-a9ba-8eca43739426 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.169944 Apr 02 20:55:32.443290 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 511/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:32 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:32.717443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:32.718945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:32.728837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.729500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:32.730460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:32.731063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.022248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:33.030574 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5e06bfd9-8af8-4514-acd9-b5c7889df59d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.318660 Apr 02 20:55:33.031241 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 628/1139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:32 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:33.260703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:33.261342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:33.272034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:33.276880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.277335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.278119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.278553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.279464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:33.288346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.288834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.289619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.290060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.443001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:33.458399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:33.459917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:33.465596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2d3a2d21-7a0a-4cc4-902c-edde6157cf3b tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.199102 Apr 02 20:55:33.466180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 629/1140] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:33 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:33.480428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:33.481893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:33.495823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.496961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.501075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.502124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.509970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:33.534178 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7da0ee93-4734-49ba-927f-28de14ce310b tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1323 microversion: 2.1 time: 0.267710 Apr 02 20:55:33.538071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 512/1141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:33 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:33.686157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-69a1c580-bfca-40cd-98fd-7f05504a23f8 req-c4736ffd-f886-4ce2-a6bd-580f3c655227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9660b921-cb0b-4244-9f7b-c0bfbd321bfe", "tag": "c04f176b-9717-4cb2-9621-f8e89d6031ec"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:33.733065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-69a1c580-bfca-40cd-98fd-7f05504a23f8 req-c4736ffd-f886-4ce2-a6bd-580f3c655227 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:33.733832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-69a1c580-bfca-40cd-98fd-7f05504a23f8 req-c4736ffd-f886-4ce2-a6bd-580f3c655227 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:33.762283 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-69a1c580-bfca-40cd-98fd-7f05504a23f8 req-c4736ffd-f886-4ce2-a6bd-580f3c655227 service nova] Creating event network-changed:c04f176b-9717-4cb2-9621-f8e89d6031ec for instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe on nch2-master-1 Apr 02 20:55:33.768442 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-69a1c580-bfca-40cd-98fd-7f05504a23f8 req-c4736ffd-f886-4ce2-a6bd-580f3c655227 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087571 Apr 02 20:55:33.769217 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 513/1142] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:33.833409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:33.844554 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-124888d7-3a5f-4de5-bbc9-5c7dc6bd1d0b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.374006 Apr 02 20:55:33.845151 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 630/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:33 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:34.066332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.067139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.076054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.077507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.077639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.079573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.227925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:34.237027 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c99ed4d5-4059-477b-80e9-a666c5749ae5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.182997 Apr 02 20:55:34.237990 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 514/1144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:34.381138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.382321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.388690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.389101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.390199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.390837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.423193 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0fb5233c-dd1b-4753-9238-92fd31de7e12 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Apr 02 20:55:34.424091 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 631/1145] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:34.434490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.435290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.458083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.458546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.459353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.459794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.487379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.488351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.496928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.497455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.498419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.499133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.573551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lazy-loading 'services' on Instance uuid 6ef4400c-3d15-43a5-89f9-79edac5020ce {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:55:34.604866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:34.613768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:34.615616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:34.616812 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18fa7935-966a-4767-aeb9-142408dea9f7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.134475 Apr 02 20:55:34.617358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 632/1146] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:34.622895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.623735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.634429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.635004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.635951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.636608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.657965 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8778b8ed-2dab-4a14-a0e9-346f13f43157 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments/0486766d-eba5-4c3f-99f9-c93a71bd86f3" status: 202 len: 0 microversion: 2.1 time: 0.227381 Apr 02 20:55:34.659495 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 515/1147] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 20:55:34 2022] DELETE /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments/0486766d-eba5-4c3f-99f9-c93a71bd86f3 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:55:34.863273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.864240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.864512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:34.870682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.871372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.872652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.873000 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-62ba69e4-22e6-4321-ae40-ddb5f6f4ddbe tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1519 microversion: 2.1 time: 0.254267 Apr 02 20:55:34.873151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.873919 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 633/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1519 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:34.893551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.894131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.900146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.900631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.901578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.902020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.933914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] HTTP exception thrown: Action 999 not found Apr 02 20:55:34.934576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Returning 404 to user: Action 999 not found {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:34.935418 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a892cdd-e7f8-4bcf-a055-f3c3fd5044a0 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.048548 Apr 02 20:55:34.936446 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 634/1149] 10.222.0.18 () {58 vars in 1307 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214/os-instance-actions/999 => generated 66 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:55:34.946825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bdca99dc-cdd2-4367-81b5-7f55c9613bd3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '.version_select at 0x7f54d47c6dc0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.947502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bdca99dc-cdd2-4367-81b5-7f55c9613bd3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 4e472cb8-45b7-4a4e-b13c-19baddf28fd7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.953722 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-bdca99dc-cdd2-4367-81b5-7f55c9613bd3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] HTTP exception thrown: Instance 4e472cb8-45b7-4a4e-b13c-19baddf28fd7 could not be found. Apr 02 20:55:34.954602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bdca99dc-cdd2-4367-81b5-7f55c9613bd3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Returning 404 to user: Instance 4e472cb8-45b7-4a4e-b13c-19baddf28fd7 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:34.955658 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bdca99dc-cdd2-4367-81b5-7f55c9613bd3 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/4e472cb8-45b7-4a4e-b13c-19baddf28fd7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013249 Apr 02 20:55:34.956498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 635/1150] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/4e472cb8-45b7-4a4e-b13c-19baddf28fd7/os-instance-actions => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:55:34.967836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:34.968651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:34.975404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.976396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:34.977689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:34.978298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.007473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:55:35.099005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:35.110636 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f872ec87-0181-4d5a-8d52-5b627631af6a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.252095 Apr 02 20:55:35.111470 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 516/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:34 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:35.253562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:35.254222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:35.260695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.261150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.261936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.262390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.303137 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-308c5527-e55a-4c2f-826c-012b7a6d2266 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 204 len: 0 microversion: 2.1 time: 0.339979 Apr 02 20:55:35.306365 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 636/1152] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:34 2022] DELETE /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:55:35.317350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:35.319403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:35.329951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.331498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.333184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.333826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.434982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:35.450879 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32adee70-0364-48ca-ad64-39483fa7f425 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.201154 Apr 02 20:55:35.451945 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 517/1153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:35 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:35.534099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:35.563541 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61bbf7cf-4494-4ec4-a487-f2cc5bf0793c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1525 microversion: 2.1 time: 0.252511 Apr 02 20:55:35.564120 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 637/1154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:35 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1525 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:35.635273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:35.635843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:35.642431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.642899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.643903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.645055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.723321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:35.733316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:35.734865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:35.736138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-69e83b44-82e0-4b33-b3ed-7326f77163cc tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.104767 Apr 02 20:55:35.736624 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 518/1155] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:35 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:35.821934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:35.823736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:35.831024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.832110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.833826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.833826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.866997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2ca9627-525c-4f6a-9d05-e8da6b61d889 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050464 Apr 02 20:55:35.868131 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 638/1156] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 20:55:35 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:55:35.926253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:35.927308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:35.934137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.934817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.935600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:35.936047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:35.970276 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be7d4e2f-03ae-4daa-a006-2d6535db6890 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047951 Apr 02 20:55:35.970874 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 519/1157] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 20:55:35 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:55:36.030692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:36.031581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:36.041807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.042977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.043847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.044323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.077827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:55:36.128210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:36.129903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:36.137973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.138560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.139487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.140279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.175451 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c206827d-53cc-477c-8bf0-d7f82fb49ca9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 204 len: 0 microversion: 2.1 time: 0.148034 Apr 02 20:55:36.180753 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 639/1158] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:36 2022] DELETE /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:55:36.189927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:36.190643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:36.197397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.197860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.198648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.199095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.300281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.313287 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a6582a5-1eda-400b-9412-75b061508613 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.188670 Apr 02 20:55:36.314260 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 520/1159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:36 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:36.360981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.370097 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-04a0bd52-6875-482c-a34d-c6b295289aa8 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1680 microversion: 2.1 time: 0.184639 Apr 02 20:55:36.370692 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 640/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:36 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:36.468256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:36.469073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:36.477033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.477962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.479051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.479497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.586341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:36.587519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:36.594712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.595166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.596497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.597116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.631011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.640534 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb12a350-37c1-4b29-8b9e-1858d089aaa0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.176024 Apr 02 20:55:36.644548 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 521/1161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:36 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:36.754704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:36.755331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:36.755603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.761895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.762354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.763248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:36.763553 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-84a8baa5-63e7-4c7f-abff-25563459b67c tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1525 microversion: 2.1 time: 0.181623 Apr 02 20:55:36.763718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:36.773140 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 641/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:36 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:36.829578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.837468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.839063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:36.840243 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-089a8189-fbd3-4313-9617-bbced2a0f8da tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.089799 Apr 02 20:55:36.840908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 522/1163] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:36 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:37.330456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:37.331062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:37.337684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.338141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.338917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.339352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.389432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:37.390061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:37.402275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.402757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.403561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.404011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.495542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:37.503388 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3bfa9122-e4ba-4b7e-8219-7cb90d2118f5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.176718 Apr 02 20:55:37.504502 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 642/1164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:37 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:37.640978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:37.652431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65fe6f9d-95ca-4fc0-9974-687e0bf05a24 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1680 microversion: 2.1 time: 0.267383 Apr 02 20:55:37.660590 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 523/1165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:37 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:37.665834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:37.669510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:37.685734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.686203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.688822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.689283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.781690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:37.782465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:37.793496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.794030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.794901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.795414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.847773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:37.857329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25119005-87e6-42a9-8f8f-1feff050a0fe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.203335 Apr 02 20:55:37.857915 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 643/1166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:37 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:37.862473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:37.863114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:37.869132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.869521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.870347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:37.870792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:37.945860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:37.956042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:37.958513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:37.960251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5fd94d3-ebf7-43e4-8858-8f7df8e50da8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.101393 Apr 02 20:55:37.961134 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 644/1167] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:37 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:38.103570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ce1c27f7-d582-410b-b7bf-33c08fc0cbec req-0122f016-478c-4d78-b29f-493fa2810dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787d3f16-a1b9-4630-a900-2f5421dd1214", "name": "network-vif-deleted", "tag": "fa794201-c166-4b87-89ae-d05e98fa82ec"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:38.112711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d64769b0374642a462d10d4ff49f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78889a02e6054dd49c29b72fc422e9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:38.117824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ce1c27f7-d582-410b-b7bf-33c08fc0cbec req-0122f016-478c-4d78-b29f-493fa2810dc7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.118459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ce1c27f7-d582-410b-b7bf-33c08fc0cbec req-0122f016-478c-4d78-b29f-493fa2810dc7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.123748 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d82af9c-a231-47f2-999e-c35c4ed2a617 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 200 len: 1525 microversion: 2.1 time: 0.346762 Apr 02 20:55:38.124296 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 524/1168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:37 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 1525 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:38.140213 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ce1c27f7-d582-410b-b7bf-33c08fc0cbec req-0122f016-478c-4d78-b29f-493fa2810dc7 service nova] Creating event network-vif-deleted:fa794201-c166-4b87-89ae-d05e98fa82ec for instance 787d3f16-a1b9-4630-a900-2f5421dd1214 on nch1-master-1 Apr 02 20:55:38.147204 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ce1c27f7-d582-410b-b7bf-33c08fc0cbec req-0122f016-478c-4d78-b29f-493fa2810dc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053683 Apr 02 20:55:38.149005 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 645/1169] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:38.520835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:38.521975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:38.529398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.530168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.531227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.531897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.679395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:38.680965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:38.689200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.689758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.690617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.691788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.720696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:38.731629 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b9c42cf-82ca-4511-affb-519b94eef3ad tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.214756 Apr 02 20:55:38.733190 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 525/1170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:38 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:38.877519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:38.880049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:38.904948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.904948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.904948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.905591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.973620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf5e0bd625644d9eabf92db0624219e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2a80eb708d4a2b8aab54b268dc218d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:38.982166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-755514dd-abab-4e4f-bdb9-631560aee916 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 200 len: 1680 microversion: 2.1 time: 0.309231 Apr 02 20:55:38.983338 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 646/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:38 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:38.988892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:38.989713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:38.997319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.998167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:38.998983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:38.999581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:39.076885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:39.088020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:39.090217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:39.091859 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-17fc98fb-65af-4c2b-a6a1-5163f71771d0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.107398 Apr 02 20:55:39.093077 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 647/1172] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:38 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:39.106736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:39.114854 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bd0940b-30df-40ad-ba8e-05b2d64239cc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.243260 Apr 02 20:55:39.115435 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 526/1173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:38 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:39.141922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:39.142474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] [instance: 787d3f16-a1b9-4630-a900-2f5421dd1214] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:39.149737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:39.150455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:39.152285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:39.152773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:39.168503 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] HTTP exception thrown: Instance 787d3f16-a1b9-4630-a900-2f5421dd1214 could not be found. Apr 02 20:55:39.169498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] Returning 404 to user: Instance 787d3f16-a1b9-4630-a900-2f5421dd1214 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:39.170366 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7080abf8-3235-4543-962e-172c7c621b31 tempest-InstanceActionsNegativeTestJSON-1553538928 tempest-InstanceActionsNegativeTestJSON-1553538928-project] 10.222.0.18 "GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214" status: 404 len: 111 microversion: 2.1 time: 0.032913 Apr 02 20:55:39.170941 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 648/1174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:39 2022] GET /compute/v2.1/servers/787d3f16-a1b9-4630-a900-2f5421dd1214 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:39.335004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b0cd97d5-4d0c-4e78-85d0-03a7c054e214 req-99106cd7-28e0-4aa2-bf54-d97f4a1170f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef4400c-3d15-43a5-89f9-79edac5020ce", "name": "network-vif-deleted", "tag": "d783c05e-b460-4890-8989-48914b4b5820"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:39.357667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b0cd97d5-4d0c-4e78-85d0-03a7c054e214 req-99106cd7-28e0-4aa2-bf54-d97f4a1170f3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:39.358250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b0cd97d5-4d0c-4e78-85d0-03a7c054e214 req-99106cd7-28e0-4aa2-bf54-d97f4a1170f3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:39.393426 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b0cd97d5-4d0c-4e78-85d0-03a7c054e214 req-99106cd7-28e0-4aa2-bf54-d97f4a1170f3 service nova] Creating event network-vif-deleted:d783c05e-b460-4890-8989-48914b4b5820 for instance 6ef4400c-3d15-43a5-89f9-79edac5020ce on nch2-master-1 Apr 02 20:55:39.414088 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b0cd97d5-4d0c-4e78-85d0-03a7c054e214 req-99106cd7-28e0-4aa2-bf54-d97f4a1170f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078485 Apr 02 20:55:39.415738 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 527/1175] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:39.627958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3791fcdf-cc13-4719-bb4f-719bf8574453 req-06845abb-489a-43d1-bb28-2510cc03b96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd846a15-f5e0-4225-86ac-1616ce4995b2", "name": "network-vif-plugged", "status": "completed", "tag": "e5923ad5-b88a-4951-8f88-e4d0130bec3f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:39.640169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3791fcdf-cc13-4719-bb4f-719bf8574453 req-06845abb-489a-43d1-bb28-2510cc03b96a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:39.643703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3791fcdf-cc13-4719-bb4f-719bf8574453 req-06845abb-489a-43d1-bb28-2510cc03b96a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:39.657096 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3791fcdf-cc13-4719-bb4f-719bf8574453 req-06845abb-489a-43d1-bb28-2510cc03b96a service nova] Creating event network-vif-plugged:e5923ad5-b88a-4951-8f88-e4d0130bec3f for instance bd846a15-f5e0-4225-86ac-1616ce4995b2 on nch1-master-1 Apr 02 20:55:39.662806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3791fcdf-cc13-4719-bb4f-719bf8574453 req-06845abb-489a-43d1-bb28-2510cc03b96a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039049 Apr 02 20:55:39.663810 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 649/1176] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:39.762039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:39.763680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:39.773593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:39.775499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:39.779212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:39.780492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.000673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:40.002105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:40.013520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:40.013982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.014770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:40.015212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.057239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] HTTP exception thrown: Instance 6ef4400c-3d15-43a5-89f9-79edac5020ce could not be found. Apr 02 20:55:40.057868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Returning 404 to user: Instance 6ef4400c-3d15-43a5-89f9-79edac5020ce could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:40.058801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9134eddd-f092-429d-b06d-3670b67a16a7 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 404 len: 111 microversion: 2.1 time: 0.062948 Apr 02 20:55:40.060079 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 650/1177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:39 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:40.078386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-706ca97f-7f78-4400-9d5f-875519e2abf9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '.version_select at 0x7f54d48f33a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:40.092557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:40.101521 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7739ebc7-2877-414c-ae1a-794387a80a1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.354692 Apr 02 20:55:40.103172 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 528/1178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:39 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:40.114229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:40.115427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:40.123559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:40.124325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.126056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:40.126721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.126991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-706ca97f-7f78-4400-9d5f-875519e2abf9 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414920512" status: 202 len: 0 microversion: 2.1 time: 0.061858 Apr 02 20:55:40.128235 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 651/1179] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1414920512 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:55:40.134476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:40.135711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:40.143473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:40.144233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.145304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:40.146319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:40.336020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:40.348214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:40.350472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:40.352670 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e2f98a5-ff0e-40ad-82be-821a13ca548e tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.243899 Apr 02 20:55:40.354160 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 529/1180] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:40 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:40.493872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:40.509744 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-391b4eea-49ac-44af-b18c-cf18ce094bbe tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.375390 Apr 02 20:55:40.510417 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 652/1181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:40 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:41.120185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:41.121278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:41.129622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.130201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.130929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.131373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.369409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:41.380798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:41.382880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:41.394363 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3141ae32-d0b9-463c-9ea4-af784574382b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1316 microversion: 2.1 time: 0.278344 Apr 02 20:55:41.396665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.397198 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 530/1182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:41 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:41.398154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.399195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.399918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.484383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:41.495491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:41.498034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:41.500086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1810fdc6-408c-43ee-833f-bd2ecfe9fe53 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.129025 Apr 02 20:55:41.501686 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 653/1183] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:41 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:41.529441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:41.530062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:41.538153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.538613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.539404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.539906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.686014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-64cb8d58-7913-4fae-aefb-534803a62367 req-770da9e6-3748-4484-8305-d6b49d559325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9660b921-cb0b-4244-9f7b-c0bfbd321bfe", "name": "network-vif-plugged", "status": "completed", "tag": "c04f176b-9717-4cb2-9621-f8e89d6031ec"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:41.696048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-64cb8d58-7913-4fae-aefb-534803a62367 req-770da9e6-3748-4484-8305-d6b49d559325 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.697954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-64cb8d58-7913-4fae-aefb-534803a62367 req-770da9e6-3748-4484-8305-d6b49d559325 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.699766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:41.710505 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07d62562-3050-4ce5-9c0b-068fe321e327 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.185803 Apr 02 20:55:41.711104 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 531/1184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:41 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:41.724081 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-64cb8d58-7913-4fae-aefb-534803a62367 req-770da9e6-3748-4484-8305-d6b49d559325 service nova] Creating event network-vif-plugged:c04f176b-9717-4cb2-9621-f8e89d6031ec for instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe on nch2-master-1 Apr 02 20:55:41.731849 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-64cb8d58-7913-4fae-aefb-534803a62367 req-770da9e6-3748-4484-8305-d6b49d559325 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049517 Apr 02 20:55:41.733883 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 654/1185] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:41.932705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:41.933444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:41.947543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.948106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.949321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:41.950070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:41.992571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:55:42.110087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72e504d0-2dbc-4eaa-b245-f8417ec7f74b tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 204 len: 0 microversion: 2.1 time: 0.181399 Apr 02 20:55:42.118107 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 532/1186] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:41 2022] DELETE /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:55:42.127029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:42.128028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:42.135835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.136631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.137838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.138524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.412522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:42.413864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:42.421093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.421843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.422853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.423505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.440932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:42.450891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-990f8c92-2b17-4071-aba7-30b5a9327f8e tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1665 microversion: 2.1 time: 0.327969 Apr 02 20:55:42.452193 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 655/1187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:42 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1665 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:42.521262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:42.521808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:42.534362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.535598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.536574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.537165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.587981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:42.598470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1eb0e94a-4a9a-4b02-83cc-7c5c5e3491b7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1466 microversion: 2.1 time: 0.189123 Apr 02 20:55:42.599639 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 533/1188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:42 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1466 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:42.615623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:42.616251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:42.623195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.623659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.624501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.624972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.626144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:42.656969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:42.661667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:42.664182 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be1430c1-1819-406d-9692-908dff59ae74 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.148906 Apr 02 20:55:42.666897 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 656/1189] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:42 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:55:42.727853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:42.728645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:42.743505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.744298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.745226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:42.745685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:42.797761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-026490f0-3ee9-4c52-8f23-b2f30783b0c2 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1617 microversion: 2.1 time: 0.183305 Apr 02 20:55:42.797761 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 534/1190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:42 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1617 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:43.220024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-5947556", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:43.234662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:43.243824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32c7be54-bd80-4dc3-81b6-957952a7d591 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1312 microversion: 2.1 time: 0.519873 Apr 02 20:55:43.244920 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 657/1191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:42 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1312 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:43.257271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1802319975", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["0adca561-7967-465d-a3e3-78a0dd5bb75d"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:43.300760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] validate_networks() for [('2427a2f7-cca3-4878-92a4-fe77defc6f38', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:55:43.333313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:55:43.574775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:55:43.575291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:55:43.575802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:55:43.576266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:55:43.576940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:43.586708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.587454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.588541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.589237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.607382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:55:43.625645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:55:43.642953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:55:43.645537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:55:43.693762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b2b750e-89a5-4579-966d-428c388f47d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.442817 Apr 02 20:55:43.695066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 658/1192] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:55:43.703543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:43.704492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:43.712288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.712859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.713732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.714241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.722167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:55:43.723142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:55:43.729216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:55:43.729921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:55:43.732061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:43.752892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.754093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.754972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.755480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.783534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Getting quotas for project 99e28f04f7dd4777891efe100377f141. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:55:43.789582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Getting quotas for user ee8c4a666eb94960b71b0353d32b5f67 and project 99e28f04f7dd4777891efe100377f141. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:55:43.808106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:55:43.810530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:55:43.873660 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ba9be4f-b1f2-4083-91b6-e644d499e563 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857766 Apr 02 20:55:43.874693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 535/1193] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:55:43.882040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:43.887265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:43.889156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:43.895192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.895816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.896653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.897259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.903262 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-395e9bb1-d9d4-4ed2-988f-41903cd693b7 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1665 microversion: 2.1 time: 0.206909 Apr 02 20:55:43.904639 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 659/1194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:43 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1665 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:43.913661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:43.914354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:43.922240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.922964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.923997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:43.924194 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] HTTP exception thrown: Instance 6ef4400c-3d15-43a5-89f9-79edac5020ce could not be found. Apr 02 20:55:43.924825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:43.928854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Returning 404 to user: Instance 6ef4400c-3d15-43a5-89f9-79edac5020ce could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:43.931151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e768a67-7b00-49d0-9091-f39946d77587 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 404 len: 111 microversion: 2.1 time: 0.052769 Apr 02 20:55:43.931929 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 536/1195] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:43 2022] DELETE /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:43.941237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51e2caba-24d4-44fa-b7c6-a29004c522df tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:43.948523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51e2caba-24d4-44fa-b7c6-a29004c522df tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.018236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-51e2caba-24d4-44fa-b7c6-a29004c522df tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.026224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.032355 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51e2caba-24d4-44fa-b7c6-a29004c522df tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1217 microversion: 2.1 time: 0.099183 Apr 02 20:55:44.037849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.039114 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 537/1196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:43 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:44.053299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f4507ff-5855-4b2c-ade2-669bdf15d7c2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:44.053922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f4507ff-5855-4b2c-ade2-669bdf15d7c2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.056509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.057747 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c683075a-f9ba-400c-915d-52900dfc3d43 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.151467 Apr 02 20:55:44.058620 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 660/1197] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:43 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:44.068989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:44.070182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] [instance: 6ef4400c-3d15-43a5-89f9-79edac5020ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.083090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.088198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.090719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.092630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.135778 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] HTTP exception thrown: Instance 6ef4400c-3d15-43a5-89f9-79edac5020ce could not be found. Apr 02 20:55:44.137439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] Returning 404 to user: Instance 6ef4400c-3d15-43a5-89f9-79edac5020ce could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:44.138359 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca9aa280-1fc1-4bbc-bc69-a0930c08df53 tempest-AttachSCSIVolumeTestJSON-1933708698 tempest-AttachSCSIVolumeTestJSON-1933708698-project] 10.222.0.18 "GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce" status: 404 len: 111 microversion: 2.1 time: 0.078504 Apr 02 20:55:44.144856 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 661/1198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:44 2022] GET /compute/v2.1/servers/6ef4400c-3d15-43a5-89f9-79edac5020ce => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:44.158592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f4507ff-5855-4b2c-ade2-669bdf15d7c2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.169234 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f4507ff-5855-4b2c-ade2-669bdf15d7c2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1214 microversion: 2.1 time: 0.120007 Apr 02 20:55:44.169822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 538/1199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:44 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:44.262427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:44.263872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.272368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.273383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.275332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.276146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.580095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.597072 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-baf2f68c-5162-4c30-a7a3-1f8591f67ec4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1461 microversion: 2.1 time: 0.338130 Apr 02 20:55:44.608842 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 662/1200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:44 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1461 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:44.618309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:44.619295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.649292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.653209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.654320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.654936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.658375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:44.659083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.669027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.669744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.673344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.673852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.719058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:55:44.795175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:44.803292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Old instance type m1.heat2, new instance type m1.heat {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 20:55:44.819004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:55:44.822177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:55:44.822905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:55:44.824652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:55:44.825583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:55:44.857094 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5eb40a36-399a-421b-b246-f8f0f622de27 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "DELETE /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 204 len: 0 microversion: 2.1 time: 0.202172 Apr 02 20:55:44.858643 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 663/1201] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:44 2022] DELETE /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:55:44.878945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:44.879993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:44.899633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.900105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:44.900930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:44.901565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.018399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e647d207-573e-4b8d-acd2-12e9646bcc23 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe/action" status: 202 len: 0 microversion: 2.1 time: 0.405848 Apr 02 20:55:45.022815 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 539/1202] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:55:44 2022] POST /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:55:45.027895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:45.028557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:45.035594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:45.036078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.036902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:45.037350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.142374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:45.154199 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05936911-0453-45aa-8db4-17ecb6b79d16 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1710 microversion: 2.1 time: 0.289785 Apr 02 20:55:45.158293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 664/1203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:44 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1710 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:45.168733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:45.170701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:45.184683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:45.189068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.190060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:45.190636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.734663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:45.750677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f41c4e7-8f81-4dbd-b2f6-3e74f0ce95bc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1470 microversion: 2.1 time: 0.591142 Apr 02 20:55:45.751779 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 665/1204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:45 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:45.782086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:45.785013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:45.807494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:45.824425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.828950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:45.831113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:45.969093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:45.984031 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f99cfc1d-4963-41a0-8ee7-b80832abd435 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1275 microversion: 2.1 time: 0.214265 Apr 02 20:55:45.996393 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 666/1205] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:45 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1275 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:46.002731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:46.004012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:46.013896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.014360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.015272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.015727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.141262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:46.150250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:46.160765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:46.165157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:46.166420 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a3eecf91-2cd5-4365-9213-2b2de67fab19 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.168918 Apr 02 20:55:46.167001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 667/1206] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:45 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:46.169252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ce8835cd-5e5d-4974-8aeb-7fa8f5074262 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1665 microversion: 2.1 time: 1.144032 Apr 02 20:55:46.170545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 540/1207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:45 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1665 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:46.183640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:46.184106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:46.184271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:46.185007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:46.204179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.204685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.205501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.205617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.205952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.206088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.210418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.211733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.313731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:46.323062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8f8de42-8f9d-4ca7-a5f3-59ee6ae4c65f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1272 microversion: 2.1 time: 0.149046 Apr 02 20:55:46.323667 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 668/1208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:46 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:46.769440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:46.770871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:46.779140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.780097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:46.781354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:46.782089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.026692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.037110 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0af0db84-f1dc-4c93-b063-cf213bdc3ca5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1710 microversion: 2.1 time: 0.865263 Apr 02 20:55:47.037701 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 541/1209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:46 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1710 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:47.061802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:47.062446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:47.070241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.071254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.076722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.079128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.237163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.257396 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e9442b18-1608-42a0-a867-bab7e7726781 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1275 microversion: 2.1 time: 0.212346 Apr 02 20:55:47.258895 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 542/1210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:47 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:47.277590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:47.279260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:47.279660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.299071 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-feebc658-3993-4a0d-93ce-5386b9b083d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1470 microversion: 2.1 time: 0.523207 Apr 02 20:55:47.299971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 669/1211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:46 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1470 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:47.304586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.305064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.306242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:47.307327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:47.308859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.310014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.324945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.325542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.326465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.327230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.626500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.655135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.667938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.671801 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-403955e4-c27c-4930-8893-d267fd0c44b3 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.407707 Apr 02 20:55:47.678674 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 543/1212] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:47 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:47.695070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:47.698251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:47.733949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.736080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.743410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.748444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.780231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d48665a950454aa634b35c21bbb279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d12a2c8ad9a43f2bded1c2804915030', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:47.789444 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33bd81b1-07d3-4ff2-81a4-ddd9e60d91c5 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 200 len: 1597 microversion: 2.1 time: 0.487604 Apr 02 20:55:47.793088 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 670/1213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:47 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 1597 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:47.808191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2f64b727-0715-4303-8200-f1a2e86a7c12 req-3746c23f-11d8-4536-b4b4-78e3af0ddae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a9702c7-3cb0-4764-bfad-98cdc6767f2d", "name": "network-vif-deleted", "tag": "4037f3ad-46a9-4e66-8974-76920ca5320b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:47.829394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2f64b727-0715-4303-8200-f1a2e86a7c12 req-3746c23f-11d8-4536-b4b4-78e3af0ddae6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:47.830251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2f64b727-0715-4303-8200-f1a2e86a7c12 req-3746c23f-11d8-4536-b4b4-78e3af0ddae6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:47.858902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2f64b727-0715-4303-8200-f1a2e86a7c12 req-3746c23f-11d8-4536-b4b4-78e3af0ddae6 service nova] Creating event network-vif-deleted:4037f3ad-46a9-4e66-8974-76920ca5320b for instance 0a9702c7-3cb0-4764-bfad-98cdc6767f2d on nch1-master-1 Apr 02 20:55:47.865121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2f64b727-0715-4303-8200-f1a2e86a7c12 req-3746c23f-11d8-4536-b4b4-78e3af0ddae6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069894 Apr 02 20:55:47.866389 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 671/1214] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:48.058009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:48.059002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:48.068906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:48.073746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:48.074692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:48.075177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:48.668327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:48.677351 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4fe28ac2-e974-4126-8ba3-eead9f57d06a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1710 microversion: 2.1 time: 0.624553 Apr 02 20:55:48.683180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 672/1215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:48 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1710 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:48.695271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:48.696255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:48.697734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:48.710935 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a3dc3a5-87c9-460b-a319-83aa55fc603e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 1.024599 Apr 02 20:55:48.712719 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 544/1216] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:47 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:48.713590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:48.714662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:48.715828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:48.717522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:48.727864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:48.728567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:48.744612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:48.745255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:48.748253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:48.748955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.146589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:49.155301 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d851f6cd-7a91-48b6-bda4-690e2dd57c55 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.469700 Apr 02 20:55:49.159461 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 673/1217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:48 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:49.173177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:49.174137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:49.181194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.185679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.186755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.192435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.313956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:49.326278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:49.331480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:49.334171 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f267412f-088e-4fac-85a1-a03f9506eed8 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.172822 Apr 02 20:55:49.349430 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 674/1218] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:49 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:49.365134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:49.366052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] [instance: 0a9702c7-3cb0-4764-bfad-98cdc6767f2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:49.374764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.375409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.376393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.378160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.412787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] HTTP exception thrown: Instance 0a9702c7-3cb0-4764-bfad-98cdc6767f2d could not be found. Apr 02 20:55:49.413535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Returning 404 to user: Instance 0a9702c7-3cb0-4764-bfad-98cdc6767f2d could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:49.414525 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2c9267c-8bf0-463a-9cbf-4c884442bc0f tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d" status: 404 len: 111 microversion: 2.1 time: 0.063665 Apr 02 20:55:49.417164 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 675/1219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:49 2022] GET /compute/v2.1/servers/0a9702c7-3cb0-4764-bfad-98cdc6767f2d => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:49.427814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-063556e3-90a8-4ce8-8865-c034265b2606 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] Calling method '.version_select at 0x7f54d48f3040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:49.468797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-063556e3-90a8-4ce8-8865-c034265b2606 tempest-ServersTestFqdnHostnames-590094399 tempest-ServersTestFqdnHostnames-590094399-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558302494" status: 202 len: 0 microversion: 2.1 time: 0.047225 Apr 02 20:55:49.469750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 676/1220] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 20:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558302494 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:55:49.586215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4afa994e-e564-4e7e-97d1-e95cabfeca72 req-a7e9d463-fcab-4a6b-9030-139448ee7ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88c5184-0805-4677-a11d-4077b9465e11", "tag": "f4087e3e-4f59-4105-bdf5-e1707ada38cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:49.609827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4afa994e-e564-4e7e-97d1-e95cabfeca72 req-a7e9d463-fcab-4a6b-9030-139448ee7ed2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.610560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4afa994e-e564-4e7e-97d1-e95cabfeca72 req-a7e9d463-fcab-4a6b-9030-139448ee7ed2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.632744 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4afa994e-e564-4e7e-97d1-e95cabfeca72 req-a7e9d463-fcab-4a6b-9030-139448ee7ed2 service nova] Creating event network-changed:f4087e3e-4f59-4105-bdf5-e1707ada38cb for instance d88c5184-0805-4677-a11d-4077b9465e11 on nch2-master-1 Apr 02 20:55:49.652267 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4afa994e-e564-4e7e-97d1-e95cabfeca72 req-a7e9d463-fcab-4a6b-9030-139448ee7ed2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071494 Apr 02 20:55:49.653217 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 677/1221] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:55:49.703378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:49.704300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:49.725135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.725946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.726980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.727590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.884274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:49.894836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86c6abfd-ce7d-4b68-84b2-9da9f52bb9f6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1642 microversion: 2.1 time: 0.195043 Apr 02 20:55:49.904849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 678/1222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:49 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1642 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:49.909943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:49.910803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:49.930314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.930989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.931975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:49.932608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:49.942478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:49.950586 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d5f76db8-c24a-43c8-af51-421d7dc71831 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1470 microversion: 2.1 time: 1.236780 Apr 02 20:55:49.965963 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 545/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:48 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1470 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:50.176204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:50.176953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:50.188096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.189076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.191735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.193200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.445155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:50.453578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2255570b-5879-4947-ae2c-334c7417d978 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 0.547402 Apr 02 20:55:50.458535 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 679/1224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:49 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:50.469915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:50.470809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:50.483893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.487032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.488690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.501315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.582359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:50.591650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:50.593612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:50.595228 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2e9e325-25d1-42e0-bed6-bcf3face7f16 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.134527 Apr 02 20:55:50.607421 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 680/1225] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:50 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:50.869184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:50.883978 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0ea0937-845e-4744-a401-c8bb5e1e4721 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.708567 Apr 02 20:55:50.886768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 546/1226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:50 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:50.921830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:50.922810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:50.934465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.937063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.945363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.946200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.969183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:50.970527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:50.985884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.986760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:50.991176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:50.992497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:51.209658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42119999e6f40b487a7174dc5a7d617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde6bd005e3a4a25b63639832027ab85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:51.228566 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-845f20ca-fdc0-45e3-8eec-28959f8d55b8 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 200 len: 1642 microversion: 2.1 time: 0.311236 Apr 02 20:55:51.229771 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 681/1227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:50 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 1642 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:51.477729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:51.478601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:51.485528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:51.486927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:51.491058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:51.491785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:51.724668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:51.739908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c47caa3-733d-45a7-a160-44411da8a1bb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1470 microversion: 2.1 time: 0.774745 Apr 02 20:55:51.749315 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 547/1228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:50 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1470 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:51.755857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:51.756491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:51.785593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:51.793465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:51.797144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:51.797701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.029609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:52.051704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:52.058820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:52.065631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04013e12-8556-4ded-940f-69a987b66c98 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.312696 Apr 02 20:55:52.067822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 548/1229] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:51 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:52.096916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-14c6e4ef-69d6-47ca-a764-ae6842f48e4c req-efa74e72-54eb-4af0-8268-fb7592f9ba6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ac4213-e19d-4d5a-bbd3-7b0cd30d9738", "name": "network-vif-deleted", "tag": "a84128dc-caef-46d0-8071-fe3f7c4c4a81"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:52.119265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-14c6e4ef-69d6-47ca-a764-ae6842f48e4c req-efa74e72-54eb-4af0-8268-fb7592f9ba6b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.119994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-14c6e4ef-69d6-47ca-a764-ae6842f48e4c req-efa74e72-54eb-4af0-8268-fb7592f9ba6b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.158789 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-14c6e4ef-69d6-47ca-a764-ae6842f48e4c req-efa74e72-54eb-4af0-8268-fb7592f9ba6b service nova] Creating event network-vif-deleted:a84128dc-caef-46d0-8071-fe3f7c4c4a81 for instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 on nch1-master-1 Apr 02 20:55:52.173214 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-14c6e4ef-69d6-47ca-a764-ae6842f48e4c req-efa74e72-54eb-4af0-8268-fb7592f9ba6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088992 Apr 02 20:55:52.175127 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 549/1230] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:52.190069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:52.191805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:52.201197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.201853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.203039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.203881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.534975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:52.553117 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e35e7627-852f-419f-a304-eb489f3c482d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 1.081962 Apr 02 20:55:52.554335 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 682/1231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:51 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:55:52.560991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:52.573048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:52.604340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.604946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.605884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.606432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.627064 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 could not be found. Apr 02 20:55:52.629503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:52.631189 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a6f38e67-00c8-4e8d-a9e2-e85a2bae63f3 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 404 len: 111 microversion: 2.1 time: 0.075584 Apr 02 20:55:52.632329 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 683/1232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:52 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:52.646205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:52.646997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:52.660341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.661166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.662389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.663725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.699308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. Apr 02 20:55:52.700484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:52.701558 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-723c49fa-4c14-4fad-8e02-c727d3e6f4ac tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "DELETE /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 404 len: 111 microversion: 2.1 time: 0.064973 Apr 02 20:55:52.702977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 684/1233] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:52 2022] DELETE /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:52.718013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:52.720611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:52.732286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.732825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.733887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.734801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.763006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. Apr 02 20:55:52.764063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:52.765682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1668ae5-7f3a-4a77-b72a-714a9fbd42ff tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 404 len: 111 microversion: 2.1 time: 0.056446 Apr 02 20:55:52.766749 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 685/1234] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:52 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:52.774460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:52.775716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:52.789058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.792185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:52.793923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:52.794612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:53.157819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:53.182549 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c8cf3bb-85fe-4ade-95af-09e3c74b6769 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.997401 Apr 02 20:55:53.183412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 550/1235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:52 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:53.192123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8d07fb0a-e8e5-46d1-963f-fc197f4cc20d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '.version_select at 0x7f54d49bbaf0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:53.205099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:53.214832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0e9502c-b7cb-4430-b9d4-ef68c8b9c5b6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.446511 Apr 02 20:55:53.221421 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 686/1236] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:52 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:53.229880 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8d07fb0a-e8e5-46d1-963f-fc197f4cc20d tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511390929" status: 202 len: 0 microversion: 2.1 time: 0.045133 Apr 02 20:55:53.231156 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 551/1237] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 20:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1511390929 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:55:53.233290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:53.234408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:53.254121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:53.254595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:53.255415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:53.255854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:53.405217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:53.414536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:53.419851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:53.421450 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61345efe-8c41-4370-adfc-fa30c7f65361 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.198514 Apr 02 20:55:53.422401 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 687/1238] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:53 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:53.570360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:53.571152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:53.579730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:53.593159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:53.594198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:53.594789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:53.974843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:53.985961 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86d24ff7-ea8c-4f7f-82d1-af8c02275903 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 0.418831 Apr 02 20:55:53.990260 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 552/1239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:53 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:54.200947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:54.201480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:54.208820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.209535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.210494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.211102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.224602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a33dc06f-0f2f-44e9-bd62-4e4515a522b9 req-c843449d-e5d8-4339-b7a7-e19842db3bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a49b75f0-be94-47d7-bea0-defda75a9f43", "tag": "8aae08e3-d1ba-42cd-87c1-fbb358fdc29e"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:54.235557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a33dc06f-0f2f-44e9-bd62-4e4515a522b9 req-c843449d-e5d8-4339-b7a7-e19842db3bd6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.236010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a33dc06f-0f2f-44e9-bd62-4e4515a522b9 req-c843449d-e5d8-4339-b7a7-e19842db3bd6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.264520 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a33dc06f-0f2f-44e9-bd62-4e4515a522b9 req-c843449d-e5d8-4339-b7a7-e19842db3bd6 service nova] Creating event network-changed:8aae08e3-d1ba-42cd-87c1-fbb358fdc29e for instance a49b75f0-be94-47d7-bea0-defda75a9f43 on nch1-master-1 Apr 02 20:55:54.272815 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a33dc06f-0f2f-44e9-bd62-4e4515a522b9 req-c843449d-e5d8-4339-b7a7-e19842db3bd6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051831 Apr 02 20:55:54.274213 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 553/1240] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:54.298615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:54.301284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:54.309525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.310132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.311450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.311763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.516289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:54.532226 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f0a7e452-c540-4419-9bd4-0f0f9b2efab8 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.335087 Apr 02 20:55:54.533251 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 688/1241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:54 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:54.555209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:54.558168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:54.574381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.577896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.579026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:54.579646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:54.733145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:54.744560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:54.746716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:54.748307 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0536f2ac-b343-43b2-ace7-8bfb4cb20912 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.213789 Apr 02 20:55:54.749142 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 689/1242] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:54 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:54.841393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c98aeb16-6278-4958-8e41-617e06c31cf0 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:54.843127 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:55:54.843127 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:55:54.896900 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c98aeb16-6278-4958-8e41-617e06c31cf0 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1530115126" status: 202 len: 0 microversion: 2.1 time: 0.061447 Apr 02 20:55:54.901413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 690/1243] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:55:54 2022] DELETE /compute/v2.1/flavors/1530115126 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:55:54.907360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9e205b5a-fd8c-4419-8a2e-e0f738e67c2f tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:54.931373 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9e205b5a-fd8c-4419-8a2e-e0f738e67c2f tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5399 microversion: 2.1 time: 0.028072 Apr 02 20:55:54.932407 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 691/1244] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:55:54 2022] GET /compute/v2.1/flavors/detail => generated 5399 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:54.948536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0bac7bb-1238-4c33-a2aa-a21474b65e44 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:54.973675 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0bac7bb-1238-4c33-a2aa-a21474b65e44 tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/52101737" status: 202 len: 0 microversion: 2.1 time: 0.028956 Apr 02 20:55:54.978364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 692/1245] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 20:55:54 2022] DELETE /compute/v2.1/flavors/52101737 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:55:54.988296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2495f687-c950-4578-beff-0f47e35e812d tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.024570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2495f687-c950-4578-beff-0f47e35e812d tempest-ServersWithSpecificFlavorTestJSON-1405233828 tempest-ServersWithSpecificFlavorTestJSON-1405233828-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041765 Apr 02 20:55:55.038481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 693/1246] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:55:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:55.047479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.054360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.061855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.062512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.063761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.064311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.262027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:55.273066 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-239e805f-6238-4188-b79a-96bb75ca6f67 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.997314 Apr 02 20:55:55.273677 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 554/1247] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:54 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:55.288845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.290246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.296866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.297416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.298278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.298797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.317296 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 could not be found. Apr 02 20:55:55.317609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:55.318553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f3553c8-0f32-4262-91b0-1591ac42d7e5 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "DELETE /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 404 len: 111 microversion: 2.1 time: 0.034240 Apr 02 20:55:55.320380 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 555/1248] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:55 2022] DELETE /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:55:55.328892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.329849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.339796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:55.343703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.348360 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80922d88-a3a3-48e6-b14a-13ff8796161b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 0.308514 Apr 02 20:55:55.349166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.350166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.351496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.354486 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 694/1249] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:55 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:55.367111 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 could not be found. Apr 02 20:55:55.367786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:55.368668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e974ac0d-4f75-4bbf-891d-08248f7e2f71 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738" status: 404 len: 111 microversion: 2.1 time: 0.043786 Apr 02 20:55:55.369346 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 556/1250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:55 2022] GET /compute/v2.1/servers/86ac4213-e19d-4d5a-bbd3-7b0cd30d9738 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:55:55.377967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.379089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.386379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.387516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.388593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.389235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.406085 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. Apr 02 20:55:55.406785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:55.408096 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6fbb7cb1-7842-47b6-9629-7d0a3219090a tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "DELETE /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 404 len: 111 microversion: 2.1 time: 0.033975 Apr 02 20:55:55.411152 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 695/1251] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:55:55 2022] DELETE /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:55:55.422826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.423447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] [instance: 807e6da4-1b09-4731-9332-98dce9466b87] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.434822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.435596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.437050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.439118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.461859 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] HTTP exception thrown: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. Apr 02 20:55:55.462487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] Returning 404 to user: Instance 807e6da4-1b09-4731-9332-98dce9466b87 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:55:55.463444 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bca099ae-56d1-4956-9399-78931a1c1ce6 tempest-ServersWithSpecificFlavorTestJSON-89163153 tempest-ServersWithSpecificFlavorTestJSON-89163153-project] 10.222.0.18 "GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87" status: 404 len: 111 microversion: 2.1 time: 0.048466 Apr 02 20:55:55.464181 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 557/1252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:55 2022] GET /compute/v2.1/servers/807e6da4-1b09-4731-9332-98dce9466b87 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:55:55.551815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.552966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.565648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.570081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.573322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.586123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.768043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:55.768702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:55.781947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.788613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.788613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:55.790156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:55.951480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:55.964489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:55.965153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36e08d35-6196-441a-bce5-e2719a8c64cf tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.417440 Apr 02 20:55:55.966186 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 696/1253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:55 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:55.973487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:55.975323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:55.976858 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32153a51-d4d4-49bc-8793-d205a94ef304 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.213270 Apr 02 20:55:55.979219 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 558/1254] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:55 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:56.290979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:56.291704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:56.306938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:56.307670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:56.308764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:56.312342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:56.370172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:56.373463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:56.383888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:56.384733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:56.386273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:56.387073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:56.791673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:56.804758 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7b20c55-d5c2-465e-8d8e-e3b1d866236a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.517676 Apr 02 20:55:56.806072 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 697/1255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:56 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:56.892007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:56.904244 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5a7a3e74-ac0e-4a31-a491-56a5a9bd0609 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 0.540244 Apr 02 20:55:56.906368 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 559/1256] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:56 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:56.995023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:56.996076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:57.002262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:57.002870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:57.022539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.022969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.023311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.023912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.024112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.024753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.025844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.026515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.389987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:57.403510 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-38d99813-18cb-4a32-babb-de61851f36c3 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.422198 Apr 02 20:55:57.414060 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 698/1257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:56 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:57.419990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-52459724-8b48-4677-8275-b4651f1d7b51 req-c5e37a7b-8504-4611-acf1-6c0ebfde8951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88c5184-0805-4677-a11d-4077b9465e11", "name": "network-vif-plugged", "status": "completed", "tag": "f4087e3e-4f59-4105-bdf5-e1707ada38cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:55:57.430903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-52459724-8b48-4677-8275-b4651f1d7b51 req-c5e37a7b-8504-4611-acf1-6c0ebfde8951 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.431925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-52459724-8b48-4677-8275-b4651f1d7b51 req-c5e37a7b-8504-4611-acf1-6c0ebfde8951 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.451313 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-52459724-8b48-4677-8275-b4651f1d7b51 req-c5e37a7b-8504-4611-acf1-6c0ebfde8951 service nova] Creating event network-vif-plugged:f4087e3e-4f59-4105-bdf5-e1707ada38cb for instance d88c5184-0805-4677-a11d-4077b9465e11 on nch2-master-1 Apr 02 20:55:57.459690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-52459724-8b48-4677-8275-b4651f1d7b51 req-c5e37a7b-8504-4611-acf1-6c0ebfde8951 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043771 Apr 02 20:55:57.460970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 699/1258] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:55:57.588821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:57.602585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:57.604998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:57.606250 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-714215bd-95e0-4c29-81ab-a885e8b1959a tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.608236 Apr 02 20:55:57.611674 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 560/1259] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:56 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:57.854396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:57.856494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:57.881320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.882224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.883342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.884149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.937068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:57.937680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:57.952729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.953716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:57.955326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:57.957065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:58.558300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:58.574027 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc1f8b4d-e2fd-4bbe-8f75-eadb1f021e2f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.744281 Apr 02 20:55:58.593427 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 700/1260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:57 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:58.604875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:58.605508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:58.622625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:58.623142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:58.627385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:58.629739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:58.745341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:58.755699 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-70c8cf13-d111-4914-8ceb-0072363eb165 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1314 microversion: 2.1 time: 0.835343 Apr 02 20:55:58.756437 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 561/1261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:57 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:58.765181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:58.765458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:58.772702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:58.773168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:58.773961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:58.774407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:58.938016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:58.948009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:58.950258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:58.951913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a92fcd3f-828f-4b5e-ba3a-85881b4adaf5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.193399 Apr 02 20:55:58.952856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 562/1262] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:55:58 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:55:58.987862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:55:58.998899 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f77e476-bea1-4b76-b146-26b1874e8193 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.404352 Apr 02 20:55:59.004258 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 701/1263] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:58 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:55:59.599186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:59.599812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:59.612536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:59.613731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:59.616649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:59.619414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:59.775422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:55:59.776058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:55:59.787702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:59.788171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:55:59.791348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:55:59.792120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:00.256942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:00.269379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:00.278647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1ba4ab4-c130-44b4-ba7e-6a41ba9a882d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.684473 Apr 02 20:56:00.292157 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 563/1264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:59 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:00.299011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:00.302835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:00.306933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16475fe0-2701-4714-9c30-28cf47a0c53b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.535801 Apr 02 20:56:00.307605 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 702/1265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:55:59 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:00.311356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:00.312020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:00.313191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:00.314153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:00.319781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:00.320646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:00.369295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:00.370227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:00.378936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:00.379834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:00.553439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:00.576254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:00.577858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:00.579084 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a37c90b-d007-4496-a4c6-9ecd73fa4fe7 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.285168 Apr 02 20:56:00.594356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 564/1266] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:00 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:00.604047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1442191044", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:00.702670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] validate_networks() for [('2427a2f7-cca3-4878-92a4-fe77defc6f38', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:00.740916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:00.752399 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-88459beb-0dd4-4b90-ad7e-1c5cfc6a5d1e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.435713 Apr 02 20:56:00.764813 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 703/1267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:00 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:01.301427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:01.302957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:01.311884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.312649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:01.314376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.315026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:01.509004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:01.517490 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d7983e3-7cc6-4352-b6fd-0798ce3ecee3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.221525 Apr 02 20:56:01.518742 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 704/1268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:01 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:01.568250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8e68f1b7-83d1-4584-8db3-8d08a18eb53f req-94880ee9-6157-4910-81a6-7776f547f5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49b75f0-be94-47d7-bea0-defda75a9f43", "name": "network-vif-plugged", "status": "completed", "tag": "8aae08e3-d1ba-42cd-87c1-fbb358fdc29e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:01.576846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8e68f1b7-83d1-4584-8db3-8d08a18eb53f req-94880ee9-6157-4910-81a6-7776f547f5c4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.577310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8e68f1b7-83d1-4584-8db3-8d08a18eb53f req-94880ee9-6157-4910-81a6-7776f547f5c4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:01.590282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8e68f1b7-83d1-4584-8db3-8d08a18eb53f req-94880ee9-6157-4910-81a6-7776f547f5c4 service nova] Creating event network-vif-plugged:8aae08e3-d1ba-42cd-87c1-fbb358fdc29e for instance a49b75f0-be94-47d7-bea0-defda75a9f43 on nch1-master-1 Apr 02 20:56:01.595550 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8e68f1b7-83d1-4584-8db3-8d08a18eb53f req-94880ee9-6157-4910-81a6-7776f547f5c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032523 Apr 02 20:56:01.596163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 705/1269] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:56:01.601594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:01.602301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:01.616993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.617757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:01.619200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.622454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:01.725614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:01.736181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:01.738539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:01.739753 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11f54039-90b6-4fc9-9683-1bb05e673472 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.142215 Apr 02 20:56:01.774773 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 706/1270] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:01 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:01.785423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:01.786073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:01.804100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.807347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:01.808270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:01.809410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:02.181311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:02.181805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:02.182218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:02.182830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:02.183252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:02.197645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:02.199019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:02.199484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:02.200402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:02.208190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:02.209875 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba7b4478-2df1-471b-ac54-a3f82768a94e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.433937 Apr 02 20:56:02.221365 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 707/1271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:01 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:02.242855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Getting quotas for project 99e28f04f7dd4777891efe100377f141. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:02.255039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Getting quotas for user ee8c4a666eb94960b71b0353d32b5f67 and project 99e28f04f7dd4777891efe100377f141. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:02.281726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:02.289086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:02.386057 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a90e8f8-9ee5-4687-973b-fac2cb5b993e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790349 Apr 02 20:56:02.391723 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 565/1272] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:56:02.402130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2214cd6d-6af0-4bb6-8a41-20949eac8432 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:02.402926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2214cd6d-6af0-4bb6-8a41-20949eac8432 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:02.481888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2214cd6d-6af0-4bb6-8a41-20949eac8432 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:02.495606 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2214cd6d-6af0-4bb6-8a41-20949eac8432 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1217 microversion: 2.1 time: 0.097693 Apr 02 20:56:02.496419 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 708/1273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:02 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:02.540050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:02.540050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:02.554286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:02.554773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:02.555591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:02.561325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:02.758435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:02.759063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:02.775634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:02.776100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:02.776958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:02.777371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:03.116701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:03.135344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:03.141517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:03.143078 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9bf28e6c-3b20-4646-a31f-e6c8b2e9b95d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.388618 Apr 02 20:56:03.158131 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 709/1274] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:02 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:03.202486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:03.211994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3125dbb0-a65e-45ab-bde6-fe053937a43f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.680251 Apr 02 20:56:03.221452 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 566/1275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:02 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:03.233150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:03.233781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:03.245722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:03.247201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:03.251205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:03.251712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:03.513889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:03.515175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:03.521884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:03.523023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:03.524582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:03.525905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:03.662337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:03.677482 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-136bed0c-63d8-44ad-9c11-36eb76bd2fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1213 microversion: 2.1 time: 0.166018 Apr 02 20:56:03.682669 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 567/1276] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:03 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:03.752345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:03.761667 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3f18a95-7b55-4bf3-a7d7-36ba6b320c3f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1317 microversion: 2.1 time: 0.537903 Apr 02 20:56:03.762268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 710/1277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:03 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:03.993466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-112865354", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "83a57283-8e77-4048-913b-713f633ea68f"}], "block_device_mapping_v2": [{"uuid": "2dc66bc6-7365-4044-a99a-86eb8a66d8c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:04.108673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] validate_networks() for [('83a57283-8e77-4048-913b-713f633ea68f', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:04.165478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:04.166417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:04.182244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:04.183462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:04.189758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:04.190582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:04.394985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:04.413048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:04.420160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:04.427914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6201d5d-8549-4ae7-b8af-87bd12614af0 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.263574 Apr 02 20:56:04.428860 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 711/1278] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:04 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:56:04.469190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:04.474269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:04.486000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:04.486475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:04.487289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:04.488319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:04.938855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:04.949021 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-089177f1-c923-40a8-9309-0b374233312d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.502677 Apr 02 20:56:04.950218 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 712/1279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:04 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:04.962584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:04.963717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:04.970123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:04.970941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:04.972361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:04.973093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.353944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:05.355002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:05.355693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:05.356262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:05.356868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:05.372053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:05.374318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.385192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:05.385192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.412474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:05.421551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:05.429525 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e629d1c-50ea-476e-8152-960b6329faac tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1275 microversion: 2.1 time: 0.473039 Apr 02 20:56:05.429525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 713/1280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:04 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1275 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:05.441001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:05.441846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:05.448799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Getting quotas for user a2e061bb9a054fb1945417baf444eaee and project 1e586602a4da4d659974e36ab71486a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:05.459852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:05.461083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.462033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:05.462461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.536716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:05.540546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2dc66bc6-7365-4044-a99a-86eb8a66d8c3',volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:05.717542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00ec4306-ff36-4a4a-b4d5-06a951230c31 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.727914 Apr 02 20:56:05.718791 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 568/1281] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:56:05.785660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:05.793625 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-01b4fde4-db9e-4929-8740-922799132598 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1467 microversion: 2.1 time: 0.364667 Apr 02 20:56:05.797236 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 714/1282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:05 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1467 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:05.806495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:05.809946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:05.823526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:05.823887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.824715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:05.825162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:05.937205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:05.960345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:05.967751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:05.968949 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-090eadd3-f162-4daf-9153-f8eaaf9ab14c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1366 microversion: 2.57 time: 0.166321 Apr 02 20:56:05.969553 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 715/1283] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:05 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:05.976012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a01309bb-1edd-4e70-b7b3-20c44c485a5b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:05.976672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a01309bb-1edd-4e70-b7b3-20c44c485a5b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:06.082038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a01309bb-1edd-4e70-b7b3-20c44c485a5b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:06.091578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a01309bb-1edd-4e70-b7b3-20c44c485a5b tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1052 microversion: 2.1 time: 0.120420 Apr 02 20:56:06.092178 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 716/1284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:05 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1052 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:06.096678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:06.097646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:06.104793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:06.105605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:06.106629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:06.107822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:06.156219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2058328793", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "8c367129-e8a6-4477-ae42-b50d7c7292de"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:06.230040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] validate_networks() for [('8c367129-e8a6-4477-ae42-b50d7c7292de', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:06.461843 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-320044b9-7ade-445d-9163-2a82aac7611c tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1618 microversion: 2.1 time: 0.368548 Apr 02 20:56:06.478076 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 717/1285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:06 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1618 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:06.483092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:06.483720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:06.493884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:06.494599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:06.495594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:06.496206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:06.893191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:06.903006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e55e8e8-363e-4567-aa8d-fedfaac0c8b1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.423750 Apr 02 20:56:06.903858 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 718/1286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:06 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:06.913046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:06.913940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:06.920625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:06.921290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:06.922368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:06.922822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.253022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:07.253626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:07.253950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:07.254654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:07.255079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:07.269183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:07.279795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:07.279979 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1367dad-7283-481a-a93e-9569c710b62a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.374763 Apr 02 20:56:07.280582 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 719/1287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:06 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:07.283621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.285142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:07.286808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.301114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-996782188", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0adca561-7967-465d-a3e3-78a0dd5bb75d"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:07.317326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Getting quotas for project ca062168c5234ac98bdfe39669d817d7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:07.332522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Getting quotas for user b4e403362d974575bed8e6aca5fde653 and project ca062168c5234ac98bdfe39669d817d7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:07.365583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:07.370676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:07.389012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:07.430462 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-82a866eb-0669-488e-a09c-745a5ae79218 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710001 Apr 02 20:56:07.431269 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 569/1288] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:56:07.438049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:07.439561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:07.452660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:07.453465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.454792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:07.455571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.579298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:07.592266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:07.594201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:07.596384 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c3f46442-9f83-49af-aeb7-84adeeb427ab tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1372 microversion: 2.57 time: 0.164073 Apr 02 20:56:07.600688 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 570/1289] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:07 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:07.618143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:07.620279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:07.638992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:07.639829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.640602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:07.641249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:07.943580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:07.952133 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71c8b50f-2e9a-46a6-9103-01c58dc11e8e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1168 microversion: 2.1 time: 0.350127 Apr 02 20:56:07.957309 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 571/1290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:07 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1168 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:07.972793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f5ec80d5-0260-44f0-a3d0-489dfa20320c tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:07.973838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f5ec80d5-0260-44f0-a3d0-489dfa20320c tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:08.078007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f5ec80d5-0260-44f0-a3d0-489dfa20320c tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:08.087235 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f5ec80d5-0260-44f0-a3d0-489dfa20320c tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1217 microversion: 2.1 time: 0.128300 Apr 02 20:56:08.089962 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 572/1291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:07 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:08.104777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-bd0fba6f-275f-4ecd-83b5-7da801f6c16d req-ad27e31e-2237-458e-80bc-366d6ace179f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921651cb-3b32-40b1-93bd-69c6229974fc", "tag": "96f3f740-986f-4e13-ba57-2ec87a000263"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:08.118114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bd0fba6f-275f-4ecd-83b5-7da801f6c16d req-ad27e31e-2237-458e-80bc-366d6ace179f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.118567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bd0fba6f-275f-4ecd-83b5-7da801f6c16d req-ad27e31e-2237-458e-80bc-366d6ace179f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.150962 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-bd0fba6f-275f-4ecd-83b5-7da801f6c16d req-ad27e31e-2237-458e-80bc-366d6ace179f service nova] Creating event network-changed:96f3f740-986f-4e13-ba57-2ec87a000263 for instance 921651cb-3b32-40b1-93bd-69c6229974fc on nch2-master-1 Apr 02 20:56:08.157286 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-bd0fba6f-275f-4ecd-83b5-7da801f6c16d req-ad27e31e-2237-458e-80bc-366d6ace179f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065914 Apr 02 20:56:08.158161 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 573/1292] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:08.179795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:08.180569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:08.191836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:08.192446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:08.193311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:08.194065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:08.194735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:08.199952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.203961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.205340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.209453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.217408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.217870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.218877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.219320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.276075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:08.288627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Getting quotas for user 6bf48963161747228e3cafa0bc045729 and project 5f8ef84a62894a7da5457cafc1bcf172. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:08.302501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:08.305398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:08.373193 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d00f910e-2383-4de7-8ea1-fe6f0a3fb3db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082188 Apr 02 20:56:08.375722 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 720/1293] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:56:08.387957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:08.391603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:08.405159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.405877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.406910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.407832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.816401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:08.827582 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0331d71f-4b90-463d-99fe-1afbea4fe14d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.449942 Apr 02 20:56:08.829734 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 721/1294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:08 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:08.847792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0491e30c-b8f5-4226-8a6e-562906e572d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:08.850626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0491e30c-b8f5-4226-8a6e-562906e572d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:08.924047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:08.935676 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62962875-1782-4947-a113-5fea2618f137 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.775952 Apr 02 20:56:08.936337 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 574/1295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:08 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:08.945019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:08.945655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:08.960211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.960735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:08.961647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:08.962149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.094545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0491e30c-b8f5-4226-8a6e-562906e572d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:09.107971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0491e30c-b8f5-4226-8a6e-562906e572d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1216 microversion: 2.1 time: 0.276603 Apr 02 20:56:09.118218 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 722/1296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:08 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1216 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:09.137030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:09.137660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:09.140699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:09.152679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:09.156793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:09.159083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.159334 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58fb138f-8dfc-470d-89eb-685b2a2fa90d tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1372 microversion: 2.57 time: 0.221823 Apr 02 20:56:09.159578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.173945 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 575/1297] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:08 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:09.174150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.177128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.184564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:09.185791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:09.199486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.200590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.201909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.206771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.403480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:09.414542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3e0769f-9db3-414b-8c63-04fcca685c7e tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1269 microversion: 2.1 time: 0.238220 Apr 02 20:56:09.416671 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 576/1298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:09 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1269 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:09.774708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:09.783739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d14bbcb-0d30-4f70-b97d-643fbfe2d8ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1210 microversion: 2.1 time: 0.664103 Apr 02 20:56:09.785291 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 723/1299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:09 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1210 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:09.847890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:09.848819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:09.855886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.856708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.857931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.858615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.957811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:09.957811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:09.968010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.977365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:09.978330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:09.978851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.513955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.533926 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-921c26b5-17fa-4ed2-801c-81fad2d756ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.581822 Apr 02 20:56:10.535852 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 724/1300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:09 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:10.545568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:10.546445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:10.555116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.555819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.556972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.558235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.687196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.699545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70299369-f16f-49d4-88df-b2df556332ae tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1274 microversion: 2.1 time: 0.161855 Apr 02 20:56:10.713169 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 725/1301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:10 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:10.723506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:10.724703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:10.738223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.745649 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85a8e721-319d-4759-9494-89532ca2db37 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.902680 Apr 02 20:56:10.746248 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 577/1302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:09 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:10.757181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.757468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:10.757844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.760119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.760713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.766841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:10.782141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.782828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.783808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.784413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.885471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.900093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.910793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.913375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-461edce6-4e83-4888-bcf2-0023e285cbb6 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1372 microversion: 2.57 time: 0.196693 Apr 02 20:56:10.915445 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 726/1303] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:10 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:10.921276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:10.922094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:10.930213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.930810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.931473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:10.931923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:10.966727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:10.975303 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2aba13a7-ca28-4ecb-a6f9-5c7ffd0cbfd5 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1275 microversion: 2.1 time: 0.227983 Apr 02 20:56:10.989174 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 578/1304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:10 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:11.551100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:11.551732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:11.566547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:11.569445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:11.569445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:11.569445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:11.773990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:11.784009 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-492e8213-da70-49ec-a22c-169ffff036a8 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.866892 Apr 02 20:56:11.786891 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 727/1305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:10 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:11.796697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:11.798052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:11.806913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:11.809684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:11.811549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:11.812440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:11.964922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:11.974166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-47f8cc81-a15d-49f6-a2fb-555619699eb1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1274 microversion: 2.1 time: 0.185959 Apr 02 20:56:11.975354 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 728/1306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:11 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:11.990939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:11.991967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:12.002875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.003390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.004189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.004654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.321261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:12.339634 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2a3046b-773d-466c-bdd2-46d5282d8d3d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.792328 Apr 02 20:56:12.341310 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 579/1307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:11 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:12.348483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-da8ba1cb-d250-49a4-9443-b2df7b908cdd req-92e41f93-aaf3-4720-aad4-a51571800453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9730a5f5-5e43-46cf-aa28-9d9031f06a40", "tag": "01630476-a097-41f9-be67-f49e683617f0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:12.362202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-da8ba1cb-d250-49a4-9443-b2df7b908cdd req-92e41f93-aaf3-4720-aad4-a51571800453 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.363388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-da8ba1cb-d250-49a4-9443-b2df7b908cdd req-92e41f93-aaf3-4720-aad4-a51571800453 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.379417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-da8ba1cb-d250-49a4-9443-b2df7b908cdd req-92e41f93-aaf3-4720-aad4-a51571800453 service nova] Creating event network-changed:01630476-a097-41f9-be67-f49e683617f0 for instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 on nch2-master-1 Apr 02 20:56:12.387110 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-da8ba1cb-d250-49a4-9443-b2df7b908cdd req-92e41f93-aaf3-4720-aad4-a51571800453 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043718 Apr 02 20:56:12.387804 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 580/1308] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:12.394930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:12.396004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:12.404198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.404933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.406363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.407246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.543286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:12.551454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:12.553761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:12.554393 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc1841d7-f33c-4b8a-81a9-a7adec4794ee tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1357 microversion: 2.57 time: 0.165131 Apr 02 20:56:12.555143 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 581/1309] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:12 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:12.561079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:12.561930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:12.582631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.583114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.584948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.585669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.595000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:12.603657 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5eca93c6-7510-4850-a2ea-970023d08465 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.627083 Apr 02 20:56:12.611871 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 729/1310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:11 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:12.617765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:12.621222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:12.627887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.634447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.641811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.642597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.716448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:12.946288 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4c8d528-f458-4f90-9ab7-02b248b7430c tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 204 len: 0 microversion: 2.57 time: 0.331943 Apr 02 20:56:12.947091 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 730/1311] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 20:56:12 2022] DELETE /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:56:12.953681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:12.953681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:12.972801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.973455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:12.979036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:12.979036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:13.338213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:13.346546 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0829f90f-3c67-43eb-aca3-ee0715db56bb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.398134 Apr 02 20:56:13.347700 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 731/1312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:12 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:13.365078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:13.366050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:13.373616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:13.374087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:13.374892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:13.375341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:13.506666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:13.516624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:13.518235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:13.520296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6ab1561-b36f-48ab-8fdd-4bd68c7d3199 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1363 microversion: 2.57 time: 0.160917 Apr 02 20:56:13.520949 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 732/1313] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:13 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:13.537205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:13.537834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:13.548151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:13.548660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:13.549889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:13.550390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:13.907146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:13.917754 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b52f2fff-acdd-4d10-a2ed-2dbf561d95bc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.384859 Apr 02 20:56:13.927513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 733/1314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:13 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:13.933450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:13.934394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:13.943432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:13.944319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:13.945404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:13.946132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.293272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.306630 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f024c7e3-8a37-46e1-a80e-2f93035685f1 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 1.750067 Apr 02 20:56:14.307967 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 582/1315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:12 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:14.318329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:14.320708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:14.339887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.355669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.356878 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90f677db-67f9-4abb-9667-fa7d21e81151 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1475 microversion: 2.1 time: 0.437409 Apr 02 20:56:14.358896 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 734/1316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:13 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1475 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:14.370328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.371185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.371871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.372842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:14.373593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:14.393752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.398899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.399859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.400400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.692543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.702297 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b9b5720-8587-44c6-9da5-3d01fa383304 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.342086 Apr 02 20:56:14.703236 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 735/1317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:14 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:14.709194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:14.710076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:14.716619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.718100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.719100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.719763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.870916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.892121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.895953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.899467 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a10901b-f8db-4901-bd17-3b8276661598 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1363 microversion: 2.57 time: 0.194664 Apr 02 20:56:14.912641 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 736/1318] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:14 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:14.939663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:14.944217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:14.951196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:14.959714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.960490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.961758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:14.962564 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-059f4b88-4981-4931-ac79-5f137147d3b3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.651921 Apr 02 20:56:14.962905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:14.971819 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 583/1319] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:14 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:15.324481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:15.325214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:15.335243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:15.335965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:15.337154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:15.339549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:15.614926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:15.623674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a848b66-1c47-4e25-9777-c531f5cb5121 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.692008 Apr 02 20:56:15.625171 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 737/1320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:14 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:15.630632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:15.631496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:15.638199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:15.639080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:15.640122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:15.640962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.044697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:16.055358 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80f4f15c-41ec-4d2c-b1f2-442cea0f64ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1474 microversion: 2.1 time: 0.428817 Apr 02 20:56:16.056004 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 738/1321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:15 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1474 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:16.067903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:16.070547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:16.086129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.093457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.094592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.095072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.234955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:16.247772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac30abcb-1013-44cf-93cf-2d18bbcc3e50 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.927373 Apr 02 20:56:16.248599 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 584/1322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:15 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:16.257730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:16.258660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:16.282162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.282629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.283431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.284079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.318552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.319451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.320250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lazy-loading 'fault' on Instance uuid 9180f4b9-672f-422e-a2ff-199b76e2566e {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:56:16.493430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:16.511542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:16.517194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38ba365bc3b9486eac23e3eeae7af79f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683458310c945dd9acbecfb8661a9f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:16.520189 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-280e5376-c19e-46c0-aafb-7fcde1bd28fd tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 200 len: 1368 microversion: 2.57 time: 0.268634 Apr 02 20:56:16.523445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 585/1323] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:16 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:16.557814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:16.565481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:16.589798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.591165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.594994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.596066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.622498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:16.635981 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32b53a77-99b8-482f-893f-1a34544d8e9c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.578083 Apr 02 20:56:16.636670 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 739/1324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:16 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:16.653981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-df52988b-c918-49b6-93e0-fb3f21bb72ce req-963c0391-9b41-4203-80bc-7deddfe83fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2314138d-b06e-4d43-b9ce-b7e7087cb7e4", "tag": "8cc5a9bf-bfc8-4e7b-b13b-0e759dc4c2ab"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:16.677750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-df52988b-c918-49b6-93e0-fb3f21bb72ce req-963c0391-9b41-4203-80bc-7deddfe83fab service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.689493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-df52988b-c918-49b6-93e0-fb3f21bb72ce req-963c0391-9b41-4203-80bc-7deddfe83fab service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.704563 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-df52988b-c918-49b6-93e0-fb3f21bb72ce req-963c0391-9b41-4203-80bc-7deddfe83fab service nova] Creating event network-changed:8cc5a9bf-bfc8-4e7b-b13b-0e759dc4c2ab for instance 2314138d-b06e-4d43-b9ce-b7e7087cb7e4 on nch1-master-1 Apr 02 20:56:16.711617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-df52988b-c918-49b6-93e0-fb3f21bb72ce req-963c0391-9b41-4203-80bc-7deddfe83fab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068991 Apr 02 20:56:16.716805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 740/1325] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:16.737141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:16.737989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:16.744447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.745285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:16.746244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:16.746844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.168792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:17.181106 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-442f79f2-1409-4788-b598-611d2152b65f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.458482 Apr 02 20:56:17.183365 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 741/1326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:16 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:17.198578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-66dcca1b-a3b8-4b67-baff-91f2fa840240 req-36af8885-f869-40af-977e-a45420ba8456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921651cb-3b32-40b1-93bd-69c6229974fc", "name": "network-vif-plugged", "status": "completed", "tag": "96f3f740-986f-4e13-ba57-2ec87a000263"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:17.219478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-66dcca1b-a3b8-4b67-baff-91f2fa840240 req-36af8885-f869-40af-977e-a45420ba8456 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.220324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-66dcca1b-a3b8-4b67-baff-91f2fa840240 req-36af8885-f869-40af-977e-a45420ba8456 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.246832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-66dcca1b-a3b8-4b67-baff-91f2fa840240 req-36af8885-f869-40af-977e-a45420ba8456 service nova] Creating event network-vif-plugged:96f3f740-986f-4e13-ba57-2ec87a000263 for instance 921651cb-3b32-40b1-93bd-69c6229974fc on nch2-master-1 Apr 02 20:56:17.257817 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-66dcca1b-a3b8-4b67-baff-91f2fa840240 req-36af8885-f869-40af-977e-a45420ba8456 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072932 Apr 02 20:56:17.264125 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 742/1327] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:17.281853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:17.285853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:17.300804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.305359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.308519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.309235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.328751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:17.338248 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-213c0263-bf4b-4391-90cf-9b8c2ced01af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.812141 Apr 02 20:56:17.340044 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 586/1328] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:16 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:17.352547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:17.353872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:17.370470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.373039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.375951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.376774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.874098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:17.884807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-072164b3-a8c9-40c4-98ef-7cd5ad607442 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1474 microversion: 2.1 time: 0.618894 Apr 02 20:56:17.885814 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 743/1329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:17 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1474 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:17.891678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:17.897385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] [instance: 9180f4b9-672f-422e-a2ff-199b76e2566e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:17.909256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.910638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.911615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.912421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.930643 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] HTTP exception thrown: Instance 9180f4b9-672f-422e-a2ff-199b76e2566e could not be found. Apr 02 20:56:17.931243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] Returning 404 to user: Instance 9180f4b9-672f-422e-a2ff-199b76e2566e could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:17.932092 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d956f46e-6ad3-4c70-a035-c27f67f81de5 tempest-ServerShowV257Test-1504753161 tempest-ServerShowV257Test-1504753161-project] 10.222.0.18 "GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e" status: 404 len: 111 microversion: 2.57 time: 0.045051 Apr 02 20:56:17.932683 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 744/1330] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:17 2022] GET /compute/v2.1/servers/9180f4b9-672f-422e-a2ff-199b76e2566e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:17.939150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:17.940000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:17.946714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.947390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:17.948341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:17.948974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.186261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:18.225521 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-75f17bd8-e8ab-4383-a71f-16020ad8f231 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.883008 Apr 02 20:56:18.238584 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 587/1331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:17 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:18.250625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:18.251519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:18.278647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.280355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.281558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.283319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.397393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:18.410101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f492ac62-49e4-46d1-b7b8-87a700be65e1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.473049 Apr 02 20:56:18.411206 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 745/1332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:17 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:18.426106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:18.427409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:18.446484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.447251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.448263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.449262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.802622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:18.810641 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28ca4e92-ede2-4567-91be-753ec9b47846 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1317 microversion: 2.1 time: 0.398017 Apr 02 20:56:18.817916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 746/1333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:18 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:18.829203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9b89a507-f20f-420a-bb9e-02a202eedad5 req-b3110c01-789c-4903-8450-a06d69695c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9005e873-1c4a-43cf-ba69-0334fff97c58", "tag": "c64f93fe-0582-411d-9a0e-6d653a26526a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:18.849937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9b89a507-f20f-420a-bb9e-02a202eedad5 req-b3110c01-789c-4903-8450-a06d69695c1e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.857014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9b89a507-f20f-420a-bb9e-02a202eedad5 req-b3110c01-789c-4903-8450-a06d69695c1e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.894649 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9b89a507-f20f-420a-bb9e-02a202eedad5 req-b3110c01-789c-4903-8450-a06d69695c1e service nova] Creating event network-changed:c64f93fe-0582-411d-9a0e-6d653a26526a for instance 9005e873-1c4a-43cf-ba69-0334fff97c58 on nch2-master-1 Apr 02 20:56:18.908571 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9b89a507-f20f-420a-bb9e-02a202eedad5 req-b3110c01-789c-4903-8450-a06d69695c1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085362 Apr 02 20:56:18.909439 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 747/1334] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:18.927968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:18.929836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:18.952586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.955199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.961894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:18.962859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:18.979232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:18.991306 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-53fcdebe-1663-4fc5-a43b-bd9feb58f9d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.748653 Apr 02 20:56:18.995087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 588/1335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:18 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:19.243901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:19.245393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:19.254512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:19.255484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:19.256719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:19.257468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:19.470691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:19.486476 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff064aa9-ff21-4ed4-b32e-c15b0ac7d641 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1472 microversion: 2.1 time: 0.572819 Apr 02 20:56:19.488358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 748/1336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:18 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1472 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:19.505191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5acf0ddd-6626-4309-9758-05b7fd410a4f req-c520f3f0-edeb-4ca7-8bdf-08f5e8d7e0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9660b921-cb0b-4244-9f7b-c0bfbd321bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "c04f176b-9717-4cb2-9621-f8e89d6031ec"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:19.538116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5acf0ddd-6626-4309-9758-05b7fd410a4f req-c520f3f0-edeb-4ca7-8bdf-08f5e8d7e0a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:19.538586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5acf0ddd-6626-4309-9758-05b7fd410a4f req-c520f3f0-edeb-4ca7-8bdf-08f5e8d7e0a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:19.557382 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5acf0ddd-6626-4309-9758-05b7fd410a4f req-c520f3f0-edeb-4ca7-8bdf-08f5e8d7e0a7 service nova] Creating event network-vif-unplugged:c04f176b-9717-4cb2-9621-f8e89d6031ec for instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe on nch2-master-1 Apr 02 20:56:19.565938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-5acf0ddd-6626-4309-9758-05b7fd410a4f req-c520f3f0-edeb-4ca7-8bdf-08f5e8d7e0a7 service nova] Instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:56:19.574282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5acf0ddd-6626-4309-9758-05b7fd410a4f req-c520f3f0-edeb-4ca7-8bdf-08f5e8d7e0a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083154 Apr 02 20:56:19.575648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 749/1337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:19.583497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:19.584681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:19.600093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:19.602819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:19.606550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:19.611990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:19.992338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:20.005003 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-878e37ba-7adc-4517-99a6-987730036eb0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.425213 Apr 02 20:56:20.014757 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 750/1338] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:19 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:20.023848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:20.024715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:20.031618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.032566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.033919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.034652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.124306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:20.137708 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-441bd2b6-a49e-40ae-a5d5-1890f9776b2d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.897493 Apr 02 20:56:20.150391 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 589/1339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:19 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:20.231501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:20.242276 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90375406-9440-4145-8cc8-16a7b330c2b7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1506 microversion: 2.1 time: 0.225286 Apr 02 20:56:20.256096 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 751/1340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:20 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:20.269568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:20.270215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:20.279698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.280899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.281611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.282066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.502995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:20.505105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64c04860-91b2-4aaa-aa59-57ca810e7c09 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Action: 'create', calling method: .version_select at 0x7f54d4a04160>, body: {"pool": null} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:20.512140 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-820ea3e9-4667-4e3b-bb42-7b6626ef5dcd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.254109 Apr 02 20:56:20.512624 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 752/1341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:20 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:20.528385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:20.531000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:20.540263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.541037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.542146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.542941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.607462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:20.733507 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1eef9b3a-55d1-40d9-8edd-9dd2171af7ba tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 204 len: 0 microversion: 2.1 time: 0.219462 Apr 02 20:56:20.734187 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 753/1342] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:20 2022] DELETE /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:20.746057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:20.746786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:20.764887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.765361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.766163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:20.766786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:20.991304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:21.000405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95fb961f-c8d8-4897-a699-986fab6b0c3c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1469 microversion: 2.1 time: 0.263967 Apr 02 20:56:21.001047 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 754/1343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:20 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:21.009081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:21.009444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:21.029873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.030322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.031164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.031790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.233128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:21.242852 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c529acb7-8d05-4e53-9034-9344dcc80809 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1512 microversion: 2.1 time: 0.240923 Apr 02 20:56:21.244759 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 755/1344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:21 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:21.251771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:21.252834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:21.259374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.260078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.261195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.261934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.349722 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-153fead3-eec4-4f2e-b14b-605605a4c4ad tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe/action" status: 204 len: 0 microversion: 2.1 time: 0.102863 Apr 02 20:56:21.352565 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 756/1345] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:21 2022] POST /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe/action => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:21.364422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:21.365447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:21.382135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.382980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.383945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.387164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.703432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:21.714047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afb502d4-4ce0-4162-83ff-1a195fdd2e89 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.360013 Apr 02 20:56:21.715345 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 757/1346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:21 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:21.720849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:21.721897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:21.736565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.738545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.739533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:21.740195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:21.986263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:21.996173 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18bb01f2-59a8-4dd4-832f-ec8ba2f9fc12 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.279546 Apr 02 20:56:22.005926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 758/1347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:21 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:22.005926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:22.005926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:22.012173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:22.012778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:22.013780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:22.014335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:22.243359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:22.267372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-777e0924-bfca-41e6-b889-f2ffd1d2b7c5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1469 microversion: 2.1 time: 0.263803 Apr 02 20:56:22.275609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 759/1348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:21 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:22.292610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:22.294711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:22.315103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:22.315766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:22.317302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:22.321618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:22.774928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:22.787408 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a91221a-cfad-4dc7-8a44-918cfd22e556 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.508371 Apr 02 20:56:22.790071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 760/1349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:22 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:22.805717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:22.807007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:22.821317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:22.825886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:22.827299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:22.829103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:23.649696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64c04860-91b2-4aaa-aa59-57ca810e7c09 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.496977 Apr 02 20:56:23.650488 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 590/1350] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:56:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:23.826617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:23.834866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0f40fe0-dbc5-4c65-8c84-cdbf6043dadf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 200 len: 1512 microversion: 2.1 time: 1.043415 Apr 02 20:56:23.838649 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 761/1351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:22 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 1512 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:23.853288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:23.856797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:23.874499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:23.880899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:23.882074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:23.883260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.074768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a82f03fa-a421-483d-948d-296f2ca0d5c1 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-392402904", "id": 699772925, "os-flavor-access:is_public": "False"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:24.080890 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:24.080890 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:24.125390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a82f03fa-a421-483d-948d-296f2ca0d5c1 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.473811 Apr 02 20:56:24.126827 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 591/1352] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:23 2022] POST /compute/v2.1/flavors => generated 427 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:24.154901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:24.175698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:24.187796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.188831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.190049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.190826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.214024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:24.232903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6fc7d726-6030-488f-a439-8e894c1c60bc tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.383012 Apr 02 20:56:24.241875 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 762/1353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:23 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:24.246848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:24.247866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:24.265219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.266565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.267140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.269758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.466779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:24.476737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4d4e643-9085-47ab-bcf6-88858f730bf4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1469 microversion: 2.1 time: 0.240154 Apr 02 20:56:24.478177 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 763/1354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:24 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:24.483427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-13a5cc5c-21d4-42bb-9df5-4b9141859bb5 req-f33ba08c-efc1-4a63-ae1e-d747b2f637de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9730a5f5-5e43-46cf-aa28-9d9031f06a40", "name": "network-vif-plugged", "status": "completed", "tag": "01630476-a097-41f9-be67-f49e683617f0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:24.495866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-13a5cc5c-21d4-42bb-9df5-4b9141859bb5 req-f33ba08c-efc1-4a63-ae1e-d747b2f637de service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.505637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-13a5cc5c-21d4-42bb-9df5-4b9141859bb5 req-f33ba08c-efc1-4a63-ae1e-d747b2f637de service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.528870 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-13a5cc5c-21d4-42bb-9df5-4b9141859bb5 req-f33ba08c-efc1-4a63-ae1e-d747b2f637de service nova] Creating event network-vif-plugged:01630476-a097-41f9-be67-f49e683617f0 for instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 on nch2-master-1 Apr 02 20:56:24.536299 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-13a5cc5c-21d4-42bb-9df5-4b9141859bb5 req-f33ba08c-efc1-4a63-ae1e-d747b2f637de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056722 Apr 02 20:56:24.537369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 764/1355] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:24.543162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29836b90-701a-4c5d-8e8d-968803b2b0b9 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Action: 'create', calling method: .version_select at 0x7f54d4d5d700>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:24.694721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:24.709478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fcc311fd-b7d3-4683-a611-a7a378ee719f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.581306 Apr 02 20:56:24.718948 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 592/1356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:24 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:24.721189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:24.726771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:24.734043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.737987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:24.746768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:24.747887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:25.217777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:25.229310 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4401ec65-f6d3-4463-b8a4-87d43fe93da7 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.510789 Apr 02 20:56:25.249700 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 593/1357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:24 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:25.266999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f1b7387f-6db0-4c65-adf8-5b86a269b71f req-25a58ffc-6fe8-42c4-ba6f-213be3bc294f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921651cb-3b32-40b1-93bd-69c6229974fc", "name": "network-vif-deleted", "tag": "96f3f740-986f-4e13-ba57-2ec87a000263"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:25.300969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f1b7387f-6db0-4c65-adf8-5b86a269b71f req-25a58ffc-6fe8-42c4-ba6f-213be3bc294f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:25.301495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f1b7387f-6db0-4c65-adf8-5b86a269b71f req-25a58ffc-6fe8-42c4-ba6f-213be3bc294f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:25.346731 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f1b7387f-6db0-4c65-adf8-5b86a269b71f req-25a58ffc-6fe8-42c4-ba6f-213be3bc294f service nova] Creating event network-vif-deleted:96f3f740-986f-4e13-ba57-2ec87a000263 for instance 921651cb-3b32-40b1-93bd-69c6229974fc on nch2-master-1 Apr 02 20:56:25.364482 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f1b7387f-6db0-4c65-adf8-5b86a269b71f req-25a58ffc-6fe8-42c4-ba6f-213be3bc294f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117132 Apr 02 20:56:25.370661 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 594/1358] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:25.402188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5b3b32b-8978-4feb-b7a0-3f465b194fbc tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "418a8df498a341c59e0257bf4c38f83f"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:25.407020 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:25.407020 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:25.908660 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5b3b32b-8978-4feb-b7a0-3f465b194fbc tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/699772925/action" status: 200 len: 96 microversion: 2.1 time: 0.514624 Apr 02 20:56:25.914323 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 595/1359] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Apr 2 20:56:25 2022] POST /compute/v2.1/flavors/699772925/action => generated 96 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:56:25.923163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:25.923908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:25.935068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:25.935775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:25.936794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:25.937427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:25.952684 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. Apr 02 20:56:25.953619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:25.954722 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5bf4e8a-5da3-407a-9460-66d76e804339 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 404 len: 111 microversion: 2.1 time: 0.039337 Apr 02 20:56:25.955877 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 596/1360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:25 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:25.961324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:25.962206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:25.968325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:25.969083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:25.970184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:25.970825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.227026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:26.239216 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51911767-11eb-410b-8b0b-4abce724cea3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1198 microversion: 2.1 time: 0.279472 Apr 02 20:56:26.239216 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 597/1361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:25 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1198 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:26.243532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:26.244360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:26.251413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.251961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.252857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.253551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.323903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29836b90-701a-4c5d-8e8d-968803b2b0b9 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.782355 Apr 02 20:56:26.325574 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 765/1362] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:56:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:26.338299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:26.339454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:26.348284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.349038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.350494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.351049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.415422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:26.423864 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-adfb8a0d-88a6-44ed-832e-12f4f6e9ba7f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1461 microversion: 2.1 time: 0.184350 Apr 02 20:56:26.424437 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 598/1363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:26 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1461 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:26.547570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:26.555851 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-931b3eee-e1e1-4a9d-9372-2312ad690e4a tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.221949 Apr 02 20:56:26.560293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 766/1364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:26 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:26.574648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:26.579169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:26.593185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.594044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.596161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.597547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.739791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-922e8a00-9737-43dc-a3fe-2455980cba53 tempest-FlavorsAccessTestJSON-343224432 tempest-FlavorsAccessTestJSON-343224432-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:26.767678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-922e8a00-9737-43dc-a3fe-2455980cba53 tempest-FlavorsAccessTestJSON-343224432 tempest-FlavorsAccessTestJSON-343224432-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.341823 Apr 02 20:56:26.769421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 599/1365] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:56:26 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:26.774864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:26.775484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:26.793440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.793440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.794218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:26.794805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:26.816965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:26.827294 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1dfbfd6b-cb87-45d9-a7a8-8eeef5fb3009 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.264964 Apr 02 20:56:26.828516 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 767/1366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:26 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:26.834145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-498c539a-0a8a-497f-9c7c-06e3290f0f06 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Action: 'create', calling method: .version_select at 0x7f54d4ad8a60>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:26.979225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:26.996693 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9efcf379-bd84-467f-9607-8bcb31fe3a32 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.225834 Apr 02 20:56:26.997477 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 600/1367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:26 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:27.005445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.006278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:27.012907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.013392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.014374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.014862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.214847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:27.222608 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f053a40-78ae-4aa1-8c81-4712f5d679e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1461 microversion: 2.1 time: 0.223677 Apr 02 20:56:27.223204 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 601/1368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:26 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1461 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:27.233507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c97320a7-8f06-4a4b-b8a9-d88f000c2b0d req-edf16f41-a67f-4586-8ab4-8deb0e7033ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9660b921-cb0b-4244-9f7b-c0bfbd321bfe", "name": "network-vif-plugged", "status": "completed", "tag": "c04f176b-9717-4cb2-9621-f8e89d6031ec"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:27.236697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c97320a7-8f06-4a4b-b8a9-d88f000c2b0d req-edf16f41-a67f-4586-8ab4-8deb0e7033ee service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.237182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c97320a7-8f06-4a4b-b8a9-d88f000c2b0d req-edf16f41-a67f-4586-8ab4-8deb0e7033ee service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.253290 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c97320a7-8f06-4a4b-b8a9-d88f000c2b0d req-edf16f41-a67f-4586-8ab4-8deb0e7033ee service nova] Creating event network-vif-plugged:c04f176b-9717-4cb2-9621-f8e89d6031ec for instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe on nch2-master-1 Apr 02 20:56:27.258845 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c97320a7-8f06-4a4b-b8a9-d88f000c2b0d req-edf16f41-a67f-4586-8ab4-8deb0e7033ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034455 Apr 02 20:56:27.260063 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 602/1369] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:27.272222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d53a7c8c-a8f8-40b3-a073-b27e99f261b4 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "418a8df498a341c59e0257bf4c38f83f"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:27.274223 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:27.274223 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:27.484237 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d53a7c8c-a8f8-40b3-a073-b27e99f261b4 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/699772925/action" status: 200 len: 21 microversion: 2.1 time: 0.222443 Apr 02 20:56:27.484982 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 603/1370] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Apr 2 20:56:27 2022] POST /compute/v2.1/flavors/699772925/action => generated 21 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:56:27.496916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5bf4fd8-c8cd-460f-930b-db73988424b5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:27.499214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5bf4fd8-c8cd-460f-930b-db73988424b5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:27.500500 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5bf4fd8-c8cd-460f-930b-db73988424b5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.009211 Apr 02 20:56:27.501063 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 604/1371] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:27 2022] POST /compute/v2.1/servers => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:27.505826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d28b9593-818a-489b-b571-33cc3bfc97ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '.version_select at 0x7f54d49ad3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.510702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d28b9593-818a-489b-b571-33cc3bfc97ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.511301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d28b9593-818a-489b-b571-33cc3bfc97ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.521465 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d28b9593-818a-489b-b571-33cc3bfc97ea tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.019383 Apr 02 20:56:27.522392 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 605/1372] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:56:27 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:27.527361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.528086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:27.540180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.541524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.542786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.543853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.731240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:27.740200 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38586ab2-a0d2-42f4-8402-52e5ae3a45f6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1382 microversion: 2.1 time: 0.216607 Apr 02 20:56:27.742441 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 606/1373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:27 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1382 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:27.747800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8358f03-8cce-4969-b8a4-8ac202f8d060 tempest-FlavorsAccessTestJSON-343224432 tempest-FlavorsAccessTestJSON-343224432-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.771378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8358f03-8cce-4969-b8a4-8ac202f8d060 tempest-FlavorsAccessTestJSON-343224432 tempest-FlavorsAccessTestJSON-343224432-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027670 Apr 02 20:56:27.771970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 607/1374] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:56:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:27.776795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.777599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:27.783981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.785332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.786276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.786874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.936626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:27.945805 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a2219514-e7ca-469c-95af-5b335ab95a2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.172438 Apr 02 20:56:27.946695 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 608/1375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:27 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:27.951529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21ea54fb-e92a-4476-9717-772f21d408fb tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.963800 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21ea54fb-e92a-4476-9717-772f21d408fb tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015916 Apr 02 20:56:27.964412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 609/1376] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:56:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:27.978019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:27.978975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:27.986795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.988017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:27.988625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:27.989148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.181594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:28.195008 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-307d217d-084f-4a7c-89a5-06930af5ce70 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.229529 Apr 02 20:56:28.203880 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 610/1377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:27 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:28.203880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.203880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:28.209357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.209815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.210601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.211760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.313826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-498c539a-0a8a-497f-9c7c-06e3290f0f06 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.483673 Apr 02 20:56:28.314449 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 768/1378] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:56:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:28.333036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a3e72137-8e8e-42c6-89c2-2c5dcc0f9260 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.334313 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:28.334313 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:28.356928 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a3e72137-8e8e-42c6-89c2-2c5dcc0f9260 tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/699772925" status: 202 len: 0 microversion: 2.1 time: 0.041298 Apr 02 20:56:28.358548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 769/1379] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 20:56:28 2022] DELETE /compute/v2.1/flavors/699772925 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:28.366425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.367307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:28.376757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.378214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.379255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.379873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.395192 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d900371c-7150-46e0-ae70-a93b13e5ff63 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1533 microversion: 2.1 time: 0.197930 Apr 02 20:56:28.395791 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 611/1380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1533 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:28.401491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-215b6026-9226-4c10-a76e-1bf6ade2c1d0 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-900522853", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:28.403060 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:28.403060 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:28.422754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-215b6026-9226-4c10-a76e-1bf6ade2c1d0 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.025869 Apr 02 20:56:28.423367 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 612/1381] 10.222.0.18 () {60 vars in 1145 bytes} [Sat Apr 2 20:56:28 2022] POST /compute/v2.1/flavors => generated 498 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:28.436273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.437234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:28.443760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.444481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.445444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.446094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.554326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:28.572812 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9493932-bc8d-4195-b610-45d1de7d7c7e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.211998 Apr 02 20:56:28.573327 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 770/1382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:28.589306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60292014-c306-4bea-88b9-4b53c44c92fc tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Action: 'create', calling method: .version_select at 0x7f54d4aadd30>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:28.621978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:28.629955 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-412fee68-263a-4566-98f7-402a4823fe19 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.205109 Apr 02 20:56:28.640541 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 613/1383] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:28.646796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92a59d90-3604-443c-a9a2-658a55eb2f4d tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.672739 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-92a59d90-3604-443c-a9a2-658a55eb2f4d tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.030445 Apr 02 20:56:28.673353 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 614/1384] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:28.682955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.684547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:28.691526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.692296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.693122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.693674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.850247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aea7ef31-5a33-469a-9d52-de947725dafb tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1533 microversion: 2.1 time: 0.172685 Apr 02 20:56:28.850834 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 615/1385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1533 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:28.856710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f06cb824-1dc7-4bb5-bfd6-95b0427cf90b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.863615 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f06cb824-1dc7-4bb5-bfd6-95b0427cf90b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011764 Apr 02 20:56:28.864629 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 616/1386] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:56:28.871859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3548dbc4-05ab-40da-a461-be33c3b6f03f tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-744462097", "id": 1926168336, "os-flavor-access:is_public": "False"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:28.873671 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:28.873671 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:28.908937 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3548dbc4-05ab-40da-a461-be33c3b6f03f tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.042610 Apr 02 20:56:28.910102 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 617/1387] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:28.917067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23893670-b2e3-4831-910c-6a4ce8addf3e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.918535 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:28.918535 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:28.919882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23893670-b2e3-4831-910c-6a4ce8addf3e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.920585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23893670-b2e3-4831-910c-6a4ce8addf3e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.921569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23893670-b2e3-4831-910c-6a4ce8addf3e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:28.922056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23893670-b2e3-4831-910c-6a4ce8addf3e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:28.957463 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23893670-b2e3-4831-910c-6a4ce8addf3e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045760 Apr 02 20:56:28.958264 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 618/1388] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:28.964440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f74ed51c-f453-4547-a16f-5f23cc00afdf tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:28.965261 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:28.965261 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:28.984214 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f74ed51c-f453-4547-a16f-5f23cc00afdf tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1926168336/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024973 Apr 02 20:56:28.990754 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 619/1389] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 20:56:28 2022] GET /compute/v2.1/flavors/1926168336/os-flavor-access => generated 21 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:56:28.996837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:28.998147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:29.004726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:29.005428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:29.006401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:29.006863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:29.040494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lazy-loading 'flavor' on Instance uuid 9730a5f5-5e43-46cf-aa28-9d9031f06a40 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:56:29.055355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Going to try to live migrate instance to nch1-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:56:29.996682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60292014-c306-4bea-88b9-4b53c44c92fc tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.422125 Apr 02 20:56:29.997395 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 771/1390] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:56:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:30.002128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4dce7ea5-b257-4ee5-ac48-d882b9245edd tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:30.003112 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:30.003112 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:30.021637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4dce7ea5-b257-4ee5-ac48-d882b9245edd tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1926168336" status: 202 len: 0 microversion: 2.1 time: 0.022977 Apr 02 20:56:30.022529 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 772/1391] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 20:56:29 2022] DELETE /compute/v2.1/flavors/1926168336 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:30.028781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-178355359", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "8db7a0c6-f3d4-467b-8dd1-8c3146b98f54"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:30.093100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:30.455955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:30.457470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:30.458290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:30.458652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:30.459159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:30.472397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.473422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.474482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.475440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.505648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:30.511008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for user c1d982c5db7e47a6ae521f2137af3204 and project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:30.526328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:30.530027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:30.579190 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-66b9b4da-2ac5-4264-89ef-fdd1566a805e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555342 Apr 02 20:56:30.580030 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 773/1392] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:56:30.590043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:30.590908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:30.600914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.601874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.603330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.603877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.610654 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1404a952-904a-430e-b7f3-2321b36db409 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40/action" status: 202 len: 0 microversion: 2.1 time: 1.618472 Apr 02 20:56:30.614932 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 620/1393] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:28 2022] POST /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40/action => generated 0 bytes in 1623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:30.619625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fba64e5f-98a3-4355-ab79-237fd64dbeb1 req-8c8dfc34-2d26-48ae-a362-be1f4820617b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9005e873-1c4a-43cf-ba69-0334fff97c58", "name": "network-vif-plugged", "status": "completed", "tag": "c64f93fe-0582-411d-9a0e-6d653a26526a"}, {"server_uuid": "2314138d-b06e-4d43-b9ce-b7e7087cb7e4", "name": "network-vif-plugged", "status": "completed", "tag": "8cc5a9bf-bfc8-4e7b-b13b-0e759dc4c2ab"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:30.645652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fba64e5f-98a3-4355-ab79-237fd64dbeb1 req-8c8dfc34-2d26-48ae-a362-be1f4820617b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.648056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fba64e5f-98a3-4355-ab79-237fd64dbeb1 req-8c8dfc34-2d26-48ae-a362-be1f4820617b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.680795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fba64e5f-98a3-4355-ab79-237fd64dbeb1 req-8c8dfc34-2d26-48ae-a362-be1f4820617b service nova] Creating event network-vif-plugged:c64f93fe-0582-411d-9a0e-6d653a26526a for instance 9005e873-1c4a-43cf-ba69-0334fff97c58 on nch2-master-1 Apr 02 20:56:30.682800 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fba64e5f-98a3-4355-ab79-237fd64dbeb1 req-8c8dfc34-2d26-48ae-a362-be1f4820617b service nova] Creating event network-vif-plugged:8cc5a9bf-bfc8-4e7b-b13b-0e759dc4c2ab for instance 2314138d-b06e-4d43-b9ce-b7e7087cb7e4 on nch1-master-1 Apr 02 20:56:30.696843 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fba64e5f-98a3-4355-ab79-237fd64dbeb1 req-8c8dfc34-2d26-48ae-a362-be1f4820617b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080096 Apr 02 20:56:30.698241 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 621/1394] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:30.710548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:30.711487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:30.722102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.722856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.724258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:30.724952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:30.868016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:30.877852 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c683004-2fa0-4416-a720-9de0a2218238 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.291128 Apr 02 20:56:30.880408 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 774/1395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:30 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:30.894558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80ab3d12-ed69-4d3a-adc5-a14512a762de tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d4f68f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:31.150699 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80ab3d12-ed69-4d3a-adc5-a14512a762de tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/4fac83c8-8de0-4976-ac24-f4d80b309dca" status: 200 len: 142 microversion: 2.1 time: 0.268813 Apr 02 20:56:31.151662 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 775/1396] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:56:30 2022] GET /compute/v2.1/os-floating-ips/4fac83c8-8de0-4976-ac24-f4d80b309dca => generated 142 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:31.156161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33bb86c5-e1ff-4ea4-9b5d-bbdf8d4a982a tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:31.183018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33bb86c5-e1ff-4ea4-9b5d-bbdf8d4a982a tempest-FlavorsAccessTestJSON-893933485 tempest-FlavorsAccessTestJSON-893933485-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.030211 Apr 02 20:56:31.183789 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 776/1397] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:56:31 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:31.210784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:31.213496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e440b47-e296-44d2-ab66-360e0a1d42eb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1286161241", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e466f3c5-906c-4696-be9e-51f2c77cd2a8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:31.218933 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fd999af9-2cd8-4940-b112-baf1e48d43e1 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1316 microversion: 2.1 time: 0.519263 Apr 02 20:56:31.219524 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 622/1398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:30 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:31.234345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:31.235352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:31.242255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:31.242899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:31.243848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:31.244472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:31.318913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:31.329085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1efb6548-b697-41d4-9dee-dddc19eb74cf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1274 microversion: 2.1 time: 0.098739 Apr 02 20:56:31.331133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 623/1399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:31 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:31.336921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:31.337901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:31.342611 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2e440b47-e296-44d2-ab66-360e0a1d42eb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Block Device e466f3c5-906c-4696-be9e-51f2c77cd2a8 is not bootable. Apr 02 20:56:31.343546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e440b47-e296-44d2-ab66-360e0a1d42eb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Block Device e466f3c5-906c-4696-be9e-51f2c77cd2a8 is not bootable. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:31.344472 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e440b47-e296-44d2-ab66-360e0a1d42eb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.159484 Apr 02 20:56:31.346071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 777/1400] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:31.346190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:31.346567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:31.348445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:31.349589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:31.352233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e04013f1-11b0-41d9-be01-d400abe345a3 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d4793940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:31.722474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:31.734811 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e3efb675-a563-4cab-8c54-894a8f979a55 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.401540 Apr 02 20:56:31.735923 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 624/1401] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:31 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:31.744803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:31.745786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:31.761030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:31.762057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:31.766841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:31.767520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.064892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:32.077282 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f9503ff-46a8-4cf3-bbb9-94f422f4d08a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.337090 Apr 02 20:56:32.079000 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 625/1402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:31 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:32.088146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:32.093158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:32.106159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.106858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.110022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.110900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.486792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:32.503021 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37d36491-6adc-4ba7-8b63-002b880a85d3 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1317 microversion: 2.1 time: 0.418852 Apr 02 20:56:32.505990 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 626/1403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:32 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:32.510817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:32.511635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:32.528736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.535532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.540176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.540908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.844373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:32.852854 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3062c946-c4b5-436e-b5f4-745d06ee269c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.345257 Apr 02 20:56:32.855850 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 627/1404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:32 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:32.862787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:32.866815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:32.873722 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e04013f1-11b0-41d9-be01-d400abe345a3 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4fac83c8-8de0-4976-ac24-f4d80b309dca" status: 202 len: 0 microversion: 2.1 time: 1.526130 Apr 02 20:56:32.874731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 778/1405] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:56:31 2022] DELETE /compute/v2.1/os-floating-ips/4fac83c8-8de0-4976-ac24-f4d80b309dca => generated 0 bytes in 1528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:32.879796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:32.880409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:32.884609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.885075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.885866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.886308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.889023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.889944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:32.890869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:32.891834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.038143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:33.048300 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-20cfe5f2-5742-49a3-ab4d-4f900020763e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1336 microversion: 2.1 time: 0.172340 Apr 02 20:56:33.050532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 779/1406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:32 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:33.055846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:33.056744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:33.066376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:33.067013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.068315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:33.068938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.341435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:33.373170 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c783d4f-4a9c-4aa2-aa8a-33ad4ace19cb tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.321202 Apr 02 20:56:33.373771 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 780/1407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:33 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:33.385311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:33.392926 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cbdc605-ae6d-4bd2-803b-0ff29690e028 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1466 microversion: 2.1 time: 0.535389 Apr 02 20:56:33.393526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 628/1408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:32 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1466 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:33.428475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:33.440098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-82700d0a-d5ba-4419-90b9-5933f7454fff tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d47a8f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:33.441732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:33.466636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:33.473259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.474211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:33.474675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.915538 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-82700d0a-d5ba-4419-90b9-5933f7454fff tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.521386 Apr 02 20:56:33.923022 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 781/1409] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Apr 2 20:56:33 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:56:33.928732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:33.929356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:33.960365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:33.961308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.965465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:33.967768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:33.999502 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e548f96-4544-48c3-b05c-69789634fa27 tempest-ServersOnMultiNodesTest-1921666140 tempest-ServersOnMultiNodesTest-1921666140-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1617 microversion: 2.1 time: 0.574577 Apr 02 20:56:34.005775 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 629/1410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:33 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1617 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:34.028546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c06d475-3f96-474d-bc2e-6b805c074275 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d49a4d30>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.352831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:34.361046 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f56b581f-abe6-4375-b04b-bd1b591dfc69 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1505 microversion: 2.1 time: 0.436902 Apr 02 20:56:34.361980 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 782/1411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:33 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:34.367414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.368238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:34.379958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.380993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.382062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.382728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.397237 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c06d475-3f96-474d-bc2e-6b805c074275 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.388668 Apr 02 20:56:34.399031 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 630/1412] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 20:56:34 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:34.407684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.410620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:34.422184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.422660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.423991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:34.424703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.430453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.554635 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b7307c6-1550-4c27-85b5-3e7666af4d16 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 204 len: 0 microversion: 2.1 time: 0.190516 Apr 02 20:56:34.555691 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 783/1413] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:34 2022] DELETE /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:34.562427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.563319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:34.571303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.571986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.573087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.573691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.613041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:34.614999 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e028987c-1c82-44aa-9b8a-ab86c2ae593b tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4/os-instance-actions/req-82a866eb-0669-488e-a09c-745a5ae79218" status: 200 len: 313 microversion: 2.1 time: 0.057852 Apr 02 20:56:34.616135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 784/1414] 10.222.0.18 () {58 vars in 1418 bytes} [Sat Apr 2 20:56:34 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4/os-instance-actions/req-82a866eb-0669-488e-a09c-745a5ae79218 => generated 313 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:34.624034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.624973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:34.633206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.634205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.635193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.635903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.762416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:34.776842 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eca5aaea-cdc5-4f4c-b0d5-2c522ae608fc tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.371773 Apr 02 20:56:34.778037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 631/1415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:34 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:34.793450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca360cc3-b2eb-4f6f-b84f-4e2e9bf039c3 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d4995dc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.817660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:34.826046 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9283a0b0-5bde-4500-b48e-17dd933defe6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.208531 Apr 02 20:56:34.826906 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 785/1416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:34 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:34.832874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:34.833799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:34.843614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.844256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:34.845476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:34.846106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.026643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:35.045308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eaeed08c-a57e-4d22-aa01-e8f59b8b08e5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1472 microversion: 2.1 time: 0.216849 Apr 02 20:56:35.046133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 786/1417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:34 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:35.057169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:35.058729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:35.066569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.067504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.068542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.069749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.170507 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-000427be-0e1d-495d-b725-d1f7244b2d51 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "POST /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4/action" status: 202 len: 0 microversion: 2.1 time: 0.119451 Apr 02 20:56:35.171585 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 787/1418] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:35 2022] POST /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:35.189848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2decbab5-a10a-4583-a60a-b2d9cae2c0d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-445338772", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "destination_type": "local"}, {"source_type": "volume", "uuid": "ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c", "destination_type": "invalid"}], "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:35.192421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2decbab5-a10a-4583-a60a-b2d9cae2c0d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:35.195592 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2decbab5-a10a-4583-a60a-b2d9cae2c0d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.022234 Apr 02 20:56:35.196774 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 788/1419] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:35.202796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:35.203824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:35.212194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.212995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.213983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.215277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.386397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:35.397159 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f212ef77-c43f-4dac-88e6-4134232c8b0f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1507 microversion: 2.1 time: 0.199075 Apr 02 20:56:35.397976 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 789/1420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:35 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:35.403688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:35.404554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:35.412113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.412879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.413839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.415086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.617034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:35.630591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11f866df-9bfb-406e-879c-84b47c7e38f5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.230864 Apr 02 20:56:35.631495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 790/1421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:35 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:35.648822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:35.649532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:35.657403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.657607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.658529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.659078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.842498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:35.850863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f985f0a1-c23b-4bb4-ab4c-4f8d0cdc882a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.206150 Apr 02 20:56:35.863566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 791/1422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:35 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:35.863566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:35.863566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:35.864804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.865271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:35.866075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:35.866518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.098473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:36.107720 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5db3c354-7097-480b-994d-37a888b2bbbf tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.254854 Apr 02 20:56:36.109185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 792/1423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:35 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:36.113950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:36.114787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:36.123752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.124545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.125959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.127425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.335330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:36.344130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68fcd50c-3876-45e9-9517-5d61c5722406 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.233647 Apr 02 20:56:36.345078 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 793/1424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:36 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:36.351932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:36.354537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:36.366713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.367175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.367962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.368400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.583903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:36.591631 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-01e03457-2a0c-4a6e-85b9-9ac2f013297a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1472 microversion: 2.1 time: 0.245274 Apr 02 20:56:36.592605 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 794/1425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:36 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:36.597374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02e626e9-a48a-42ac-b6ef-8d5ad538c8c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-112782470", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:36.599047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02e626e9-a48a-42ac-b6ef-8d5ad538c8c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:36.600043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02e626e9-a48a-42ac-b6ef-8d5ad538c8c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.006367 Apr 02 20:56:36.600761 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 795/1426] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:36 2022] POST /compute/v2.1/servers => generated 624 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:36.605707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e8709486-c268-4b66-9b53-40a16fc1cb73 req-a69a1426-8b9b-421b-a314-f4285b8f2d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:36.620174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8709486-c268-4b66-9b53-40a16fc1cb73 req-a69a1426-8b9b-421b-a314-f4285b8f2d01 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.620904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8709486-c268-4b66-9b53-40a16fc1cb73 req-a69a1426-8b9b-421b-a314-f4285b8f2d01 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.635438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e8709486-c268-4b66-9b53-40a16fc1cb73 req-a69a1426-8b9b-421b-a314-f4285b8f2d01 service nova] Creating event network-changed:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 20:56:36.641617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e8709486-c268-4b66-9b53-40a16fc1cb73 req-a69a1426-8b9b-421b-a314-f4285b8f2d01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039579 Apr 02 20:56:36.642765 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 796/1427] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:36.652004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:36.652975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:36.663092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.664410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.665242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.665696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.824565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:36.834665 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea3f00df-6fed-4b5b-95f4-4149ef1af98d tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1507 microversion: 2.1 time: 0.189034 Apr 02 20:56:36.844426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 797/1428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:36 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:36.854262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:36.854920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:36.861469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.862005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:36.863463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:36.863917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.031712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:37.043061 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d150a279-9a97-48e0-85ad-4f249d7cb5ff tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.204371 Apr 02 20:56:37.044098 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 798/1429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:36 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:37.349830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78e821e3-e9ae-44b3-88ab-ec36d2c648d7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Calling method '.version_select at 0x7f54d4d5d3a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:37.351639 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:37.351639 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:37.353229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78e821e3-e9ae-44b3-88ab-ec36d2c648d7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.353887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78e821e3-e9ae-44b3-88ab-ec36d2c648d7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.354817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78e821e3-e9ae-44b3-88ab-ec36d2c648d7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.356001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78e821e3-e9ae-44b3-88ab-ec36d2c648d7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.389623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78e821e3-e9ae-44b3-88ab-ec36d2c648d7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.344029 Apr 02 20:56:37.390364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 799/1430] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:56:37 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:37.396644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:37.397358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:37.407411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.408004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.409782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.410304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.585281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:37.594361 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4de57933-8fd2-4ed6-a682-b915977150d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.201047 Apr 02 20:56:37.595316 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 800/1431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:37 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:37.600545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:37.601570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:37.609625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.609855 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca360cc3-b2eb-4f6f-b84f-4e2e9bf039c3 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/77fe1d63-e6b6-41d2-a6f0-a236acf78111" status: 202 len: 0 microversion: 2.1 time: 2.830277 Apr 02 20:56:37.610500 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 632/1432] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:56:34 2022] DELETE /compute/v2.1/os-floating-ips/77fe1d63-e6b6-41d2-a6f0-a236acf78111 => generated 0 bytes in 2832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:37.614420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.615697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.616383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.621562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:37.623826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:37.635348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.636919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.639337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:37.641645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:37.829188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:37.837866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-14f485b8-238e-43c0-8b14-4ae281faba63 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.241099 Apr 02 20:56:37.839420 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 801/1433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:37 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:38.033112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bdc4c6fb-2caf-4d36-9364-211e23cc8ac2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Calling method '.version_select at 0x7f54d47a8ee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:38.035683 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:38.035683 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:38.037181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bdc4c6fb-2caf-4d36-9364-211e23cc8ac2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '298356dcff5a405493da095dacfc7aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da0e8e619e0431fb29b64983f33da56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:38.037953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bdc4c6fb-2caf-4d36-9364-211e23cc8ac2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:38.038898 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bdc4c6fb-2caf-4d36-9364-211e23cc8ac2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.198296 Apr 02 20:56:38.039542 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 802/1434] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Apr 2 20:56:37 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:38.060272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:38.061314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:38.072542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:38.073016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:38.073830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:38.074356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:38.248970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:38.262199 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee8d563e-434f-4447-9396-ce48df65bc8e tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 200 len: 1472 microversion: 2.1 time: 0.216804 Apr 02 20:56:38.272330 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 803/1435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:38 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:38.277454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3bfc59e8-68fb-4554-981d-e57fbffb2082 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d4a28550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:38.991761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:39.017518 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78c3cee1-face-44a6-aa8b-e7f91dfd3d0e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 1.405903 Apr 02 20:56:39.032832 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 633/1436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:37 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:39.057902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aac7efb9-e860-488b-8728-93673ae5ada3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:39.059341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aac7efb9-e860-488b-8728-93673ae5ada3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:39.068317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aac7efb9-e860-488b-8728-93673ae5ada3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.034014 Apr 02 20:56:39.070826 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 634/1437] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:39 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:39.087267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.088187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:39.109756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.110230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.114010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.115404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.531363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3bfc59e8-68fb-4554-981d-e57fbffb2082 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/6237f83b-437a-4e5a-a7d7-2cf2e889953b" status: 202 len: 0 microversion: 2.1 time: 1.257536 Apr 02 20:56:39.535292 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 804/1438] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:56:38 2022] DELETE /compute/v2.1/os-floating-ips/6237f83b-437a-4e5a-a7d7-2cf2e889953b => generated 0 bytes in 1262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:39.547583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b8d0f56-47d3-4598-b627-89e6bbd77be2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Calling method '.version_select at 0x7f54d4d5d4c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.552433 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:39.552433 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:39.557157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b8d0f56-47d3-4598-b627-89e6bbd77be2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '298356dcff5a405493da095dacfc7aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da0e8e619e0431fb29b64983f33da56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:39.559229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b8d0f56-47d3-4598-b627-89e6bbd77be2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:39.561324 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b8d0f56-47d3-4598-b627-89e6bbd77be2 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.023607 Apr 02 20:56:39.566082 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 805/1439] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:39.578364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:39.580529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-cf436270-93af-4d7f-a9ef-6f251a967eee req-ef7cebb7-0011-4cc5-ae89-27fd268f7543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9730a5f5-5e43-46cf-aa28-9d9031f06a40", "name": "network-vif-unplugged", "status": "completed", "tag": "01630476-a097-41f9-be67-f49e683617f0"}, {"server_uuid": "9005e873-1c4a-43cf-ba69-0334fff97c58", "name": "network-vif-deleted", "tag": "c64f93fe-0582-411d-9a0e-6d653a26526a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:39.589327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f11e16f7-07ae-4d1b-9629-2ec51ac69fad tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1505 microversion: 2.1 time: 0.516664 Apr 02 20:56:39.590677 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 635/1440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:39.590941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cf436270-93af-4d7f-a9ef-6f251a967eee req-ef7cebb7-0011-4cc5-ae89-27fd268f7543 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.591478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cf436270-93af-4d7f-a9ef-6f251a967eee req-ef7cebb7-0011-4cc5-ae89-27fd268f7543 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.596059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.597739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:39.605265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.605446 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-cf436270-93af-4d7f-a9ef-6f251a967eee req-ef7cebb7-0011-4cc5-ae89-27fd268f7543 service nova] Creating event network-vif-unplugged:01630476-a097-41f9-be67-f49e683617f0 for instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 on nch2-master-1 Apr 02 20:56:39.605907 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-cf436270-93af-4d7f-a9ef-6f251a967eee req-ef7cebb7-0011-4cc5-ae89-27fd268f7543 service nova] Creating event network-vif-deleted:c64f93fe-0582-411d-9a0e-6d653a26526a for instance 9005e873-1c4a-43cf-ba69-0334fff97c58 on nch2-master-1 Apr 02 20:56:39.606372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.607403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.608207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.619391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-cf436270-93af-4d7f-a9ef-6f251a967eee req-ef7cebb7-0011-4cc5-ae89-27fd268f7543 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050385 Apr 02 20:56:39.620712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 806/1441] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:39.626093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.626999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:39.633550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.634242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.635221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.635828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.798136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:39.805873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed83ccf4-690c-42ba-88bc-cb5fb34fdacf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.183810 Apr 02 20:56:39.806573 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 807/1442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:39.818828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.818828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 9005e873-1c4a-43cf-ba69-0334fff97c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:39.824865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.825570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.826353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.826793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.841470 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance 9005e873-1c4a-43cf-ba69-0334fff97c58 could not be found. Apr 02 20:56:39.842068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance 9005e873-1c4a-43cf-ba69-0334fff97c58 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:39.843080 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2f48e3d-9319-4c64-83c0-fd8aa672016f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58" status: 404 len: 111 microversion: 2.1 time: 0.035479 Apr 02 20:56:39.843663 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 808/1443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/servers/9005e873-1c4a-43cf-ba69-0334fff97c58 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:39.848957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c8e54ba-018e-4e5e-911d-afea56605923 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] Calling method '.version_select at 0x7f54d47a89d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.892382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:39.903939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-73955aa5-d555-482a-80bf-33866c3bac0d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.311431 Apr 02 20:56:39.904659 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 636/1444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:39.920877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c3a68533-f4f3-4264-bba9-00ae542a56dc tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Calling method '.version_select at 0x7f54d4955040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.921997 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:39.921997 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:39.942486 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c3a68533-f4f3-4264-bba9-00ae542a56dc tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 02 20:56:39.943110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c3a68533-f4f3-4264-bba9-00ae542a56dc tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:39.944390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c3a68533-f4f3-4264-bba9-00ae542a56dc tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.028752 Apr 02 20:56:39.944991 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 637/1445] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:39.951695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '.version_select at 0x7f54d4b24f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:39.952263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:39.960931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.961677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:39.963135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:39.964535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.000474 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c04f77ae-2c57-4d7a-b5f2-e034e9c2a643 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054214 Apr 02 20:56:40.004658 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 638/1446] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Apr 2 20:56:39 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4/os-instance-actions => generated 611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:40.010931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.011637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.018136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.019666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.020878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.021325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.182580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:40.190839 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f28231d5-51d9-4b06-a4e4-a398608bc34d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.185017 Apr 02 20:56:40.191426 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 639/1447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:40.196149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.196819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.203150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.203864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.205008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.205546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.235015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:40.334561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4b5b21b-70be-4969-8ab6-b6152d92d820 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 204 len: 0 microversion: 2.1 time: 0.141303 Apr 02 20:56:40.335091 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 640/1448] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:40 2022] DELETE /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:40.351102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-05d20f84-0fc7-41a7-9d16-1ba594a50cc8 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Calling method '.version_select at 0x7f54d49348b0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.352171 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:40.352171 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:40.353821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-05d20f84-0fc7-41a7-9d16-1ba594a50cc8 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '298356dcff5a405493da095dacfc7aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da0e8e619e0431fb29b64983f33da56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:40.354661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-05d20f84-0fc7-41a7-9d16-1ba594a50cc8 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:40.355778 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-05d20f84-0fc7-41a7-9d16-1ba594a50cc8 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.013180 Apr 02 20:56:40.359200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 641/1449] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:40.365528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.367089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.375453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.375990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.377065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.377662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.413835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:40.508687 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0dd4ac99-39da-4341-a265-aabb9842ba1f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 204 len: 0 microversion: 2.1 time: 0.147798 Apr 02 20:56:40.509410 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 642/1450] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:40 2022] DELETE /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:40.520282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.521105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.528869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.529550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.530548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.531178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.736413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:40.747156 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e687959-64cc-4552-b2a3-5831853ce26d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.236165 Apr 02 20:56:40.748010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 643/1451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:40.755246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.756890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.763544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.764378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.765397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.765947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.918695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:40.928733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74c22285-4a81-4ed3-9edf-527186606364 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1473 microversion: 2.1 time: 0.179198 Apr 02 20:56:40.929564 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 644/1452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1473 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:40.932556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c8e54ba-018e-4e5e-911d-afea56605923 tempest-FloatingIPDetailsTestJSON-1150013904 tempest-FloatingIPDetailsTestJSON-1150013904-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/1fec0ff9-70af-43a6-bfbf-fb1354ddf2d6" status: 202 len: 0 microversion: 2.1 time: 1.087802 Apr 02 20:56:40.933403 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 809/1453] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:56:39 2022] DELETE /compute/v2.1/os-floating-ips/1fec0ff9-70af-43a6-bfbf-fb1354ddf2d6 => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:40.935527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f85b72f-74d5-41fc-abd1-6890faf2d5a6 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Calling method '.version_select at 0x7f54d4934550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.936666 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:40.936666 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:40.938402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7de2118a-bf55-494c-b9af-98aab6270266 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-86807052", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": -1, "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:40.944911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5f85b72f-74d5-41fc-abd1-6890faf2d5a6 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 02 20:56:40.946195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f85b72f-74d5-41fc-abd1-6890faf2d5a6 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:40.947048 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f85b72f-74d5-41fc-abd1-6890faf2d5a6 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016138 Apr 02 20:56:40.947783 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 645/1454] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:40.951111 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-7de2118a-bf55-494c-b9af-98aab6270266 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Flavor -1 could not be found. Apr 02 20:56:40.951626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7de2118a-bf55-494c-b9af-98aab6270266 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:40.952485 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7de2118a-bf55-494c-b9af-98aab6270266 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.018144 Apr 02 20:56:40.953231 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 810/1455] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:40 2022] POST /compute/v2.1/servers => generated 73 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:40.957196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.958126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.959011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:40.960169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:40.967094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.967510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.967629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.968016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.968332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.968831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:40.969284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:40.970990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.136546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.146701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5b939e0-f32c-4026-8967-8ad69628dfbb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.192260 Apr 02 20:56:41.147550 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 811/1456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:41.160573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fbd6107e-842b-47ba-b995-5f36a7ec637e tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Calling method '.version_select at 0x7f54d47a8040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.163063 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:41.163063 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:41.164524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fbd6107e-842b-47ba-b995-5f36a7ec637e tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '298356dcff5a405493da095dacfc7aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da0e8e619e0431fb29b64983f33da56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.165708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fbd6107e-842b-47ba-b995-5f36a7ec637e tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.166716 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fbd6107e-842b-47ba-b995-5f36a7ec637e tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017908 Apr 02 20:56:41.167546 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 812/1457] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:41.179861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.180661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:41.188380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.189242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.190205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.190779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.259074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.275167 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-076ed691-c671-4892-88df-10b9f9d27386 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1511 microversion: 2.1 time: 0.325689 Apr 02 20:56:41.287316 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 646/1458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:40 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:41.292888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-548e4edc-2407-4ff4-a460-db314d97fdbe tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Calling method '.version_select at 0x7f54d4bdc4c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.294029 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:41.294029 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:41.303796 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-548e4edc-2407-4ff4-a460-db314d97fdbe tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 02 20:56:41.304759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-548e4edc-2407-4ff4-a460-db314d97fdbe tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.305799 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-548e4edc-2407-4ff4-a460-db314d97fdbe tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017303 Apr 02 20:56:41.312962 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 647/1459] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:41.318654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b4e5e5f-9d44-425b-b164-b83e116c72f7 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Calling method '.version_select at 0x7f54d49a4160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.320023 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:41.320023 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:41.321723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b4e5e5f-9d44-425b-b164-b83e116c72f7 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '298356dcff5a405493da095dacfc7aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da0e8e619e0431fb29b64983f33da56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.322445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b4e5e5f-9d44-425b-b164-b83e116c72f7 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.323345 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b4e5e5f-9d44-425b-b164-b83e116c72f7 tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.009325 Apr 02 20:56:41.324053 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 648/1460] 10.222.0.18 () {58 vars in 1193 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:56:41.336368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a08a30b1-f2e2-4190-a6fc-ed56202c8db7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Calling method '.version_select at 0x7f54d49a43a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.348562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.349524 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a08a30b1-f2e2-4190-a6fc-ed56202c8db7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 02 20:56:41.350133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a08a30b1-f2e2-4190-a6fc-ed56202c8db7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.352844 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a08a30b1-f2e2-4190-a6fc-ed56202c8db7 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020000 Apr 02 20:56:41.353443 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 649/1461] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:56:41.357951 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a819df28-a9db-4dc3-88ec-350174327b01 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.182967 Apr 02 20:56:41.358534 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 813/1462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:41.378415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8872d12f-a955-492b-87ce-83b3f6e5b232 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Action: 'update', calling method: .version_select at 0x7f54d49c6430>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.379674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8872d12f-a955-492b-87ce-83b3f6e5b232 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.380541 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8872d12f-a955-492b-87ce-83b3f6e5b232 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.021583 Apr 02 20:56:41.381181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.381813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:41.385523 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 650/1463] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Apr 2 20:56:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:41.388615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.390046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f38a6a2-1d5f-4fb3-9afa-345ee2ba479b tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Action: 'update', calling method: .version_select at 0x7f54d4af7ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.390998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.391806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f38a6a2-1d5f-4fb3-9afa-345ee2ba479b tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.391938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.392280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.393116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f38a6a2-1d5f-4fb3-9afa-345ee2ba479b tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.006637 Apr 02 20:56:41.398211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 651/1464] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Apr 2 20:56:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:41.407420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d27d8d15-65e1-4f85-a1da-b5578a960d7a tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Action: 'update', calling method: .version_select at 0x7f54d49f8c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.408657 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:41.408657 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:41.410314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d27d8d15-65e1-4f85-a1da-b5578a960d7a tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '298356dcff5a405493da095dacfc7aa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da0e8e619e0431fb29b64983f33da56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.411189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d27d8d15-65e1-4f85-a1da-b5578a960d7a tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.411958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d27d8d15-65e1-4f85-a1da-b5578a960d7a tempest-HostsAdminNegativeTestJSON-1651474152 tempest-HostsAdminNegativeTestJSON-1651474152-project] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.008332 Apr 02 20:56:41.412789 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 652/1465] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Apr 2 20:56:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:41.421359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bafba247-7536-4a84-9357-664b468b7c54 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Action: 'update', calling method: .version_select at 0x7f54d49a44c0>, body: {"status": null, "maintenance_mode": null} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.422765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bafba247-7536-4a84-9357-664b468b7c54 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.423581 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bafba247-7536-4a84-9357-664b468b7c54 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.005991 Apr 02 20:56:41.429661 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 653/1466] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Apr 2 20:56:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 20:56:41.435522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88da52c2-626e-418b-98d3-4cafa496dfd1 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Action: 'update', calling method: .version_select at 0x7f54d49ad940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.438590 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.hosts [None req-88da52c2-626e-418b-98d3-4cafa496dfd1 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Enabling host nonexistent_hostname. Apr 02 20:56:41.457347 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-88da52c2-626e-418b-98d3-4cafa496dfd1 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 02 20:56:41.458482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88da52c2-626e-418b-98d3-4cafa496dfd1 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.459494 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88da52c2-626e-418b-98d3-4cafa496dfd1 tempest-HostsAdminNegativeTestJSON-1556678767 tempest-HostsAdminNegativeTestJSON-1556678767-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028723 Apr 02 20:56:41.465544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 654/1467] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Apr 2 20:56:41 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:41.571385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.580018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86ca7738-c4ce-4eed-be50-16a6259cdce7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.202438 Apr 02 20:56:41.581952 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 814/1468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:41.671116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-1cf96eb3-239b-4986-aa20-2f79b88b5cb2 req-57fc1cb8-9560-4f3b-8b90-90d409f602cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9730a5f5-5e43-46cf-aa28-9d9031f06a40", "tag": "01630476-a097-41f9-be67-f49e683617f0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.679240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1cf96eb3-239b-4986-aa20-2f79b88b5cb2 req-57fc1cb8-9560-4f3b-8b90-90d409f602cc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.679990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1cf96eb3-239b-4986-aa20-2f79b88b5cb2 req-57fc1cb8-9560-4f3b-8b90-90d409f602cc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.693790 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-1cf96eb3-239b-4986-aa20-2f79b88b5cb2 req-57fc1cb8-9560-4f3b-8b90-90d409f602cc service nova] Creating event network-changed:01630476-a097-41f9-be67-f49e683617f0 for instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 on nch2-master-1 Apr 02 20:56:41.699178 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-1cf96eb3-239b-4986-aa20-2f79b88b5cb2 req-57fc1cb8-9560-4f3b-8b90-90d409f602cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032148 Apr 02 20:56:41.700259 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 655/1469] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:41.702354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e52d1304-fba6-4485-9ad5-15773160b980 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-68954551", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:41.704938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e52d1304-fba6-4485-9ad5-15773160b980 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:41.706952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e52d1304-fba6-4485-9ad5-15773160b980 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008606 Apr 02 20:56:41.707846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 815/1470] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:41.722645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.723974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:41.731355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.732679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.733573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.734017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.766721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.767472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:41.776846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.777455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.778791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:41.779459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:41.972176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:41.981718 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2f83fa9-bc20-4844-9022-b8b61cd97ff0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.219316 Apr 02 20:56:41.993809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 816/1471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:41.998881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:41.999511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:42.006082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.006534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.007419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.007760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.077907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:42.087855 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df5292e1-f8e7-4ecd-896f-974590c3628d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.375167 Apr 02 20:56:42.088764 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 656/1472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:42.108073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:42.108728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:42.115807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.116431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.117451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.118236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.339129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:42.351668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a255d146-030a-4130-8c3f-11e225cb95ce tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1473 microversion: 2.1 time: 0.356362 Apr 02 20:56:42.365449 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 817/1473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:41 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1473 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:42.371856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:42.374642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:42.387068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.388383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.391310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.392216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.553874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:42.568640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c733f71a-9223-4e5b-bd48-2e367a48a4ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.464717 Apr 02 20:56:42.569338 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 657/1474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:42 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:42.574171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:42.582557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:42.592338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.605225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.606324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.606940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.610698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:42.619495 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de3922f6-7871-4f29-b38b-d121e2b6fa98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.251398 Apr 02 20:56:42.620226 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 818/1475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:42 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:42.789872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-553d01bd-02c5-4195-be05-5b760860f758 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2050392212", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:42.793435 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-553d01bd-02c5-4195-be05-5b760860f758 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Apr 02 20:56:42.794276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-553d01bd-02c5-4195-be05-5b760860f758 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:42.795197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-553d01bd-02c5-4195-be05-5b760860f758 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.009231 Apr 02 20:56:42.799765 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 819/1476] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:42 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 20:56:42.810687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:42.811748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:42.821646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.822508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.823401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:42.824140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:42.984614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:42.994365 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-83a0ba8e-1d4a-497d-ba29-de22143ac47d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.192728 Apr 02 20:56:42.997237 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 820/1477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:42 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:43.013788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:43.015035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:43.021618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.022228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.023190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.023834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.268067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:43.286689 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a4ca12be-328a-4fa8-b37e-d93135a9f5e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.287619 Apr 02 20:56:43.287581 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 821/1478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:42 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:43.296606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:43.296606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:43.303675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.304259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.306098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.307255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.482776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:43.529544 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ccb497a1-47bb-4598-a454-90f1f684cadc tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1511 microversion: 2.1 time: 0.956969 Apr 02 20:56:43.531003 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 658/1479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:42 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1511 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:43.540350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:43.540858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:43.542334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:43.550125 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5071a8d-d88f-4f18-a24f-47c6704d3ded tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.259953 Apr 02 20:56:43.550764 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 822/1480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:43 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:43.585075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.585561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.586439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.587062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.637179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:43.638053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:43.650542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.652726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.655191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:43.655667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:43.898333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:43.910344 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2eb534c-adc2-486a-9a87-08860ac2d4be tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.277151 Apr 02 20:56:43.913230 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 823/1481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:43 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:43.931739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f21e080c-1575-417c-99f1-d979a7e8343e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-163004489", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "key_name": "tempest-key-98417984", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:44.022306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-f21e080c-1575-417c-99f1-d979a7e8343e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] validate_networks() for [('2427a2f7-cca3-4878-92a4-fe77defc6f38', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:44.234864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:44.246758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4644a8a7-fcad-4b38-872d-7c306e95b776 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1473 microversion: 2.1 time: 0.713805 Apr 02 20:56:44.257617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 659/1482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:43 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1473 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:44.290656 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f21e080c-1575-417c-99f1-d979a7e8343e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Invalid key_name provided. Apr 02 20:56:44.292060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f21e080c-1575-417c-99f1-d979a7e8343e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid key_name provided. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:44.293188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f21e080c-1575-417c-99f1-d979a7e8343e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.377889 Apr 02 20:56:44.294401 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 824/1483] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:43 2022] POST /compute/v2.1/servers => generated 70 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:44.303091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:44.303963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:44.316201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.316938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.318704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.319370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.319851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:44.320790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:44.339465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.340423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.342886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.343468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.548648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:44.560297 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9e82e6a6-d2bd-42ef-8590-38947c4f4293 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 0.251785 Apr 02 20:56:44.561958 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 825/1484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:44 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:44.571778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:44.572700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:44.579872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.581906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.582971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.583650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.758719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:44.767494 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dfb99d79-52ec-4070-a4fe-5a9d64fd519f tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1511 microversion: 2.1 time: 0.204211 Apr 02 20:56:44.769457 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 826/1485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:44 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:44.930716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:44.931797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:44.939569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.940024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.941378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.941812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.941924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:44.957945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9d1f9b3-93c4-4d5d-9cba-a5a3a65a3685 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.658777 Apr 02 20:56:44.959211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 660/1486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:44 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:44.976358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:44.977280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:44.987850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.988537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:44.990674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:44.991325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.149428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:45.161671 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e29d2cb-1687-413d-93d3-af3ed16fd9f8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.234855 Apr 02 20:56:45.162703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 827/1487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:44 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:45.264189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:45.264995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:45.277058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.277708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.278595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.279136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.459760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:45.486157 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34037348-1e77-4726-adce-751c07e84902 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 200 len: 1431 microversion: 2.1 time: 0.226582 Apr 02 20:56:45.496123 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 828/1488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:45 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 1431 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:45.501160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-fb399a0e-c0fa-4e45-ba19-765448da813f req-493b8c09-13f5-4181-888c-17511af04478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a49b75f0-be94-47d7-bea0-defda75a9f43", "name": "network-vif-deleted", "tag": "8aae08e3-d1ba-42cd-87c1-fbb358fdc29e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:45.529003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fb399a0e-c0fa-4e45-ba19-765448da813f req-493b8c09-13f5-4181-888c-17511af04478 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.529605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fb399a0e-c0fa-4e45-ba19-765448da813f req-493b8c09-13f5-4181-888c-17511af04478 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.560249 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-fb399a0e-c0fa-4e45-ba19-765448da813f req-493b8c09-13f5-4181-888c-17511af04478 service nova] Creating event network-vif-deleted:8aae08e3-d1ba-42cd-87c1-fbb358fdc29e for instance a49b75f0-be94-47d7-bea0-defda75a9f43 on nch1-master-1 Apr 02 20:56:45.582033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-fb399a0e-c0fa-4e45-ba19-765448da813f req-493b8c09-13f5-4181-888c-17511af04478 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084076 Apr 02 20:56:45.583325 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 829/1489] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:45.608762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:45.609472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:45.626172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.626636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.627498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.627984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.729459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:45.749563 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-941d83a3-c8f4-4eef-afc1-39ee5d30b6f2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.777176 Apr 02 20:56:45.753819 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 661/1490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:44 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:45.788564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:45.789352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:45.804356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.806547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.812996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:45.815219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:45.995598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e403362d974575bed8e6aca5fde653', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca062168c5234ac98bdfe39669d817d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:46.010523 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-227a9bfd-9023-4927-8d72-7a049835fecb tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 200 len: 1469 microversion: 2.1 time: 0.228086 Apr 02 20:56:46.011368 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 662/1491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:45 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:46.019733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f2f7f555-dfff-4aaa-b3fe-dec0fe6fb56c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1089012314", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:46.201183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-f2f7f555-dfff-4aaa-b3fe-dec0fe6fb56c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Neutron security group does_not_exist not found {{(pid=136517) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Apr 02 20:56:46.202012 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-f2f7f555-dfff-4aaa-b3fe-dec0fe6fb56c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Apr 02 20:56:46.203413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f2f7f555-dfff-4aaa-b3fe-dec0fe6fb56c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:46.205335 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f2f7f555-dfff-4aaa-b3fe-dec0fe6fb56c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.192745 Apr 02 20:56:46.206539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 663/1492] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:46 2022] POST /compute/v2.1/servers => generated 106 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:46.217455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:46.218648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:46.239570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:46.240798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:46.242016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:46.243045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:46.575315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:46.589250 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-157f3f09-cd60-4509-b44b-a50324f0ad81 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.380587 Apr 02 20:56:46.590762 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 664/1493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:46 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:46.599002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:46.600513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:46.607721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:46.608529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:46.609569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:46.610604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:46.753232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:46.766882 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5802e4d8-d7e1-4c8b-8267-a2377b65b8a0 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1392 microversion: 2.1 time: 1.182104 Apr 02 20:56:46.767488 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 830/1494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:45 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1392 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:46.779698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:46.780672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a49b75f0-be94-47d7-bea0-defda75a9f43] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:46.794273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:46.794980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:46.796275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:46.797119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:46.817153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance a49b75f0-be94-47d7-bea0-defda75a9f43 could not be found. Apr 02 20:56:46.818204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance a49b75f0-be94-47d7-bea0-defda75a9f43 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:46.819527 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ea80048-f1ea-4702-845b-540b8f2c5fa5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43" status: 404 len: 111 microversion: 2.1 time: 0.043931 Apr 02 20:56:46.824336 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 831/1495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:46 2022] GET /compute/v2.1/servers/a49b75f0-be94-47d7-bea0-defda75a9f43 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:47.110700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Calling method '.version_select at 0x7f54d47a2ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:47.112025 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:47.112025 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:47.113412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.113945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.142252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.142747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.167415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.167985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.176749 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-883b8a7d-73ea-4a65-95cd-cf4d849e174e tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.349152 Apr 02 20:56:47.177545 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 832/1496] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:56:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:56:47.187106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:47.189019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:47.196601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.197317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.198307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.198948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.226374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:47.276593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:47.286727 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-06d80f14-b09e-4bab-8643-09b789ecc9be tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.694609 Apr 02 20:56:47.287322 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 665/1497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:46 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:47.301795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:47.302433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] [instance: 2314138d-b06e-4d43-b9ce-b7e7087cb7e4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:47.310614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.311353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.312145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.312926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.326691 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96d3c8f9-e9e6-4421-a437-e11943b5bc25 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 204 len: 0 microversion: 2.1 time: 0.142135 Apr 02 20:56:47.331118 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 833/1498] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:47 2022] DELETE /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:47.337862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-064aaf69-6744-45d6-beaf-8b2db5d97a0b tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Calling method '.version_select at 0x7f54d4aad1f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:47.338873 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:47.338873 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:47.341681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-064aaf69-6744-45d6-beaf-8b2db5d97a0b tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.342266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-064aaf69-6744-45d6-beaf-8b2db5d97a0b tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.360180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-064aaf69-6744-45d6-beaf-8b2db5d97a0b tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.361036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-064aaf69-6744-45d6-beaf-8b2db5d97a0b tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.369255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] HTTP exception thrown: Instance 2314138d-b06e-4d43-b9ce-b7e7087cb7e4 could not be found. Apr 02 20:56:47.370663 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-064aaf69-6744-45d6-beaf-8b2db5d97a0b tempest-HypervisorAdminV228Test-479204854 tempest-HypervisorAdminV228Test-479204854-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.037699 Apr 02 20:56:47.374578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] Returning 404 to user: Instance 2314138d-b06e-4d43-b9ce-b7e7087cb7e4 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:47.376832 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 834/1499] 10.222.0.18 () {60 vars in 1192 bytes} [Sat Apr 2 20:56:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:56:47.381099 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-70976b09-197b-4b07-98ff-49b49eaa20b4 tempest-InstanceActionsTestJSON-2046298555 tempest-InstanceActionsTestJSON-2046298555-project] 10.222.0.18 "GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4" status: 404 len: 111 microversion: 2.1 time: 0.088771 Apr 02 20:56:47.382111 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 666/1500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:47 2022] GET /compute/v2.1/servers/2314138d-b06e-4d43-b9ce-b7e7087cb7e4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:47.389849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:47.393372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:47.404831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:47.406963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:47.416500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.417098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.418034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.418547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.419105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.419898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.420950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:47.421629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:47.943884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:47.959895 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11d49ab7-9f99-4952-ac8d-231508d89f10 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1472 microversion: 2.1 time: 0.576199 Apr 02 20:56:47.964285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 667/1501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:47 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1472 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:47.996559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:48.003853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:48.030782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.033454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.037440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.038182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.168411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:48.196168 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5fba7708-c5ba-41b5-9156-9ed33169835d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.817843 Apr 02 20:56:48.196816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 835/1502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:47 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:48.224788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7f9f5149-f792-4b16-8407-87ceb7638d93 req-6d71d81d-79d7-4fd2-9c66-2b3891faa327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2314138d-b06e-4d43-b9ce-b7e7087cb7e4", "name": "network-vif-deleted", "tag": "8cc5a9bf-bfc8-4e7b-b13b-0e759dc4c2ab"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:48.247062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7f9f5149-f792-4b16-8407-87ceb7638d93 req-6d71d81d-79d7-4fd2-9c66-2b3891faa327 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.247508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7f9f5149-f792-4b16-8407-87ceb7638d93 req-6d71d81d-79d7-4fd2-9c66-2b3891faa327 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.297802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7f9f5149-f792-4b16-8407-87ceb7638d93 req-6d71d81d-79d7-4fd2-9c66-2b3891faa327 service nova] Creating event network-vif-deleted:8cc5a9bf-bfc8-4e7b-b13b-0e759dc4c2ab for instance 2314138d-b06e-4d43-b9ce-b7e7087cb7e4 on nch1-master-1 Apr 02 20:56:48.320124 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7f9f5149-f792-4b16-8407-87ceb7638d93 req-6d71d81d-79d7-4fd2-9c66-2b3891faa327 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113843 Apr 02 20:56:48.323989 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 836/1503] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:48.336860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:48.338168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:48.347539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.348503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.350243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.351126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.531422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:48.542519 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d84af48e-743e-448f-b2e7-fba7e0f4d278 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.575394 Apr 02 20:56:48.543795 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 668/1504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:47 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:48.548683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2ae84518-9e05-4179-ad00-574b14e6cfcb req-1e727fee-e35b-43f9-a0b6-43b8f7ab4dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "name": "network-vif-plugged", "status": "completed", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:48.559017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2ae84518-9e05-4179-ad00-574b14e6cfcb req-1e727fee-e35b-43f9-a0b6-43b8f7ab4dc3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.559699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2ae84518-9e05-4179-ad00-574b14e6cfcb req-1e727fee-e35b-43f9-a0b6-43b8f7ab4dc3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.589222 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2ae84518-9e05-4179-ad00-574b14e6cfcb req-1e727fee-e35b-43f9-a0b6-43b8f7ab4dc3 service nova] Creating event network-vif-plugged:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 20:56:48.598838 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2ae84518-9e05-4179-ad00-574b14e6cfcb req-1e727fee-e35b-43f9-a0b6-43b8f7ab4dc3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051809 Apr 02 20:56:48.601474 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 669/1505] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:48.608632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-66b1e429-8cac-445f-9b81-aca8a9006917 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:48.609446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-66b1e429-8cac-445f-9b81-aca8a9006917 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 19fb7b9a-2da3-4033-ae17-31097918d4a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:48.618240 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-66b1e429-8cac-445f-9b81-aca8a9006917 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 19fb7b9a-2da3-4033-ae17-31097918d4a2 could not be found. Apr 02 20:56:48.619107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-66b1e429-8cac-445f-9b81-aca8a9006917 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 19fb7b9a-2da3-4033-ae17-31097918d4a2 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:48.620170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-66b1e429-8cac-445f-9b81-aca8a9006917 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19fb7b9a-2da3-4033-ae17-31097918d4a2" status: 404 len: 111 microversion: 2.1 time: 0.017080 Apr 02 20:56:48.628801 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 670/1506] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:48 2022] DELETE /compute/v2.1/servers/19fb7b9a-2da3-4033-ae17-31097918d4a2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:48.635709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:48.637360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:48.646212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.646912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.648236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.649450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.810897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:48.836930 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-434ea9e2-a016-4677-80da-d6d4b1aafcea tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1382 microversion: 2.1 time: 0.508886 Apr 02 20:56:48.854043 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 837/1507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:48 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1382 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:48.866485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf13a5fb-1eec-4d71-b906-b4a0a8bb2482 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '.version_select at 0x7f54d4733e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:48.872804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf13a5fb-1eec-4d71-b906-b4a0a8bb2482 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.874059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf13a5fb-1eec-4d71-b906-b4a0a8bb2482 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.914629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf13a5fb-1eec-4d71-b906-b4a0a8bb2482 tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.059004 Apr 02 20:56:48.915943 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 838/1508] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 20:56:48 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:48.937047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:48.937671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:48.968681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.969147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:48.969951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:48.981397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.185282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:49.207894 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a12dd56a-5ad1-40b4-8420-79e34839dbaf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.575262 Apr 02 20:56:49.208570 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 671/1509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:48 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:49.213604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:49.217023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:49.232302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.232986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.233960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.234373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.650181 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-141df63a-7580-4f5e-8517-fde47d08dc4e tempest-LiveMigrationTest-1623648684 tempest-LiveMigrationTest-1623648684-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1533 microversion: 2.1 time: 0.719224 Apr 02 20:56:49.661056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:49.661711 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 839/1510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:48 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1533 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:49.675603 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21bf4dd1-d81f-474c-939d-316878fbcda5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1472 microversion: 2.1 time: 0.464733 Apr 02 20:56:49.675786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:49.676398 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 672/1511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:49 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:49.676603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:49.682151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:49.682866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:49.700295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.700645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.701119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.701912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.702357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.703034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.705464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.705914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.912867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:49.926596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5ec4aece-e869-482f-95e2-c6d9120992e6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.272372 Apr 02 20:56:49.927295 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 840/1512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:49 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:49.942892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:49.944068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:49.954979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.955422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:49.957352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:49.966828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.011440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:50.022894 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-69bc81fc-b0e8-4a26-99ea-763c9475b8e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.345197 Apr 02 20:56:50.035085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 673/1513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:49 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:50.051111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1d738f6-180c-449d-9a08-38fe2b417067 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.051802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1d738f6-180c-449d-9a08-38fe2b417067 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Failed to fetch instance by id 9223372036854775808 {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 20:56:50.052402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c1d738f6-180c-449d-9a08-38fe2b417067 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Apr 02 20:56:50.053108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1d738f6-180c-449d-9a08-38fe2b417067 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:50.055028 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1d738f6-180c-449d-9a08-38fe2b417067 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018716 Apr 02 20:56:50.055362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:56:50.055621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 674/1514] 10.222.0.18 () {58 vars in 1187 bytes} [Sat Apr 2 20:56:50 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:50.071882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.072548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:50.211286 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 204 len: 0 microversion: 2.1 time: 0.281282 Apr 02 20:56:50.217588 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 841/1515] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:56:49 2022] DELETE /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:56:50.260082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.263206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:50.282569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.286585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.287824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.291874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.344664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.346041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.348226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.349848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.474405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:50.483628 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-573decc6-f681-4936-9333-853e2c9da4ec tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.251290 Apr 02 20:56:50.484400 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 842/1516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:50 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:50.546782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:50.558903 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9897bc30-79f5-4c8d-85e6-5fe0dd66c9a7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.496059 Apr 02 20:56:50.560526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 675/1517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:50 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:50.578373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.578988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:50.586033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.586846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.587927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.588556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.693978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.694876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:50.701522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.702282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.704146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.704792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.802829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:50.815239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fbbdf9c8-ec8d-4c3b-881f-30a95788427c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.239858 Apr 02 20:56:50.817551 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 843/1518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:50 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:50.834574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95736c1b-ea5a-43ca-8514-ef6a60086cbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.835564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-95736c1b-ea5a-43ca-8514-ef6a60086cbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Failed to fetch instance by id -1 {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 20:56:50.836288 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-95736c1b-ea5a-43ca-8514-ef6a60086cbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance -1 could not be found. Apr 02 20:56:50.837337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95736c1b-ea5a-43ca-8514-ef6a60086cbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance -1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:50.838462 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95736c1b-ea5a-43ca-8514-ef6a60086cbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008643 Apr 02 20:56:50.839438 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 844/1519] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:56:50 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:50.848104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:50.849066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:50.855827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.856285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.857100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:50.857566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:50.946607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:50.959992 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ee211c4-13db-4532-97b1-dcaf302ce385 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1472 microversion: 2.1 time: 0.271914 Apr 02 20:56:50.961060 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 676/1520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:50 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:51.043199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.043356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.043937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.051442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-163c6293-343f-4199-89d1-2c9c0023058b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.207406 Apr 02 20:56:51.052037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.052525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.054201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.054964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.064684 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 845/1521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:50 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:51.074228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.075212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.081979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.082915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.084019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.084788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.219040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.227948 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8141757-8059-445a-a160-6fb4df639947 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.191097 Apr 02 20:56:51.237804 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 677/1522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:51.270628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.280868 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31a5789e-1236-4a9b-8e2e-719b8d90242f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.212551 Apr 02 20:56:51.292818 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 846/1523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:51.299267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04d71384-0db1-4c2b-8033-df8e26eceaa1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:51.299267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04d71384-0db1-4c2b-8033-df8e26eceaa1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 4a327b70-2dfd-4b77-9783-c28d7879e689] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.304638 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-04d71384-0db1-4c2b-8033-df8e26eceaa1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 4a327b70-2dfd-4b77-9783-c28d7879e689 could not be found. Apr 02 20:56:51.305245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04d71384-0db1-4c2b-8033-df8e26eceaa1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 4a327b70-2dfd-4b77-9783-c28d7879e689 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:51.306148 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04d71384-0db1-4c2b-8033-df8e26eceaa1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/4a327b70-2dfd-4b77-9783-c28d7879e689/action" status: 404 len: 111 microversion: 2.1 time: 0.013854 Apr 02 20:56:51.306704 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 678/1524] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:51 2022] POST /compute/v2.1/servers/4a327b70-2dfd-4b77-9783-c28d7879e689/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:56:51.315246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.316525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.324584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.325529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.327129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.327767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.496407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.502390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.503076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.505401 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dd825c8-2d2b-4222-8942-d746540d86d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.194137 Apr 02 20:56:51.506395 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 847/1525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:51.513888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.514567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.515944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.516709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.529632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.530521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.538325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.539200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.540595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.541414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.709758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.714919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.719327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91c0b2e1-bbb3-455b-9bab-c89aaea30265 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.221993 Apr 02 20:56:51.723601 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 679/1526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:51.727142 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a4a2a60-ceed-4403-afc5-44cae57f2692 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.203532 Apr 02 20:56:51.727837 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 848/1527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:51.744736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-43ed57f7-16d7-4b3b-889c-780ed95bd94c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:51.745973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-43ed57f7-16d7-4b3b-889c-780ed95bd94c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 2f33d521-f06b-4c59-902a-e3099dc7a482] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.752149 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-43ed57f7-16d7-4b3b-889c-780ed95bd94c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 2f33d521-f06b-4c59-902a-e3099dc7a482 could not be found. Apr 02 20:56:51.752861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-43ed57f7-16d7-4b3b-889c-780ed95bd94c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 2f33d521-f06b-4c59-902a-e3099dc7a482 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:51.753796 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-43ed57f7-16d7-4b3b-889c-780ed95bd94c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/2f33d521-f06b-4c59-902a-e3099dc7a482/action" status: 404 len: 111 microversion: 2.1 time: 0.013250 Apr 02 20:56:51.754413 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 680/1528] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:51 2022] POST /compute/v2.1/servers/2f33d521-f06b-4c59-902a-e3099dc7a482/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:51.762604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.763214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.769870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.770326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.771095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.771526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.918246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:51.925946 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-acdf7e08-c2a5-44a2-b9fe-1a68b785768f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.167238 Apr 02 20:56:51.926520 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 849/1529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:51.944853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.945471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:51.952917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.953617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.954403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:51.954844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:51.989374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:51.993165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:52.011266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.012586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.015513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.016676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.225649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:52.234179 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d32182ff-6a99-4913-9e17-441c2977fedd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.294191 Apr 02 20:56:52.239306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 681/1530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:52.244832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:52.247388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:52.254115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:52.260107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.261662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.265073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.267230 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a4f3fc94-4dba-4f5a-86ac-ae3a3395fe9f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1472 microversion: 2.1 time: 0.291378 Apr 02 20:56:52.267450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.268491 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 850/1531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:51 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:52.284775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b7d35a1-12c6-4ea6-939d-7a758a8801d2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:52.285405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2b7d35a1-12c6-4ea6-939d-7a758a8801d2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 981172cd-4cb8-40e4-b215-a9c7a536c476] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:52.291709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2b7d35a1-12c6-4ea6-939d-7a758a8801d2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 981172cd-4cb8-40e4-b215-a9c7a536c476 could not be found. Apr 02 20:56:52.292611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b7d35a1-12c6-4ea6-939d-7a758a8801d2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 981172cd-4cb8-40e4-b215-a9c7a536c476 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:52.293864 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2b7d35a1-12c6-4ea6-939d-7a758a8801d2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/981172cd-4cb8-40e4-b215-a9c7a536c476" status: 404 len: 111 microversion: 2.1 time: 0.024105 Apr 02 20:56:52.294529 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 851/1532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:52 2022] GET /compute/v2.1/servers/981172cd-4cb8-40e4-b215-a9c7a536c476 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:52.305365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:52.306119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:52.315152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.315944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.317163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.317792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.590888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:52.604922 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f9d5b81-3522-43a1-bfc6-aec575e39323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.305908 Apr 02 20:56:52.605712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 852/1533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:52 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:52.670082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:52.678902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc73cd63-39fb-4017-9c6e-4a9ee3ffb36d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.437723 Apr 02 20:56:52.685554 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 682/1534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:52 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:52.704070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:52.707441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:52.730978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.731550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.735726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:52.741120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:52.988047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1163161330", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": "none"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:53.062603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:53.066771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:53.068076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:53.070626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:53.071245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:53.090636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.091088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.091902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.092342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.135382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Getting quotas for project 39ae799bc6f1400186ad8199388612a1. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:53.147723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Getting quotas for user 369aaa621e1a4e8788a3e18afeea57a8 and project 39ae799bc6f1400186ad8199388612a1. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:53.173799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:53.182029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:53.273862 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81c8a237-4d28-49af-9044-01e9861b5b79 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.666848 Apr 02 20:56:53.275414 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 853/1535] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:56:53.280765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:53.281928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:53.289210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.289995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.291149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.291836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.477151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.492538 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c42d0cc-744b-4fb0-a132-c703f950c239 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.215659 Apr 02 20:56:53.494594 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 854/1536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:53 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:53.500153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:53.502134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:53.519867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.525379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.526149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.527679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.529396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.536892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae283558-577d-4d99-bd33-ccc6bf6431dc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.846524 Apr 02 20:56:53.545259 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 683/1537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:52 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:53.550701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-594a8133-d98b-41c2-96fa-87db2fcb3d27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:53.553161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-594a8133-d98b-41c2-96fa-87db2fcb3d27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:53.651236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-594a8133-d98b-41c2-96fa-87db2fcb3d27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.659987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-594a8133-d98b-41c2-96fa-87db2fcb3d27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.677162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-594a8133-d98b-41c2-96fa-87db2fcb3d27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.678632 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-594a8133-d98b-41c2-96fa-87db2fcb3d27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247" status: 200 len: 1278 microversion: 2.47 time: 0.132297 Apr 02 20:56:53.681861 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 684/1538] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:53 2022] GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247 => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:53.716943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.730060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43228b80-83fe-47c9-a4a4-76337efe09c5 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1430 microversion: 2.1 time: 0.234076 Apr 02 20:56:53.731272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 855/1539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:53 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1430 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:53.744717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:53.749336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:53.762499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.766119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.766119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:53.766119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:53.976917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:53.986222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-043ed823-808a-48c8-9526-4f381e6d23b4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.252052 Apr 02 20:56:53.987351 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 856/1540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:53 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:53.992671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-315de338-4b7c-450e-b903-0f17f1df8fb3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-793543574", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:53.995500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-315de338-4b7c-450e-b903-0f17f1df8fb3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:53.996567 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-315de338-4b7c-450e-b903-0f17f1df8fb3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007765 Apr 02 20:56:53.997589 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 857/1541] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:53 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:54.023813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:54.024549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:54.037555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.038551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.041315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.042932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.158378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a0ecddc5-43fe-4378-af19-fe8754159cb0 req-a7c02d49-7a17-4a1a-8a92-f5710d2fcd7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd846a15-f5e0-4225-86ac-1616ce4995b2", "name": "network-vif-deleted", "tag": "e5923ad5-b88a-4951-8f88-e4d0130bec3f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:54.172569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a0ecddc5-43fe-4378-af19-fe8754159cb0 req-a7c02d49-7a17-4a1a-8a92-f5710d2fcd7c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.180369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a0ecddc5-43fe-4378-af19-fe8754159cb0 req-a7c02d49-7a17-4a1a-8a92-f5710d2fcd7c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.199663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a0ecddc5-43fe-4378-af19-fe8754159cb0 req-a7c02d49-7a17-4a1a-8a92-f5710d2fcd7c service nova] Creating event network-vif-deleted:e5923ad5-b88a-4951-8f88-e4d0130bec3f for instance bd846a15-f5e0-4225-86ac-1616ce4995b2 on nch1-master-1 Apr 02 20:56:54.215116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a0ecddc5-43fe-4378-af19-fe8754159cb0 req-a7c02d49-7a17-4a1a-8a92-f5710d2fcd7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.531201 Apr 02 20:56:54.220827 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 685/1542] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:56:54.229739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1226581478", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": "none"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:54.240903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:54.252955 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49123e7e-0347-447b-8ac7-48602dcd3fbc tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.240835 Apr 02 20:56:54.254263 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 858/1543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:54 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:54.286240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:54.287012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:54.296407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.296899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.305060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.305597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.309394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:54.310322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:54.310817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:54.311246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:54.311660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:54.323282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.323749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.324585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.325081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.346544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Getting quotas for project 39ae799bc6f1400186ad8199388612a1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:54.351546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Getting quotas for user 369aaa621e1a4e8788a3e18afeea57a8 and project 39ae799bc6f1400186ad8199388612a1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:54.364423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:54.367479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:54.447629 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-247b909b-a601-4e54-9779-0615ca4c499e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.224150 Apr 02 20:56:54.448285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 686/1544] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:56:54.542120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1957695084", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "f2d4ece6-a97d-4f79-921c-5a419ec5ae76"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:54.576996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:54.586390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d9917338-2498-41d9-961d-06214af633ef tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.307177 Apr 02 20:56:54.586982 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 859/1545] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:54 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:54.600791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51c5bd98-faee-49ac-9a55-7f0f68c32ff8 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:54.601915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-51c5bd98-faee-49ac-9a55-7f0f68c32ff8 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:54.625364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] validate_networks() for [('f2d4ece6-a97d-4f79-921c-5a419ec5ae76', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:56:54.652317 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51c5bd98-faee-49ac-9a55-7f0f68c32ff8 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "PUT /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 992 microversion: 2.47 time: 0.064285 Apr 02 20:56:54.662821 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 860/1546] 10.222.0.18 () {62 vars in 1296 bytes} [Sat Apr 2 20:56:54 2022] PUT /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 992 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:56:54.668641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:54.669530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:54.677894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.678553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.679441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:54.680315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:54.912653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:54.922590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b527f72-bbac-46a6-903d-285c91b099f3 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.257751 Apr 02 20:56:54.932280 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 861/1547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:54 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:54.933027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d1f3f28-681a-4500-a02b-6c77e3436706 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:54.936798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d1f3f28-681a-4500-a02b-6c77e3436706 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:55.035240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d1f3f28-681a-4500-a02b-6c77e3436706 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.050903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d1f3f28-681a-4500-a02b-6c77e3436706 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.052916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d1f3f28-681a-4500-a02b-6c77e3436706 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.054086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d1f3f28-681a-4500-a02b-6c77e3436706 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1278 microversion: 2.47 time: 0.129608 Apr 02 20:56:55.066288 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 862/1548] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:54 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:55.071833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:55.072480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:55.079674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.080395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.081892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.082581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.195029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.206083 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1bcf6c3-9550-48fe-bef8-907c835070ba tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1430 microversion: 2.1 time: 0.138378 Apr 02 20:56:55.207241 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 863/1549] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1430 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:55.224251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-40fc3054-1c9a-4c0b-8a79-70cce45c0b5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-74925296", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:55.226208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-40fc3054-1c9a-4c0b-8a79-70cce45c0b5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:55.243338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-40fc3054-1c9a-4c0b-8a79-70cce45c0b5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.018752 Apr 02 20:56:55.244504 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 864/1550] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:55 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:56:55.256036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:55.257596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:55.266288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.267451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.268800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.269465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.286179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:55.286772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:55.287188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:55.287611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:55.288325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:55.309998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.311554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.315607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.316067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.376242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:56:55.388546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for user 2e7bca7cae174c2c9b83217ea73a973e and project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:56:55.412528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:56:55.417260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:56:55.482471 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6af1f82-b03f-4617-aa72-e26c07f24224 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032796 Apr 02 20:56:55.485131 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 687/1551] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:56:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:56:55.494617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:55.495247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:55.508829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.513056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.513463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.514353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.514976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.527142 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d669862-19d2-4559-b34e-eab8251574ca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.273680 Apr 02 20:56:55.527872 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 865/1552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:55.684848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.693214 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62a34cd7-6ed3-4223-8540-1aa19451ae80 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.206716 Apr 02 20:56:55.693798 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 688/1553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:55.713340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-764c47ad-28fc-4495-91a5-7494cb94b014 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:55.714417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-764c47ad-28fc-4495-91a5-7494cb94b014 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:55.775482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-764c47ad-28fc-4495-91a5-7494cb94b014 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:55.783352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-764c47ad-28fc-4495-91a5-7494cb94b014 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1208 microversion: 2.1 time: 0.088509 Apr 02 20:56:55.793577 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 689/1554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:55.799519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:55.801353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:55.807802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.808639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.809835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:55.810509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:55.889216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4733e60-7838-443e-bcc0-30d4b7611bc8 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:55.890331 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:55.890331 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:55.891245 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e4733e60-7838-443e-bcc0-30d4b7611bc8 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Apr 02 20:56:55.892016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4733e60-7838-443e-bcc0-30d4b7611bc8 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:55.893557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4733e60-7838-443e-bcc0-30d4b7611bc8 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567 tempest-InstanceUsageAuditLogNegativeTestJSON-2107971567-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.363503 Apr 02 20:56:55.895654 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 866/1555] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 367 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 20:56:56.008238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.019854 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91b12874-3788-4946-9ed6-4f913dadde0f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.224875 Apr 02 20:56:56.020834 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 690/1556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:56.026789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.027751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.037988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.039009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.039974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.040423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.138618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb7bbdf8-78c6-4604-9df6-138c29b52024 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.139909 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:56.139909 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:56:56.141315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb7bbdf8-78c6-4604-9df6-138c29b52024 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a33b5411bfa543aeaf36575cd7589e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43205117bd845bf8d26d0afc9df8da5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.142310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb7bbdf8-78c6-4604-9df6-138c29b52024 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:56.143130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb7bbdf8-78c6-4604-9df6-138c29b52024 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.242130 Apr 02 20:56:56.143727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 867/1557] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 20:56:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:56.151248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3640884-4c7e-4d9b-831d-a352f8459a5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:56.151790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c3640884-4c7e-4d9b-831d-a352f8459a5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 4f46b332-dc5c-4146-b9ef-3b4eb748375e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.157813 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c3640884-4c7e-4d9b-831d-a352f8459a5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 4f46b332-dc5c-4146-b9ef-3b4eb748375e could not be found. Apr 02 20:56:56.158423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3640884-4c7e-4d9b-831d-a352f8459a5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 4f46b332-dc5c-4146-b9ef-3b4eb748375e could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:56.159870 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c3640884-4c7e-4d9b-831d-a352f8459a5d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/4f46b332-dc5c-4146-b9ef-3b4eb748375e/action" status: 404 len: 111 microversion: 2.1 time: 0.014440 Apr 02 20:56:56.161729 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 868/1558] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:56 2022] POST /compute/v2.1/servers/4f46b332-dc5c-4146-b9ef-3b4eb748375e/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:56.167933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.168567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.177320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.178636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.180999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.181726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.234767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.247733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9801503-0047-46be-a1f3-ae79e54fa259 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.225387 Apr 02 20:56:56.248692 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 691/1559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:56.254244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-80183326-ea9c-477d-b7d0-4289f23294cb tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.255377 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:56:56.255377 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:56:56.257699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-80183326-ea9c-477d-b7d0-4289f23294cb tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a33b5411bfa543aeaf36575cd7589e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43205117bd845bf8d26d0afc9df8da5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.259024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-80183326-ea9c-477d-b7d0-4289f23294cb tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:56.260663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-80183326-ea9c-477d-b7d0-4289f23294cb tempest-InstanceUsageAuditLogNegativeTestJSON-900396798 tempest-InstanceUsageAuditLogNegativeTestJSON-900396798-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-02 20:56:56" status: 403 len: 128 microversion: 2.1 time: 0.010761 Apr 02 20:56:56.261292 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 692/1560] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-02%2020%3A56%3A56 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:56:56.276841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.277383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.287392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.288673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.289647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.289922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.290103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.308346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.310152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.315801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f55939c1-6df1-42ac-9adb-132b9811f18e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1336 microversion: 2.47 time: 0.152860 Apr 02 20:56:56.316637 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 869/1561] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1336 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:56.338669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.344077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.358495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.359903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.363079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.363824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.417861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.418927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.420413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:56:56.463416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.473290 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6a06aec-d36d-4eac-bfe9-8e1e8922d5c6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.209662 Apr 02 20:56:56.474101 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 693/1562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:56.487452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.491699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.492550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.498780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.499640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.501047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.501368 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d88c6275-a8c9-4375-a6aa-50ccddcc2c40 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.167190 Apr 02 20:56:56.501505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.503388 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 870/1563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:56.546365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.547251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.561436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.562291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.565097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.565599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.737695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.746859 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4e7db60-5254-422e-b162-7393a5f3d668 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.259375 Apr 02 20:56:56.747589 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 694/1564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:56.749231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.757318 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e655038-4130-4239-81b6-3bb11939e603 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.215873 Apr 02 20:56:56.757838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 871/1565] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:56.764784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:56.765330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.774847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.775370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.776876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.777941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.800585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.801409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.811711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.813007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.814291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.816360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.870834 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-06198bdf-f9af-4b5b-af77-5e3adcde9d76 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 202 len: 0 microversion: 2.1 time: 0.110346 Apr 02 20:56:56.871787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 695/1566] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:56 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:56:56.886751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:56.889988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:56.915546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:56.915988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.916774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.918130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:56.918814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:56.925633 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3254b503-fed8-499b-98bb-4172c338bc48 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.129648 Apr 02 20:56:56.926234 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 872/1567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:57.094954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.102975 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25c0d85e-29a1-4c4e-bbea-2291a9b45c4c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1508 microversion: 2.1 time: 0.220359 Apr 02 20:56:57.103831 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 696/1568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:56 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:57.267256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:57.268993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:57.278426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.278922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.279893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.280543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.336109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:57.336830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:57.344949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.345988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.347158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.347817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.430059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.438587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.440977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.442586 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a43e1e8-72cc-4feb-b411-cfa5ffc37342 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1336 microversion: 2.47 time: 0.111375 Apr 02 20:56:57.443361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 697/1569] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:57 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1336 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:56:57.454205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.460683 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d1cd5c2-a8f1-45a6-ba85-f29a98abc7e4 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.199379 Apr 02 20:56:57.461265 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 873/1570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:57 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:57.519187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:57.529309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:57.548233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.549062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.550889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.551478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.594373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.595248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.595866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:56:57.654794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.662896 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e1759c8-56b7-40ed-99a1-234e7ab35d47 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.147632 Apr 02 20:56:57.663705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 698/1571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:57 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:57.775074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:57.775962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:57.782833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.783376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.784863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.785537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.937939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:57.944040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:57.945086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:57.948854 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0a11621-9897-4f53-ba5b-6870092c47a4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.177704 Apr 02 20:56:57.950664 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 874/1572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:57 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:57.953660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.954122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:57.954962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:57.955411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.027480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.036386 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c07272b-dd80-4553-8b2a-bbd7a2923841 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.096874 Apr 02 20:56:58.037419 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 699/1573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:57 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:58.121101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:58.121807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.128362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.128864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.129652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.130422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.306380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.315569 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-100106d1-362b-4583-bae6-29847766fd43 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1488 microversion: 2.1 time: 0.198317 Apr 02 20:56:58.316371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 875/1574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:58 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1488 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:58.334199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:58.335150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.344361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.345171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.345861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.346370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.371341 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'pause' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state paused Apr 02 20:56:58.371945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'pause' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state paused {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:56:58.372998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8eefdd49-bce9-4cd2-b36b-6d1244a956ad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 143 microversion: 2.1 time: 0.043769 Apr 02 20:56:58.373732 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 700/1575] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:58 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 143 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:56:58.382944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:58.383694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.390580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.391282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.392143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.392660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.461987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:58.462726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.471093 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90e16fd3-8b82-4125-94cf-d0bf52493f6d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 202 len: 0 microversion: 2.1 time: 0.091992 Apr 02 20:56:58.472493 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 876/1576] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:56:58 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:56:58.472958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.473649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.474785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.475479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.480618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:58.481593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.492920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.493318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.496756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.497267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.580785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.595095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.598009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.598573 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3d347a0a-0148-439a-a321-899f74490d01 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1336 microversion: 2.47 time: 0.140627 Apr 02 20:56:58.610041 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 701/1577] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:58 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:58.610041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:58.610041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.612947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.613472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.615011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.615496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.772583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.784719 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d259746-dad2-4574-9663-8d2cab69c7ac tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.309926 Apr 02 20:56:58.785893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 877/1578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:58 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:58.795666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:58.797198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.802886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.809923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.811722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.812847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.813580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.814711 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1974334f-4a08-4a91-b607-ee7db456a2e8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1495 microversion: 2.1 time: 0.214537 Apr 02 20:56:58.816781 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 702/1579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:58 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1495 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:58.867628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.868084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.868568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:56:58.914547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:58.922250 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d34e06a3-1a1c-4751-933a-ef7119b3bf1c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.134737 Apr 02 20:56:58.922856 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 878/1580] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:58 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:58.968233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:58.969491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:58.992160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.992682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:58.994658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:58.994658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.053787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:59.054698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:59.060829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.061524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.062487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.063225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.135618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:59.144419 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4a35cb8-9242-4839-842c-510fe6d4e71d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.095412 Apr 02 20:56:59.145067 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 879/1581] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:59 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:56:59.200015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:59.209694 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aedfb272-7b95-4e9e-b7a2-60937ab5d51e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.246224 Apr 02 20:56:59.211222 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 703/1582] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:58 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:56:59.621187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:59.621941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:59.629697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.630157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.631662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.632556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.716132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:59.726014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:59.727813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:56:59.729650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c9eefe0-56d5-4a8b-8d58-ba5d96addf27 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1357 microversion: 2.47 time: 0.116575 Apr 02 20:56:59.738865 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 880/1583] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:56:59 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1357 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:56:59.747604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:56:59.749302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:59.772014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.773633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.774437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.774883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.803280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:56:59.804159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:59.812118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.812884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.814146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.814811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.897472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:56:59.897912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:56:59.898389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:56:59.900537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:56:59.902683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:56:59.986058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:56:59.993675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.994134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.994923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:56:59.995358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:56:59.999167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.007237 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0cfe65e1-2d67-42a3-8e73-e7758680497e tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.208772 Apr 02 20:57:00.018612 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 881/1584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:56:59 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.024100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.025072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.031719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.032357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.033367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.034027 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-415b0e20-9f23-41c9-b581-b1126f2ac5e3 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "POST /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140/action" status: 202 len: 1079 microversion: 2.47 time: 0.290362 Apr 02 20:57:00.034235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.035168 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 704/1585] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 20:56:59 2022] POST /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140/action => generated 1079 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Apr 02 20:57:00.040305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.041009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.051568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.052496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.053645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.054302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.099156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.099615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.100070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:00.153269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.174323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ce4d15d-07db-4be8-ad52-deb8d5a02b8a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.137969 Apr 02 20:57:00.175543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 705/1586] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.182346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.182968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.189370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.191010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.192017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.192705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.215690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.226388 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e749391b-d7db-44db-a757-c88b7a27ecd3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.206180 Apr 02 20:57:00.240791 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 882/1587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.247285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.249245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.263857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.264578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.265440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.265945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.293665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.302764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.304283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.305911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b4ee512-e5f6-4e08-a039-59076e59605c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.127653 Apr 02 20:57:00.306991 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 706/1588] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:00.318516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.319619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.326591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.327270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.328574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.329339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.357654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.366644 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c85f7ea-a2f4-4537-a066-95892fec0a4d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.122861 Apr 02 20:57:00.376835 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 883/1589] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.383771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.384513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.391036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.391668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.392500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.392903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.570649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.570958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.582770 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d8b899ff-3218-46f9-8627-b7c4507b0d96 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.272504 Apr 02 20:57:00.583311 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c24d7f8b-2f0f-46a8-954c-fd0ba4c9d57c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.204967 Apr 02 20:57:00.583907 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 884/1590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.584617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 707/1591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.599925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:00.601044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.607605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.608266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.609288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.609897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.625551 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. Apr 02 20:57:00.626157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:00.626970 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a08397c-b5a3-4251-a46d-c477f1980b1d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc/action" status: 404 len: 111 microversion: 2.1 time: 0.031045 Apr 02 20:57:00.627537 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 885/1592] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:00 2022] POST /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:00.637068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.637752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.644185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.644708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.645824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.646466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.885124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:00.894068 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-94cf13df-95a4-4522-951d-dc6d3f77ab40 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.261424 Apr 02 20:57:00.894716 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 708/1593] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:00.912468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:00.913115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:00.921363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.922073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:00.922865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:00.923314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.028619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.030039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.041430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.042217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.043282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.043918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.185122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.195708 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-887a0d08-59be-4f2c-b4e8-225b2adbfda1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.287528 Apr 02 20:57:01.196849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 886/1594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:00 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:01.202395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.203296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.212153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.213849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.214734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.215254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.215702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.224045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d176106-28b6-4c4b-88bd-4409489ab4b7 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.202170 Apr 02 20:57:01.224747 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 709/1595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:01.233445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24e0b78a-3780-43b1-bf91-7d496986f6da tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:01.233445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24e0b78a-3780-43b1-bf91-7d496986f6da tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 509f8607-d9f1-41a5-bcde-2f2a9a5ac6ef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.237898 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-24e0b78a-3780-43b1-bf91-7d496986f6da tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 509f8607-d9f1-41a5-bcde-2f2a9a5ac6ef could not be found. Apr 02 20:57:01.238499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24e0b78a-3780-43b1-bf91-7d496986f6da tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 509f8607-d9f1-41a5-bcde-2f2a9a5ac6ef could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:01.239441 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24e0b78a-3780-43b1-bf91-7d496986f6da tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/509f8607-d9f1-41a5-bcde-2f2a9a5ac6ef/action" status: 404 len: 111 microversion: 2.1 time: 0.013756 Apr 02 20:57:01.240265 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 710/1596] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:01 2022] POST /compute/v2.1/servers/509f8607-d9f1-41a5-bcde-2f2a9a5ac6ef/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:01.248875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.249727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.254991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.255659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.256277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:01.257692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.258220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.259178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.259629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.336920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.349991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ac6d281-f36f-48e8-ae07-1989b8efa589 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.151645 Apr 02 20:57:01.359101 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 887/1597] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:01.365473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.366096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.373205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.373665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.374914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.375528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.517466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.525432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.531313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.536688 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b325ab8-06d5-4ef5-b40a-5599232d571c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.184629 Apr 02 20:57:01.537591 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 888/1598] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:01.545027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.545602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.564493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.565202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.566565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.567240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.707549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.725035 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0f31b6f-94d6-4c1c-8381-56cbbbadde85 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.184629 Apr 02 20:57:01.728727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 889/1599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:01.745638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.749556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.762263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.762734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.763935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.764480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.898848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.907416 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-319a992b-c4bc-4fa2-9a3c-48fac19e13ea tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.662921 Apr 02 20:57:01.908372 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 711/1600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:01.945723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:01.953489 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8eea3c22-3bee-40ec-9bbc-46db80a3101b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.221406 Apr 02 20:57:01.954194 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 890/1601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:01.959661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:01.960573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:01.966737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.967551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:01.968558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:01.969086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.054779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-247740334", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "eb9b7612-59b4-4022-aa4f-4de8d7979f06"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:02.112530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] validate_networks() for [('eb9b7612-59b4-4022-aa4f-4de8d7979f06', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:57:02.185491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.195561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68e52d54-3753-4f78-b4a4-6e08ea54d94b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.239820 Apr 02 20:57:02.196340 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 891/1602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:01 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:02.213679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:02.215505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.221781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.222778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.222992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.223425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.240253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. Apr 02 20:57:02.241053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:02.242148 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1620ae5d-7949-4a8e-8b45-a72399090671 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc/action" status: 404 len: 111 microversion: 2.1 time: 0.033214 Apr 02 20:57:02.243127 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 892/1603] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:02 2022] POST /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:57:02.251490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.252217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.259326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.260136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.261293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.261796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.462456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.471342 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f05733cc-8586-4565-8b92-7b13defb9365 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.227058 Apr 02 20:57:02.480798 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 893/1604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:02.480798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.480798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.485729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.486677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.487914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.488561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.514863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:57:02.515890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:57:02.516855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:57:02.517484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:57:02.517982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:57:02.527763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.528317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.529286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.529809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.547519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:57:02.552360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for user 4eaee1ddad0041828fb2e65677e2da25 and project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:57:02.563928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:57:02.567229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:57:02.614427 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a502654b-85ca-4eeb-9c0f-b7a01d182a5a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.704574 Apr 02 20:57:02.615817 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 712/1605] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:57:02.621060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.621689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.630573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.631046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.631851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.632301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.670298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.671282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.672311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.672973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:02.680673 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11550181-38c2-4edc-86ae-fa77cb5dedbe tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.207216 Apr 02 20:57:02.681294 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 894/1606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:02.686725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.687506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.696306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.696668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.697447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.697942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.734474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.746892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-453be125-39a8-4082-9143-39adb557fa87 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.129580 Apr 02 20:57:02.748970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 713/1607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:02.754174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46921f45-8a9e-43f3-95c8-33ded7c8e476 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.754801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46921f45-8a9e-43f3-95c8-33ded7c8e476 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.765703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.774067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.775614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.776769 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ecfb61f2-085c-47a7-912c-444b22c4e81f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.093603 Apr 02 20:57:02.788896 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 895/1608] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:02.793816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.794425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.801306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.801760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.802536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.803085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.831793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46921f45-8a9e-43f3-95c8-33ded7c8e476 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.840334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46921f45-8a9e-43f3-95c8-33ded7c8e476 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.842382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46921f45-8a9e-43f3-95c8-33ded7c8e476 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.843788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46921f45-8a9e-43f3-95c8-33ded7c8e476 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1261 microversion: 2.25 time: 0.093849 Apr 02 20:57:02.844472 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 714/1609] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:02.849935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.850923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.857370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.857939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.858866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.859457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.944661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.954251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7088b71-5079-4fa2-924f-9fbcbfc107c0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.108486 Apr 02 20:57:02.954851 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 715/1610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:02.976584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:02.978005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:02.989498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.989910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:02.990686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:02.994924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:02.995773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.000617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5c255f1-3588-4148-9023-90abad110ea1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.210567 Apr 02 20:57:03.001585 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 896/1611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.026656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d82d91e8-0e7a-4bc9-83fd-46378e49096d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:03.028350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d82d91e8-0e7a-4bc9-83fd-46378e49096d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: df0d95c9-5b6c-4900-836e-fe172d5f6899] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.034021 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d82d91e8-0e7a-4bc9-83fd-46378e49096d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance df0d95c9-5b6c-4900-836e-fe172d5f6899 could not be found. Apr 02 20:57:03.035413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d82d91e8-0e7a-4bc9-83fd-46378e49096d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance df0d95c9-5b6c-4900-836e-fe172d5f6899 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:03.036856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d82d91e8-0e7a-4bc9-83fd-46378e49096d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/df0d95c9-5b6c-4900-836e-fe172d5f6899/action" status: 404 len: 111 microversion: 2.1 time: 0.020204 Apr 02 20:57:03.038041 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 897/1612] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:03 2022] POST /compute/v2.1/servers/df0d95c9-5b6c-4900-836e-fe172d5f6899/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:03.047619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.048242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.056285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.056761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.058500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.059176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.174526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.182675 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a75f7a5e-e277-4a95-b411-566f9f0a86af tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.213745 Apr 02 20:57:03.187424 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 716/1613] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:02 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:03.259363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.266971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1eaa64fb-6a8e-49c3-b0dd-c2c7952dfcad tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.224199 Apr 02 20:57:03.267547 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 898/1614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.284940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.285567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.291523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.291926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.292739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.293189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.436289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.444390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9e60fb30-522f-4091-adb9-66594cf016fd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.163818 Apr 02 20:57:03.445464 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 717/1615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.462493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df343aa8-2d7e-40a6-9024-6df9a8324096 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:03.463042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df343aa8-2d7e-40a6-9024-6df9a8324096 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: a056be58-bd1d-49da-9235-c9062133d188] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.468312 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-df343aa8-2d7e-40a6-9024-6df9a8324096 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance a056be58-bd1d-49da-9235-c9062133d188 could not be found. Apr 02 20:57:03.468958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df343aa8-2d7e-40a6-9024-6df9a8324096 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance a056be58-bd1d-49da-9235-c9062133d188 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:03.469789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df343aa8-2d7e-40a6-9024-6df9a8324096 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/a056be58-bd1d-49da-9235-c9062133d188/action" status: 404 len: 111 microversion: 2.1 time: 0.011554 Apr 02 20:57:03.470355 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 899/1616] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:03 2022] POST /compute/v2.1/servers/a056be58-bd1d-49da-9235-c9062133d188/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:03.478616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.479238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.485296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.485743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.486536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.486983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.488893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.490226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.497391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.497851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.498633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.499134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.645057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.648994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.653092 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1323faf-0d69-4cb7-87f7-5c0aaa49f662 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.178422 Apr 02 20:57:03.653859 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 718/1617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.657252 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c89f260a-008b-4a66-9840-6855697cda9f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.172954 Apr 02 20:57:03.658010 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 900/1618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.670334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.670955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.676819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.677282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.678064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.678513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.767363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.769366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.778243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.779083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.779967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.780541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.818052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.818514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.819459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:03.836841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.845103 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-322f792a-96a1-4f39-96d8-1b638dbe6221 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.178504 Apr 02 20:57:03.845873 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 719/1619] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.859044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.859832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.861089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.867418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.867882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.868755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.869192 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5c8202d-fc16-4478-b502-b2542a3c055c tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.109925 Apr 02 20:57:03.869326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.869766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 901/1620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:03.884046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:03.884699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.891093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.891677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.892557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.893087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.918727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'restore' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active Apr 02 20:57:03.921867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'restore' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:03.921867 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-27e67c5e-4fcf-4a89-8c44-d3d02fc37fd9 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 145 microversion: 2.1 time: 0.049862 Apr 02 20:57:03.921867 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 902/1621] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:03 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 145 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:57:03.926758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.927462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.933444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.933975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.934816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.935323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.947790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.955872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.957489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:03.958678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c860553-5b3b-4bbc-9f3a-a752d423a08a tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.105008 Apr 02 20:57:03.959599 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 720/1622] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:03.965642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:03.966504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:03.972734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.973227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:03.974010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:03.974461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.000872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.009786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.011427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.012785 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d724b93-df48-4cf6-8b03-f3d0dc4faadd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1265 microversion: 2.25 time: 0.090312 Apr 02 20:57:04.013332 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 903/1623] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:04.018139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.018792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.025757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.026938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.027909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.028379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.095340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.103715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b607f5a5-44b7-4134-828b-ae897a0e0271 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1204 microversion: 2.1 time: 0.089076 Apr 02 20:57:04.104427 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 904/1624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.126294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.135549 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8f2cb03d-0cf3-4707-933a-9ffc2f0e900c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.173351 Apr 02 20:57:04.136479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 721/1625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:03 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.161964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.162951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.172911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.172911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.173688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.174353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.200787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.201624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.207823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.208287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.209099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.209595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.326517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.336021 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32f6e16c-1a85-437a-91a5-1244920afa0a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.181044 Apr 02 20:57:04.336780 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 905/1626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.352761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92e33a98-a0c4-43bd-ba09-19fc68416fe0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:04.356010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.356360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-92e33a98-a0c4-43bd-ba09-19fc68416fe0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: f36e575a-4608-4290-9afb-96af47cab225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.361807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-92e33a98-a0c4-43bd-ba09-19fc68416fe0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance f36e575a-4608-4290-9afb-96af47cab225 could not be found. Apr 02 20:57:04.363104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92e33a98-a0c4-43bd-ba09-19fc68416fe0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance f36e575a-4608-4290-9afb-96af47cab225 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:04.364047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92e33a98-a0c4-43bd-ba09-19fc68416fe0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/f36e575a-4608-4290-9afb-96af47cab225/action" status: 404 len: 111 microversion: 2.1 time: 0.015239 Apr 02 20:57:04.364545 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f59ded77-904b-45f7-8fcc-2fb525a6217d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.168067 Apr 02 20:57:04.373476 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 722/1627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.373667 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 906/1628] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:04 2022] POST /compute/v2.1/servers/f36e575a-4608-4290-9afb-96af47cab225/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:57:04.379187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.379933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.385842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.386382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.387186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.387624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.532610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.540736 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-292af3e7-cd55-43af-b5c5-0861e3568995 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.165638 Apr 02 20:57:04.541421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 723/1629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.560113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.560764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.569628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.570565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.571550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.572163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.682039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.683007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.690694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.692762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.697390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.701726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.798851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.807905 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25d95fbd-65eb-4354-bb17-10a95281e241 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.252319 Apr 02 20:57:04.809004 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 907/1630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.826021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:04.827733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.837027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.837742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.838547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.838995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.867873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'resume' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active Apr 02 20:57:04.868624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'resume' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:04.869484 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e92d583c-0c3d-4c7a-9cbd-24caa01a646d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 144 microversion: 2.1 time: 0.047714 Apr 02 20:57:04.870047 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 908/1631] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:04 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 144 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:57:04.882626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.882626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.892692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.894379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.895653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.896095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.919451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:04.926972 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38f3c001-7fbe-459a-9c66-77b29c8845c1 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.253883 Apr 02 20:57:04.928370 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 724/1632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:04.933489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:04.934112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:04.942621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.943082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.943982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.944435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.983224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:04.983907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:04.984557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid bd846a15-f5e0-4225-86ac-1616ce4995b2 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:05.035741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.060812 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5628ce89-b19d-4417-a806-c87d52667302 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 200 len: 1306 microversion: 2.1 time: 0.131310 Apr 02 20:57:05.075128 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 725/1633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:05.080324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.081889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.098875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.105637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.107087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.108331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.108642 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f057f97c-ce54-48b7-93ad-5ef7a30692a6 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.232963 Apr 02 20:57:05.109225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.122708 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 909/1634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:04 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:05.129884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.130516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.139573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.140088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.140995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.141561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.212881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.241493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.246234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.249478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20cbe3f3-2755-47f4-a698-7cc7c4a0361f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.173170 Apr 02 20:57:05.253433 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 726/1635] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:05.253581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.261623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.265198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.265359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.271199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.272719 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09b62f67-07e4-4fc4-8005-e5446afb352f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1313 microversion: 2.25 time: 0.148761 Apr 02 20:57:05.273284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.274297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.275294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.275961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.277485 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 910/1636] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:05.291770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.292400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.299505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.300538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.301331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.301780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.436079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.452619 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6ecac60-353a-480c-875a-5883ba8bbc49 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1278 microversion: 2.1 time: 0.197637 Apr 02 20:57:05.453215 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 727/1637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:05.464440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.469417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.480115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.480736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.481818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.482347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.513355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.527674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a57af21b-ac77-4bc2-a1b5-1536265dd099 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.248812 Apr 02 20:57:05.532519 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 911/1638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:05.636663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4632c092-0a9a-4483-acdd-d0a81d58ecde tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "2427a2f7-cca3-4878-92a4-fe77defc6f38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:05.638544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4632c092-0a9a-4483-acdd-d0a81d58ecde tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:05.639364 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4632c092-0a9a-4483-acdd-d0a81d58ecde tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.006683 Apr 02 20:57:05.639900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 912/1639] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:57:05 2022] POST /compute/v2.1/servers => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 20:57:05.648078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.648715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.656677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.657773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.658646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.660066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.810392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.820349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a7299ead-5549-4ae4-9772-4fbbabbde65e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.175972 Apr 02 20:57:05.821361 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 913/1640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:05.840249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:05.841472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.842099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.848816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.849274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.850067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.850572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.853381 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4f1dd00-3825-467f-9b15-6ae7ed82f915 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.398488 Apr 02 20:57:05.854875 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 728/1641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:05.945989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:05.951864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:05.964069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.967319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:05.968363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:05.973141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.032281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.043494 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b7acd26-0f34-4eff-99fa-693de9bfc7b0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.207894 Apr 02 20:57:06.044609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 914/1642] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:06.061542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-273f7583-561b-4973-a6da-a9410380863f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:06.062410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-273f7583-561b-4973-a6da-a9410380863f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 092bebe3-65d2-4715-aebf-4c1299f95578] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.068924 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-273f7583-561b-4973-a6da-a9410380863f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 092bebe3-65d2-4715-aebf-4c1299f95578 could not be found. Apr 02 20:57:06.069520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-273f7583-561b-4973-a6da-a9410380863f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 092bebe3-65d2-4715-aebf-4c1299f95578 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:06.070781 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-273f7583-561b-4973-a6da-a9410380863f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/092bebe3-65d2-4715-aebf-4c1299f95578/action" status: 404 len: 111 microversion: 2.1 time: 0.013577 Apr 02 20:57:06.071343 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 915/1643] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:06 2022] POST /compute/v2.1/servers/092bebe3-65d2-4715-aebf-4c1299f95578/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:57:06.079380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.080605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: bd846a15-f5e0-4225-86ac-1616ce4995b2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.089602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.090857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.091662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.092577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.108084 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance bd846a15-f5e0-4225-86ac-1616ce4995b2 could not be found. Apr 02 20:57:06.108634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance bd846a15-f5e0-4225-86ac-1616ce4995b2 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:06.109489 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43c79781-52ae-4f00-bd77-617a62208a38 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2" status: 404 len: 111 microversion: 2.1 time: 0.034468 Apr 02 20:57:06.110055 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 916/1644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/bd846a15-f5e0-4225-86ac-1616ce4995b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:57:06.117633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.118509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.124768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.125413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.126592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.127196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.310268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.318089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d09ccbdc-06bc-44da-ae02-48d18f79f311 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.204516 Apr 02 20:57:06.318970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 917/1645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:06.330580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.331989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.338863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.339994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.341047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.341843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.350262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.357940 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f13e8a91-cb57-46dc-9c8d-ff33a647dbe5 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.418410 Apr 02 20:57:06.367464 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 729/1646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:05 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:06.371837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:06.373197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.374020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.380770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.381537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.382609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.383139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.484285 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf61b21b-ef59-42cd-9dcb-93fdae42a83f tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 204 len: 0 microversion: 2.1 time: 0.163205 Apr 02 20:57:06.485263 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 918/1647] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:06 2022] DELETE /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:06.492427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.494052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.500771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.502083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.502083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.502518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.543909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.552187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.554109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.555999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8e77cfd9-1fd6-47f8-b67c-5583c82d2a9b tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.186709 Apr 02 20:57:06.556675 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 730/1648] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:06.572152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.572968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.573677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.580559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.581972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.582964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.583616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.584908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.587022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.588713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe16efd7-1330-43d8-91e0-a0b4f66b5232 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1319 microversion: 2.25 time: 0.101793 Apr 02 20:57:06.599424 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 919/1649] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:06.599424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.599424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.606817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.607422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.609767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.610329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.682614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:06.690864 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a526c24c-8825-46ec-b14c-dae27ac5bbc5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1266 microversion: 2.1 time: 0.099869 Apr 02 20:57:06.691718 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 920/1650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:06.696583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.697312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.702885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.703342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.704245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.704716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.730414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:06.822339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3d5fbd7c-20a7-4710-8a21-b6e1f8e5c959 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 204 len: 0 microversion: 2.1 time: 0.129448 Apr 02 20:57:06.823487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 921/1651] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:06 2022] DELETE /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:06.832894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:06.834055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:06.840652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.841503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:06.842525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:06.843026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.077865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.087025 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8f2443b-832d-45e5-8309-eaf09b0d4125 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1475 microversion: 2.1 time: 0.259315 Apr 02 20:57:07.087644 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 922/1652] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1475 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:07.100923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:07.101671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:07.109365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.109820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.110659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.111124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.172275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.182704 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-54eb6740-984b-494e-9325-2ceb7677fb7d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.624456 Apr 02 20:57:07.186389 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 731/1653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:06 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:07.199983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:07.200646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:07.207829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.208829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.210633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.211213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.254091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lazy-loading 'flavor' on Instance uuid d88c5184-0805-4677-a11d-4077b9465e11 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:07.342848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.351212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eeb3e39c-0dbf-44ff-8ff6-dd34fd02bc2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.262280 Apr 02 20:57:07.363488 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 923/1654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:07 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:07.375917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:07.377083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:07.385889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.387035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.388391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.389279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.576372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.587690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a81993a-fd79-41bc-8dff-3d0d97a238af tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 200 len: 1388 microversion: 2.1 time: 0.217329 Apr 02 20:57:07.589103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 924/1655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:07 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 1388 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:07.595283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:07.595908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:07.603053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.603513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.604803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.605839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.623684 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3cf3a5cf-90cb-4a9f-aa85-f01bbffebfee tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 202 len: 0 microversion: 2.1 time: 0.427385 Apr 02 20:57:07.624722 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 732/1656] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:07 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 20:57:07.631435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:07.632429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:07.639012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.640244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.641305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.641977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.706440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.716162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.717721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:07.719121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4bb3b45d-e7d3-4492-b2bb-8a6dd8e9cc5d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.128725 Apr 02 20:57:07.724596 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 925/1657] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:07 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:07.725100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:07.725837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:07.731877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.732486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:07.733427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:07.733843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.173548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:08.182133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:08.184223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:08.185639 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c20639f-a217-4f85-9ee6-923cc4a99ae4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.559193 Apr 02 20:57:08.187010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 733/1658] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:07 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:08.192893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:08.193778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:08.200550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.201064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.202514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.203106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.398100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:08.412706 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5e5729d-66ec-48c6-aba7-ab64b0f4a2c4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.691735 Apr 02 20:57:08.416358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 926/1659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:07 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:08.425600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:08.427285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:08.447084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.449395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.453197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.453851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.783515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:08.792815 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fec9915c-b1cd-4e6a-98f2-17d370a76cd9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 200 len: 1475 microversion: 2.1 time: 0.375097 Apr 02 20:57:08.793694 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 927/1660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:08 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 1475 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:08.808538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c7681d73-a0ee-41f1-930e-12dca9edcc95 req-237aff64-b1fe-4f40-ab36-2f367cf068b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9730a5f5-5e43-46cf-aa28-9d9031f06a40", "name": "network-vif-deleted", "tag": "01630476-a097-41f9-be67-f49e683617f0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:08.818095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c7681d73-a0ee-41f1-930e-12dca9edcc95 req-237aff64-b1fe-4f40-ab36-2f367cf068b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.818551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c7681d73-a0ee-41f1-930e-12dca9edcc95 req-237aff64-b1fe-4f40-ab36-2f367cf068b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.830542 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c7681d73-a0ee-41f1-930e-12dca9edcc95 req-237aff64-b1fe-4f40-ab36-2f367cf068b9 service nova] Creating event network-vif-deleted:01630476-a097-41f9-be67-f49e683617f0 for instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 on nch1-master-1 Apr 02 20:57:08.838853 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c7681d73-a0ee-41f1-930e-12dca9edcc95 req-237aff64-b1fe-4f40-ab36-2f367cf068b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Apr 02 20:57:08.839802 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 928/1661] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:08.844955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:08.845819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:08.853264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.853896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:08.854889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:08.855509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.183141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:09.211322 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c728003-244b-4192-be89-c97916275b5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.370207 Apr 02 20:57:09.211936 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 929/1662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:08 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:09.229956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:09.230824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 9730a5f5-5e43-46cf-aa28-9d9031f06a40] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:09.250633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.255237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.261528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.262456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.291229 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] HTTP exception thrown: Instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 could not be found. Apr 02 20:57:09.292161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Returning 404 to user: Instance 9730a5f5-5e43-46cf-aa28-9d9031f06a40 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:09.293726 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c526a81c-d040-4da2-9a3b-e973886c6607 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40" status: 404 len: 111 microversion: 2.1 time: 0.068547 Apr 02 20:57:09.295238 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 930/1663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:09 2022] GET /compute/v2.1/servers/9730a5f5-5e43-46cf-aa28-9d9031f06a40 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:09.304167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:09.310290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:09.320283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.329561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.330692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.331336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.357729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:09.366455 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11dc72e0-64b3-4779-b1c2-d85ed7873329 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 1.178141 Apr 02 20:57:09.367035 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 734/1664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:08 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:09.382302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-29b41ce2-0484-47c1-9cce-f4a5ba5ab5fd req-73019a04-36a2-498a-ac45-431997d5e725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbcd800d-a825-4c87-a87a-abb91db1128e", "name": "network-vif-deleted", "tag": "40a52eb8-652d-48d4-9919-f80edab0a6d3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:09.408724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-29b41ce2-0484-47c1-9cce-f4a5ba5ab5fd req-73019a04-36a2-498a-ac45-431997d5e725 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.410002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-29b41ce2-0484-47c1-9cce-f4a5ba5ab5fd req-73019a04-36a2-498a-ac45-431997d5e725 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.435333 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-29b41ce2-0484-47c1-9cce-f4a5ba5ab5fd req-73019a04-36a2-498a-ac45-431997d5e725 service nova] Creating event network-vif-deleted:40a52eb8-652d-48d4-9919-f80edab0a6d3 for instance dbcd800d-a825-4c87-a87a-abb91db1128e on nch1-master-1 Apr 02 20:57:09.442031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:09.453006 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-29b41ce2-0484-47c1-9cce-f4a5ba5ab5fd req-73019a04-36a2-498a-ac45-431997d5e725 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072958 Apr 02 20:57:09.454897 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 735/1665] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:09.470295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:09.478282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:09.479271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:09.481055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:09.487079 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e8f5f01-a409-48cc-8a83-32b86912e496 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.189545 Apr 02 20:57:09.488324 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 931/1666] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:09 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:09.503030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.503513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.504327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.504809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.505865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:09.506714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:09.515310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.516009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.517158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.517874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.771872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:09.784994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a2bd462-af5a-4dec-9dc5-187387f5cc53 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.282649 Apr 02 20:57:09.786433 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 932/1667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:09 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:09.817821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:09.818474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: dbcd800d-a825-4c87-a87a-abb91db1128e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:09.838978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.839503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.840524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.841135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.861578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance dbcd800d-a825-4c87-a87a-abb91db1128e could not be found. Apr 02 20:57:09.863823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance dbcd800d-a825-4c87-a87a-abb91db1128e could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:09.865786 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f0ae70b-2c02-4fed-9707-a1dd5789ea82 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e" status: 404 len: 111 microversion: 2.1 time: 0.057916 Apr 02 20:57:09.867289 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 933/1668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:09 2022] GET /compute/v2.1/servers/dbcd800d-a825-4c87-a87a-abb91db1128e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:09.881316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:09.882408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:09.891851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.892668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:09.894252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:09.894861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.139447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.155426 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-174cd701-858d-4949-af20-999edaab9000 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1475 microversion: 2.1 time: 0.281926 Apr 02 20:57:10.156018 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 934/1669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:09 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:10.180787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.196330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.197894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.199378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4de5a6ae-fd8e-415a-b1a5-dabd5ec391a9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.742260 Apr 02 20:57:10.200147 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 736/1670] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:09 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:10.241595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:10.243167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:10.259140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.259598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.260997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.261966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.387392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:10.388617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:10.397605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.398383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.399727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.400386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.435388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.446559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb7b86ff-dcd3-4491-be5d-a37018763501 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.217114 Apr 02 20:57:10.448802 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 935/1671] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:10 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:10.510181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:10.510854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:10.517427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.517948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.519424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.519939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.598211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.604718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.606352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:10.607557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d69a5b23-76fb-44c9-b2ad-b6cc756b7c8c tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.101386 Apr 02 20:57:10.608116 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 936/1672] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:10 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:10.613781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:10.614569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:10.620948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.621684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.622693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.623129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.650075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:10.770404 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-74df8e70-77a8-40bf-a304-163244a363ca tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 204 len: 0 microversion: 2.1 time: 0.159035 Apr 02 20:57:10.771552 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 937/1673] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:10 2022] DELETE /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:10.787146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:10.788262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:10.798045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.798509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:10.799600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:10.800265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.005137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.017474 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ccf83b4f-552e-404a-8671-9beef57d0962 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1500 microversion: 2.1 time: 0.241173 Apr 02 20:57:11.019425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 938/1674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:10 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1500 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:11.035100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:11.037036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:11.047168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.048587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.050308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.051083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.055390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.062954 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a945d069-67b0-4732-8e53-313f9c184db4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.682742 Apr 02 20:57:11.063470 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 737/1675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:10 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:11.081818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-87c0efb7-0b31-4697-95ca-d40b88160e3f req-9cc5771c-305b-431f-a603-181f142c0cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea0ad92-ff3e-49af-b783-93700d77d500", "tag": "2faa1981-89af-49a0-9dd1-17e23172df4b"}, {"name": "network-changed", "server_uuid": "282887e6-5c5b-4492-8a31-c1cf713cf95f", "tag": "b729c68d-47c0-4cf5-b93a-585056bd9955"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:11.093937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-87c0efb7-0b31-4697-95ca-d40b88160e3f req-9cc5771c-305b-431f-a603-181f142c0cb9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.102780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-87c0efb7-0b31-4697-95ca-d40b88160e3f req-9cc5771c-305b-431f-a603-181f142c0cb9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.148530 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-87c0efb7-0b31-4697-95ca-d40b88160e3f req-9cc5771c-305b-431f-a603-181f142c0cb9 service nova] Creating event network-changed:2faa1981-89af-49a0-9dd1-17e23172df4b for instance 3ea0ad92-ff3e-49af-b783-93700d77d500 on nch1-master-1 Apr 02 20:57:11.149039 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-87c0efb7-0b31-4697-95ca-d40b88160e3f req-9cc5771c-305b-431f-a603-181f142c0cb9 service nova] Creating event network-changed:b729c68d-47c0-4cf5-b93a-585056bd9955 for instance 282887e6-5c5b-4492-8a31-c1cf713cf95f on nch1-master-1 Apr 02 20:57:11.156217 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-87c0efb7-0b31-4697-95ca-d40b88160e3f req-9cc5771c-305b-431f-a603-181f142c0cb9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077941 Apr 02 20:57:11.161913 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 738/1676] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:11.182716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:11.186766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:11.194837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.196150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.197399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.198020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.254428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.256703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.257659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid b28db20e-e3fa-4bb8-8060-48e2e5026d99 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:11.306853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.316655 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d538ef84-c838-480b-858a-72f66f7616cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.294627 Apr 02 20:57:11.317405 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 939/1677] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:11 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:11.322959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:11.323711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:11.330796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.331451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.332197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.332776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.386931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.395775 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6aa9216-8ee6-476f-9746-f0a33402a4d9 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 200 len: 1309 microversion: 2.1 time: 0.225673 Apr 02 20:57:11.406111 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 739/1678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:11 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:11.465980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:11.466892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:11.473756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.474444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.475551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.476004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.572713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.584039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.585815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.587393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7425195c-31e3-4000-a746-55d0a28cc3e2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.268927 Apr 02 20:57:11.588097 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 940/1679] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:11 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:11.628439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:11.629082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:11.635142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.635600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.636445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:11.637456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:11.733023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.748876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.750653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.751863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d655176-7517-43ca-bc0c-6aca67d14106 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.127544 Apr 02 20:57:11.752703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 941/1680] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:11 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:11.864044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:11.872437 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-740ba3bd-9136-4705-a706-f62a40180556 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.411356 Apr 02 20:57:11.882386 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 740/1681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:11 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:12.036237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.036976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.043969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.044929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.045979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.046485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.082415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.083166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.101872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.103647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.104856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.105531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.375607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:12.391369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:12.405961 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70f48d32-28dd-4b0f-a77c-5125255b432f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 200 len: 1500 microversion: 2.1 time: 0.374291 Apr 02 20:57:12.410979 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-badf0f6a-988d-4c09-b4b4-4b62abfac746 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.334101 Apr 02 20:57:12.412141 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 741/1682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:12.412604 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 942/1683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:12.425835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.427208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.428731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.429211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: b28db20e-e3fa-4bb8-8060-48e2e5026d99] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.442534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.444118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.445710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.447150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.447941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.448747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.453006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.453917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.494314 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance b28db20e-e3fa-4bb8-8060-48e2e5026d99 could not be found. Apr 02 20:57:12.495061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance b28db20e-e3fa-4bb8-8060-48e2e5026d99 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:12.495983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a102b02a-a1db-4e63-8990-dfe1f5a634ac tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99" status: 404 len: 111 microversion: 2.1 time: 0.082145 Apr 02 20:57:12.496690 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 742/1684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/b28db20e-e3fa-4bb8-8060-48e2e5026d99 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:12.504420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-1c31343c-bc74-43c1-ac39-3e9fe3c98f7a req-de919a03-8569-4589-8de0-d7b4dc58cc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b118f37c-0f35-46b9-81d4-a4c7f161dd5a", "name": "network-vif-deleted", "tag": "621c3ce8-97a3-47b2-8fb2-3a484d590744"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:12.516093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1c31343c-bc74-43c1-ac39-3e9fe3c98f7a req-de919a03-8569-4589-8de0-d7b4dc58cc53 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.519339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1c31343c-bc74-43c1-ac39-3e9fe3c98f7a req-de919a03-8569-4589-8de0-d7b4dc58cc53 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.531780 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-1c31343c-bc74-43c1-ac39-3e9fe3c98f7a req-de919a03-8569-4589-8de0-d7b4dc58cc53 service nova] Creating event network-vif-deleted:621c3ce8-97a3-47b2-8fb2-3a484d590744 for instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a on nch1-master-1 Apr 02 20:57:12.538606 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-1c31343c-bc74-43c1-ac39-3e9fe3c98f7a req-de919a03-8569-4589-8de0-d7b4dc58cc53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039772 Apr 02 20:57:12.539823 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 743/1685] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:12.546365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e12cc7c-7f1e-4a0e-83a8-4ae37138cf7b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.593842 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e12cc7c-7f1e-4a0e-83a8-4ae37138cf7b tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/5f064ad4-7f4a-4ec0-91c2-9cb77201bda0" status: 204 len: 0 microversion: 2.1 time: 0.052166 Apr 02 20:57:12.594937 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 744/1686] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 20:57:12 2022] DELETE /compute/v2.1/os-server-groups/5f064ad4-7f4a-4ec0-91c2-9cb77201bda0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:12.605484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.607031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.615078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.616536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.617515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.618154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.653285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:12.725765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:12.741687 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd92f4bb-926b-45ae-ae29-62a28bb858d5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.326226 Apr 02 20:57:12.741955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 943/1687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:12.748544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.749569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.758144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.758623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.758838 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5048eb16-1c30-4f5e-9d64-8ec49cea0e29 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 204 len: 0 microversion: 2.1 time: 0.158187 Apr 02 20:57:12.759648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.759820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 745/1688] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:12 2022] DELETE /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:57:12.760655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.770582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.771614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.778319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.778997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.780022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.780502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.810291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:12.900643 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51449246-e34a-4a2d-87a9-dce4462965dc tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 204 len: 0 microversion: 2.1 time: 0.135164 Apr 02 20:57:12.903019 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 746/1689] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:12 2022] DELETE /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:12.910803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.911524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.917819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.918281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.919701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.920155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.924688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:12.934179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:12.937283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:12.938707 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42d159cd-dc1e-46b7-a33b-65998670cbf8 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.195215 Apr 02 20:57:12.950259 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 944/1690] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:12.950259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:12.951399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:12.960636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.961306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:12.962232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:12.962688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.020038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.030319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.031858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.033731 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b93c8873-8b72-44fe-ac89-5260210b213e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.127236 Apr 02 20:57:13.044687 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 747/1691] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:13.044687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.044687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.049412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.049412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.049894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.050270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.147974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.158432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-103dd73d-90e5-4326-abfd-d670d21702a8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.213441 Apr 02 20:57:13.159630 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 945/1692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:12 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:13.189738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4dec3ad1-536c-43dd-9b70-8a72d006eab2 req-e4647d13-8be1-42e6-8829-1f5d15d6ddf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28db20e-e3fa-4bb8-8060-48e2e5026d99", "name": "network-vif-deleted", "tag": "7bb57a04-3148-4720-b93e-5fc3a96b579e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:13.199543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4dec3ad1-536c-43dd-9b70-8a72d006eab2 req-e4647d13-8be1-42e6-8829-1f5d15d6ddf4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.200088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4dec3ad1-536c-43dd-9b70-8a72d006eab2 req-e4647d13-8be1-42e6-8829-1f5d15d6ddf4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.213263 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4dec3ad1-536c-43dd-9b70-8a72d006eab2 req-e4647d13-8be1-42e6-8829-1f5d15d6ddf4 service nova] Creating event network-vif-deleted:7bb57a04-3148-4720-b93e-5fc3a96b579e for instance b28db20e-e3fa-4bb8-8060-48e2e5026d99 on nch2-master-1 Apr 02 20:57:13.219187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4dec3ad1-536c-43dd-9b70-8a72d006eab2 req-e4647d13-8be1-42e6-8829-1f5d15d6ddf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034672 Apr 02 20:57:13.220053 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 946/1693] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:13.250104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.260308 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-def1d506-3f25-4509-9458-097ea5bba3c4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 200 len: 1474 microversion: 2.1 time: 0.224594 Apr 02 20:57:13.260932 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 748/1694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:13 2022] GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 1474 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:13.423364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.424081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: b118f37c-0f35-46b9-81d4-a4c7f161dd5a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.430433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.431064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.431884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.432288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.433237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.433868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.438508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.438968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.439757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.440440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.449273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] HTTP exception thrown: Instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a could not be found. Apr 02 20:57:13.452925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Returning 404 to user: Instance b118f37c-0f35-46b9-81d4-a4c7f161dd5a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:13.454220 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-160920ae-7830-4a26-be70-d0666adae24c tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a" status: 404 len: 111 microversion: 2.1 time: 0.034942 Apr 02 20:57:13.454952 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 947/1695] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:13 2022] GET /compute/v2.1/servers/b118f37c-0f35-46b9-81d4-a4c7f161dd5a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:13.463203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.463743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.474202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.474976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.476330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.477279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.509749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:13.603065 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ab0c3e6-3c01-4f9b-9c47-e54d144387e6 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 204 len: 0 microversion: 2.1 time: 0.143175 Apr 02 20:57:13.604013 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 948/1696] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:13 2022] DELETE /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:13.615994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.616860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.617587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.623008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.623475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.624294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.624782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.625217 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-560d6a38-9185-4b84-9cb6-078538aabbd4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.199433 Apr 02 20:57:13.625800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 749/1697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:13 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:13.759417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.760045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.767105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.767658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.769500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.770226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.786834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.795421 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb647685-5034-4c2e-b49e-d2d9b8f3cf24 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1485 microversion: 2.1 time: 0.186326 Apr 02 20:57:13.796092 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 949/1698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:13 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1485 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:13.919262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:13.927394 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b5c713d-564b-4d8a-a6c4-e783d62acd3f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.171927 Apr 02 20:57:13.927953 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 750/1699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:13 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:13.957917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:13.958526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:13.964831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.965389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:13.966232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:13.966856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.053297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:14.053917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:14.060007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.060490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.061259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.061698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.111852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.121729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.123445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.124773 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d3b5c10d-2080-48cf-af9e-c25a3cba544d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.170724 Apr 02 20:57:14.125729 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 950/1700] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:13 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:14.145341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.153628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.155303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.156589 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a8b01b9b-f530-4912-8cb3-812965eaefec tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.107830 Apr 02 20:57:14.157446 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 751/1701] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:14 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:57:14.176887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:14.177853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:14.185781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.186518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.187313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.187950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.280507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:14.281388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:14.293871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.294842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.296726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.297435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.368618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.377480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd61f3db-0d99-40aa-b061-5157670f80ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.205745 Apr 02 20:57:14.378260 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 951/1702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:14 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:14.645134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:14.645134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:14.652050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.652669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.653464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.653902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.813390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.828613 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-84208166-eb3c-4ae5-9895-057dbf05871c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.189286 Apr 02 20:57:14.836634 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 952/1703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:14 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:14.842400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:14.842400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:14.848605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.849074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.849919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:14.850616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:14.997141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:14.999906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.006311 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21ec43a9-c076-46f5-a44e-fea428095f83 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 200 len: 1474 microversion: 2.1 time: 0.731002 Apr 02 20:57:15.007403 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 752/1704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:14 2022] GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 1474 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:15.009699 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c7bde71-271e-4c2e-bc68-ab5084d0faed tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1485 microversion: 2.1 time: 0.178358 Apr 02 20:57:15.019445 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 953/1705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:14 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1485 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:15.022438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:15.023144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:15.029780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.030518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.031477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.032049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.143187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:15.143961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:15.153520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.154222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.155164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.155604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.302641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.310861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.312482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.313719 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6722f506-1583-44ee-96e1-3d4830e80fac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.174585 Apr 02 20:57:15.324898 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 954/1706] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:15 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:57:15.329121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:15.329844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:15.336817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.339272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.342504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.343031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.424347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.434008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.435612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.436852 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-235ee2ea-7157-4b08-9e99-42c2798e6144 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.121006 Apr 02 20:57:15.437423 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 955/1707] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:15 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:15.456952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:15.457961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:15.465868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.466321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.467423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.467870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.569081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.577817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b51c93e3-8316-40a8-b25a-357bc7f223ab tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.569020 Apr 02 20:57:15.578766 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 753/1708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:15 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:15.685214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:15.702776 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02fdf1f2-65b8-4a8b-8873-06f94eb50c29 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.251719 Apr 02 20:57:15.722736 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 956/1709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:15 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:15.822344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-14cd4429-a224-403d-bc4e-422aebeb0990 req-8535c200-dcc2-4ba5-842e-6a30ce3025e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23aa3120-1d16-4505-a3c5-0ba81a38c743", "name": "network-vif-deleted", "tag": "c462078a-088f-40a2-8510-d6fb4357f7dc"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:15.847906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:15.848819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:15.859102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-14cd4429-a224-403d-bc4e-422aebeb0990 req-8535c200-dcc2-4ba5-842e-6a30ce3025e4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.859316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.860151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-14cd4429-a224-403d-bc4e-422aebeb0990 req-8535c200-dcc2-4ba5-842e-6a30ce3025e4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.860532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.862778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:15.864256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:15.900260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-14cd4429-a224-403d-bc4e-422aebeb0990 req-8535c200-dcc2-4ba5-842e-6a30ce3025e4 service nova] Creating event network-vif-deleted:c462078a-088f-40a2-8510-d6fb4357f7dc for instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 on nch1-master-1 Apr 02 20:57:15.914142 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-14cd4429-a224-403d-bc4e-422aebeb0990 req-8535c200-dcc2-4ba5-842e-6a30ce3025e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101226 Apr 02 20:57:15.915028 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 754/1710] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:16.026145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:16.027865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:16.042107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.045409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.046584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.050783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.199813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.210072 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c96c2c06-f3ab-4772-855b-b3db4c60c4d2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.366311 Apr 02 20:57:16.211053 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 957/1711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:15 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:16.217116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:16.218075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:16.227116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.235763 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6106501-be11-4304-aa04-62dfb6bf9132 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 200 len: 1303 microversion: 2.1 time: 0.215783 Apr 02 20:57:16.239888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.240797 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 755/1712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:16 2022] GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 1303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:16.241545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.244251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.244995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.296356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.297179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.297821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lazy-loading 'fault' on Instance uuid 23aa3120-1d16-4505-a3c5-0ba81a38c743 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:16.334035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:16.334858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:16.354644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.355226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.357529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.361446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.405949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.422720 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b97f6048-b3fd-4b23-aa39-802e9d3f6d92 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 200 len: 1301 microversion: 2.1 time: 0.210241 Apr 02 20:57:16.425584 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 958/1713] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:16 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 1301 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:16.455531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:16.456480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:16.474901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.475658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.476928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.477547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.661467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.669605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.671940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.673523 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a3479cf-220b-4176-b19e-89c8e87571b2 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.344745 Apr 02 20:57:16.674522 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 756/1714] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:16 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:57:16.684812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.693048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.693466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:16.694343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:16.696375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.702205 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d4c0049-6755-4107-aefa-c88ba8d82834 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.250604 Apr 02 20:57:16.702513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.702844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.703174 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 959/1715] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:16 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:16.703992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.704793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.722635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:16.723489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:16.730297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.730750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.731533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:16.731977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:16.920983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.932582 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e08ecfe-81eb-4ea9-9203-44b451bc70a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.245471 Apr 02 20:57:16.933512 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 757/1716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:16 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:16.964937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:16.973420 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-138e4b47-bac8-41ec-9cdd-a9f478ed5197 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.254444 Apr 02 20:57:16.973891 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 960/1717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:16 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:17.228269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.229454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.236770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.237904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.238786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.239603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.260178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.261139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 818956c7-a348-4c41-a48b-9c74b8ddbc66] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.268879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.269782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.270909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.271671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.291096 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance 818956c7-a348-4c41-a48b-9c74b8ddbc66 could not be found. Apr 02 20:57:17.292055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance 818956c7-a348-4c41-a48b-9c74b8ddbc66 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:17.293227 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9f9b163-2085-4646-b53f-3f20e7d793d6 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66" status: 404 len: 111 microversion: 2.1 time: 0.039699 Apr 02 20:57:17.294962 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 961/1718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/818956c7-a348-4c41-a48b-9c74b8ddbc66 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:17.305172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.307018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: a7234847-6a5b-4386-8d22-448be13057dd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.314658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.315725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.317432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.318915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.336983 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance a7234847-6a5b-4386-8d22-448be13057dd could not be found. Apr 02 20:57:17.338177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance a7234847-6a5b-4386-8d22-448be13057dd could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:17.339484 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca532deb-75e7-4c9f-9367-972a5d77c0db tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd" status: 404 len: 111 microversion: 2.1 time: 0.040255 Apr 02 20:57:17.340420 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 962/1719] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/a7234847-6a5b-4386-8d22-448be13057dd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:57:17.353689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f05bd85d-c23c-4b16-a2a9-ffa19cc84429 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.395545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f05bd85d-c23c-4b16-a2a9-ffa19cc84429 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/00eec1e6-85d8-4b64-8502-6cc338754735" status: 204 len: 0 microversion: 2.1 time: 0.050955 Apr 02 20:57:17.396522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 963/1720] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 20:57:17 2022] DELETE /compute/v2.1/os-server-groups/00eec1e6-85d8-4b64-8502-6cc338754735 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:57:17.405982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.406762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.414568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.415484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.416584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.417235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.418896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.430169 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d87b6b98-04d7-4f24-b6c9-e06b6212f432 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.206404 Apr 02 20:57:17.432320 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 758/1721] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:17.449257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.450641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 23aa3120-1d16-4505-a3c5-0ba81a38c743] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.459530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.463384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.464236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.464722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.465538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:17.480112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] HTTP exception thrown: Instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 could not be found. Apr 02 20:57:17.480748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Returning 404 to user: Instance 23aa3120-1d16-4505-a3c5-0ba81a38c743 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:17.481599 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a4b20cd-a698-42bb-b736-329d6f5bd184 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743" status: 404 len: 111 microversion: 2.1 time: 0.042073 Apr 02 20:57:17.482479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 759/1722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/23aa3120-1d16-4505-a3c5-0ba81a38c743 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:17.490364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.490946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.497677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.498240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.499114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.499647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.530282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:17.563260 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-130c0cb0-729d-46a6-92f9-599594a9044a tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 204 len: 0 microversion: 2.1 time: 0.162233 Apr 02 20:57:17.563926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 964/1723] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:17 2022] DELETE /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:57:17.579435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.580161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.587728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.588197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.589066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.589778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.653301 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-067b2980-98fd-426d-b427-5e211b9a890f tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "DELETE /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 204 len: 0 microversion: 2.1 time: 0.166762 Apr 02 20:57:17.655758 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 760/1724] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:17 2022] DELETE /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:17.667968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.670462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.678109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.678774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.679803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.680543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.747840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.756684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26696730-f5f4-462a-8324-fd19784a34cd tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1471 microversion: 2.1 time: 0.185003 Apr 02 20:57:17.767487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 965/1725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:17.773354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.774188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.781329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.781849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.782696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.783227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.835217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.842839 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62d0aba2-fc39-42c6-a6fb-10925ca1f170 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1500 microversion: 2.1 time: 0.181262 Apr 02 20:57:17.847250 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 761/1726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1500 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:17.851315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.852125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.859381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.859846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.860682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.861134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.943561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.948306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.952020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.953898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.955072 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e03878b2-4948-4f5e-8786-5ce1ff1583e4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.186479 Apr 02 20:57:17.955685 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 966/1727] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:17.961827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.963762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:17.967546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0c230204-4045-4b65-8441-869db20d8d42 req-dc7ec70e-84d7-4390-9768-4122f4f39cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818956c7-a348-4c41-a48b-9c74b8ddbc66", "name": "network-vif-deleted", "tag": "70579e43-efe8-4449-87ed-602a9094f229"}, {"server_uuid": "a7234847-6a5b-4386-8d22-448be13057dd", "name": "network-vif-deleted", "tag": "5bc77ddd-a95f-43ce-8434-61e980388e81"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:17.968116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-319ba0cb-83e7-41ee-8a61-a92dd6708627 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.123243 Apr 02 20:57:17.974620 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 762/1728] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:17.977865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:17.978004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0c230204-4045-4b65-8441-869db20d8d42 req-dc7ec70e-84d7-4390-9768-4122f4f39cc8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.978425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0c230204-4045-4b65-8441-869db20d8d42 req-dc7ec70e-84d7-4390-9768-4122f4f39cc8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.978540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:17.984946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.985462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.986519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:17.987786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:17.991890 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0c230204-4045-4b65-8441-869db20d8d42 req-dc7ec70e-84d7-4390-9768-4122f4f39cc8 service nova] Creating event network-vif-deleted:70579e43-efe8-4449-87ed-602a9094f229 for instance 818956c7-a348-4c41-a48b-9c74b8ddbc66 on nch2-master-1 Apr 02 20:57:17.992406 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0c230204-4045-4b65-8441-869db20d8d42 req-dc7ec70e-84d7-4390-9768-4122f4f39cc8 service nova] Creating event network-vif-deleted:5bc77ddd-a95f-43ce-8434-61e980388e81 for instance a7234847-6a5b-4386-8d22-448be13057dd on nch2-master-1 Apr 02 20:57:17.998752 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0c230204-4045-4b65-8441-869db20d8d42 req-dc7ec70e-84d7-4390-9768-4122f4f39cc8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041990 Apr 02 20:57:17.999521 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 967/1729] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:18.004783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:18.005583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:18.011492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.011954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.012756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.013194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.140092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:18.149347 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35564919-1ce7-43d9-a826-e0ad106aed19 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.179458 Apr 02 20:57:18.150110 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 763/1730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:18.176017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:18.183303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce2e20c8-982d-4367-bf54-e41aade0657c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.182854 Apr 02 20:57:18.184165 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 968/1731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:17 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:18.447916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:18.448627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:18.456432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.456947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.457712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.458183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.740921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:18.749728 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-59041f38-6b7f-4b43-be07-9ca19cdf5fef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.306051 Apr 02 20:57:18.750262 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 764/1732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:18 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:18.775583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:18.776212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:18.786395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.786863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.787657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.788102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.860785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:18.861869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:18.868753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.869247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.870069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:18.870519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:18.988656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.012238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da95ede4-ffc0-41fb-babb-237c872741f4 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1471 microversion: 2.1 time: 0.240306 Apr 02 20:57:19.013078 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 969/1733] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:18 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:19.024052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:19.025107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:19.031838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.032575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.033684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.034784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.133919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e586602a4da4d659974e36ab71486a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.142955 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a67e6b72-9d65-4f64-9b52-c01cf495a031 tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 200 len: 1500 microversion: 2.1 time: 0.286213 Apr 02 20:57:19.145198 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 765/1734] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:18 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 1500 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:19.150018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:19.150787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:19.180284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.181687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.182794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.183246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.254292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.262636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.264149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.265507 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba7837af-986c-4bc2-a2d3-893eb995cb87 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.251237 Apr 02 20:57:19.266555 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 970/1735] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:19 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:19.277332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:19.278099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:19.284121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.285459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.285932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.287015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.287905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.295713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.297257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.300671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ca97618-5062-4e48-b4f7-c85e4b3d2397 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.152117 Apr 02 20:57:19.301836 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 766/1736] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:19 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:19.319180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:19.320235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:19.328465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.329017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.330171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.331402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.494307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.501813 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-24610a5d-bdfa-401e-bba3-0b331fbe4457 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.234062 Apr 02 20:57:19.502464 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 971/1737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:19 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:19.578675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:19.586095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9516fc12-9aa4-411e-b2dc-23fc44d7c2d6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.282565 Apr 02 20:57:19.586869 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 767/1738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:19 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:19.772248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:19.773301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:19.784125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.784871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.785926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:19.786595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:19.992039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.007344 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8a09dab-511d-4a63-9793-c909dbfdb4d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.244030 Apr 02 20:57:20.011031 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 972/1739] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:19 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:20.026522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-42a8067c-51db-4ddd-b2c3-30cbd71bde18 req-bdb4801f-6c2a-41e8-bb89-793d4f09714f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90048480-54e7-4b20-8d1b-d8c6a461de71", "name": "network-vif-deleted", "tag": "df51f42c-1b75-412d-b9f6-4349066d58c2"}, {"server_uuid": "0adca561-7967-465d-a3e3-78a0dd5bb75d", "name": "network-vif-deleted", "tag": "860f3b0f-e306-416d-a721-e0c5589bea14"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:20.037424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-42a8067c-51db-4ddd-b2c3-30cbd71bde18 req-bdb4801f-6c2a-41e8-bb89-793d4f09714f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.038130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-42a8067c-51db-4ddd-b2c3-30cbd71bde18 req-bdb4801f-6c2a-41e8-bb89-793d4f09714f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.069623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-42a8067c-51db-4ddd-b2c3-30cbd71bde18 req-bdb4801f-6c2a-41e8-bb89-793d4f09714f service nova] Creating event network-vif-deleted:df51f42c-1b75-412d-b9f6-4349066d58c2 for instance 90048480-54e7-4b20-8d1b-d8c6a461de71 on nch1-master-1 Apr 02 20:57:20.071398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-42a8067c-51db-4ddd-b2c3-30cbd71bde18 req-bdb4801f-6c2a-41e8-bb89-793d4f09714f service nova] Creating event network-vif-deleted:860f3b0f-e306-416d-a721-e0c5589bea14 for instance 0adca561-7967-465d-a3e3-78a0dd5bb75d on nch2-master-1 Apr 02 20:57:20.084833 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-42a8067c-51db-4ddd-b2c3-30cbd71bde18 req-bdb4801f-6c2a-41e8-bb89-793d4f09714f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071619 Apr 02 20:57:20.085810 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 973/1740] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:20.094668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:20.095386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:20.101756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-cd403bed-19a1-4f46-ac31-f9eb59dc138c req-a9b7fe6b-bf86-422c-b700-d182a42c24aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282887e6-5c5b-4492-8a31-c1cf713cf95f", "name": "network-vif-plugged", "status": "completed", "tag": "b729c68d-47c0-4cf5-b93a-585056bd9955"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:20.108431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.109014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.109915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.110464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.111293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cd403bed-19a1-4f46-ac31-f9eb59dc138c req-a9b7fe6b-bf86-422c-b700-d182a42c24aa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.111913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cd403bed-19a1-4f46-ac31-f9eb59dc138c req-a9b7fe6b-bf86-422c-b700-d182a42c24aa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.128989 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-cd403bed-19a1-4f46-ac31-f9eb59dc138c req-a9b7fe6b-bf86-422c-b700-d182a42c24aa service nova] Creating event network-vif-plugged:b729c68d-47c0-4cf5-b93a-585056bd9955 for instance 282887e6-5c5b-4492-8a31-c1cf713cf95f on nch1-master-1 Apr 02 20:57:20.135141 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-cd403bed-19a1-4f46-ac31-f9eb59dc138c req-a9b7fe6b-bf86-422c-b700-d182a42c24aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233269 Apr 02 20:57:20.136280 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 768/1741] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:20.152346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.152849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.153676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lazy-loading 'fault' on Instance uuid 0adca561-7967-465d-a3e3-78a0dd5bb75d {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:20.161870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:20.162584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] [instance: 90048480-54e7-4b20-8d1b-d8c6a461de71] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:20.181763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.183366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.186013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.187266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.215612 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] HTTP exception thrown: Instance 90048480-54e7-4b20-8d1b-d8c6a461de71 could not be found. Apr 02 20:57:20.216980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] Returning 404 to user: Instance 90048480-54e7-4b20-8d1b-d8c6a461de71 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:20.218268 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6492939-5c74-4a9d-9451-70c35eac070d tempest-LiveMigrationTest-896557035 tempest-LiveMigrationTest-896557035-project] 10.222.0.18 "GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71" status: 404 len: 111 microversion: 2.1 time: 0.062233 Apr 02 20:57:20.219558 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 769/1742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:20 2022] GET /compute/v2.1/servers/90048480-54e7-4b20-8d1b-d8c6a461de71 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:57:20.240126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf48963161747228e3cafa0bc045729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f8ef84a62894a7da5457cafc1bcf172', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.248871 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a4f3f77-8190-4ef2-8494-71f058e5f656 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 200 len: 1306 microversion: 2.1 time: 0.161294 Apr 02 20:57:20.249684 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 974/1743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:20 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:20.287891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:20.288561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:20.301995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.302891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.305661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.307213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.329773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:20.335928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:20.348709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.353577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.355173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.356048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.516913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.527966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.529838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.531061 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a14a5036-7bb4-4cfc-a86f-ee752e22eaf5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.214360 Apr 02 20:57:20.542450 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 975/1744] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:20 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:57:20.542450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:20.542450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:20.551386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.551980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.552912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.553585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.623891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.635290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.637648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.640983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17e48354-69a8-4584-9620-b1239c464461 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.359523 Apr 02 20:57:20.643555 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 770/1745] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:20 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:20.658993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:20.659920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:20.667010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.667474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.668263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:20.668931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:20.827678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.836787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30073df3-a1e7-48e6-866c-3d0518e1b230 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.303969 Apr 02 20:57:20.837360 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 976/1746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:20 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:20.847692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:20.855403 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4fadb6ea-c862-41ca-a4df-54cc8c1c5a55 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.206771 Apr 02 20:57:20.865899 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 771/1747] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:20 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:21.027526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:21.029117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:21.035441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.036661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.037586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.038076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.271056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:21.271056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] [instance: 0adca561-7967-465d-a3e3-78a0dd5bb75d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:21.276424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.276870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.277028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.278813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.279331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.287179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5240e5d-b63f-41ab-9a36-f609464911a6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.262708 Apr 02 20:57:21.288293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 977/1748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:21 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:21.306311 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] HTTP exception thrown: Instance 0adca561-7967-465d-a3e3-78a0dd5bb75d could not be found. Apr 02 20:57:21.306933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] Returning 404 to user: Instance 0adca561-7967-465d-a3e3-78a0dd5bb75d could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:21.307791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b5185f9-2855-4057-9dfb-8262b1d03b76 tempest-ServersOnMultiNodesTest-1757841535 tempest-ServersOnMultiNodesTest-1757841535-project] 10.222.0.18 "GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d" status: 404 len: 111 microversion: 2.1 time: 0.044991 Apr 02 20:57:21.308865 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 772/1749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:21 2022] GET /compute/v2.1/servers/0adca561-7967-465d-a3e3-78a0dd5bb75d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:21.551111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:21.551729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:21.559137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.559776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.560860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.561358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.646187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.659833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.662000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.663390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:21.664198 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1def85a2-2422-4dbf-ac61-2fd7535e5d19 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.117492 Apr 02 20:57:21.664585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:21.665058 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 978/1750] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:21 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:21.697561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.698473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.699579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.700017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.855387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:21.856138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:21.873394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.873844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.875534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.882524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.944663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.953733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.955185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:21.956601 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4bbf5d19-39bc-4e5d-870f-03bff2cdd764 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.298216 Apr 02 20:57:21.957160 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 773/1751] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:21 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:21.962053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:21.962840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:21.969172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.969603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:21.970381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:21.970824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.128800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:22.137173 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-551ab9a4-6bd1-4eaa-a111-0842ba9506ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.178654 Apr 02 20:57:22.148492 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 774/1752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:21 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:22.153954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ff8bd9b7-803b-499b-9869-9416ed78a832 req-bd9f8a0b-08d4-4c54-a280-6a17310176d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea0ad92-ff3e-49af-b783-93700d77d500", "name": "network-vif-plugged", "status": "completed", "tag": "2faa1981-89af-49a0-9dd1-17e23172df4b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:22.162815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ff8bd9b7-803b-499b-9869-9416ed78a832 req-bd9f8a0b-08d4-4c54-a280-6a17310176d9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.163535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ff8bd9b7-803b-499b-9869-9416ed78a832 req-bd9f8a0b-08d4-4c54-a280-6a17310176d9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.178861 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ff8bd9b7-803b-499b-9869-9416ed78a832 req-bd9f8a0b-08d4-4c54-a280-6a17310176d9 service nova] Creating event network-vif-plugged:2faa1981-89af-49a0-9dd1-17e23172df4b for instance 3ea0ad92-ff3e-49af-b783-93700d77d500 on nch1-master-1 Apr 02 20:57:22.184182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:22.185939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ff8bd9b7-803b-499b-9869-9416ed78a832 req-bd9f8a0b-08d4-4c54-a280-6a17310176d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035992 Apr 02 20:57:22.186544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 775/1753] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:22.196027 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95ea5b5c-d471-4383-96e9-4e9a6bb96a12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.344487 Apr 02 20:57:22.197367 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 979/1754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:21 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:22.306908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:22.308202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:22.316877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.317334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.318503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.318966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.462873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:22.470523 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c122c68d-ddc6-44df-a6d5-52a500271522 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.169069 Apr 02 20:57:22.471283 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 776/1755] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:22 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:22.686069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:22.687418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:22.712164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.713271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.714899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.715914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.818328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:22.826629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:22.828979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:22.831332 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5067184d-8532-4a27-b545-b102a7666829 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.151765 Apr 02 20:57:22.832422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 980/1756] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:22 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:22.976030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:22.977514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:22.987077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.987728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:22.989173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:22.989841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.154079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:23.154918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:23.162108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.162976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.164224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.164950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.210391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.229500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.231382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.238317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f47513b6-3279-4c2b-9e16-1d2181abfa12 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.266742 Apr 02 20:57:23.238852 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 777/1757] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:22 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:23.251363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:23.251990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:23.265862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.266373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.267412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.269419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.379287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.390071 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-682f8e99-3de6-407a-9108-466b62fa10ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1378 microversion: 2.1 time: 0.237278 Apr 02 20:57:23.393498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 981/1758] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:23 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1378 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:23.488827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:23.490235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:23.497293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.498278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.499277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.499991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.545734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.557238 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-68cc9049-b0aa-42bb-9aa2-958df8cb6798 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1530 microversion: 2.1 time: 0.317326 Apr 02 20:57:23.557832 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 778/1759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:23 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1530 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:23.702887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.714860 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a362666-3c6f-4a1b-a3bb-141d4822ef5d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.230713 Apr 02 20:57:23.725313 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 982/1760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:23 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:23.849956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:23.850765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:23.860970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.861889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.863264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:23.863925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:23.933823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.943361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.945366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:23.946792 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c464423d-c81e-4d05-96e0-e53168ec6f2d tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.102097 Apr 02 20:57:23.947517 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 779/1761] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:23 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:24.256917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:24.257821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:24.266345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.267008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.267985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.269153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.407052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:24.408337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:24.417763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.418598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.419965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.420872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.556119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:24.564812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:24.571567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:24.572792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6df624e0-f9c6-48e9-b02c-c05b6a13c544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1361 microversion: 2.25 time: 0.320067 Apr 02 20:57:24.577113 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 983/1762] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:24 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:24.583969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:24.584864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:24.606190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.606664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.610045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.610506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.685544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:24.697669 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00c14b1e-43aa-42a2-bb55-c7ed190b50b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1528 microversion: 2.1 time: 0.294369 Apr 02 20:57:24.698755 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 780/1763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:24 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1528 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:24.717313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:24.717935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:24.730867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.732348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.733201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.733659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.845373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:24.853979 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42558631-d22b-4c00-a6c1-4f057f8a66c8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1530 microversion: 2.1 time: 0.275371 Apr 02 20:57:24.855055 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 984/1764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:24 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1530 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:24.859798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:24.860529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:24.873970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.875785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:24.875941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:24.876553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.101378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.103366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.109456 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8437c464-1399-403c-87b4-978bcbe60d45 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1528 microversion: 2.1 time: 0.396249 Apr 02 20:57:25.111072 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 781/1765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:24 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:25.121374 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ff8ed1a-2a0c-4f8f-929b-0b82ec0d0ff6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1308 microversion: 2.1 time: 0.255703 Apr 02 20:57:25.121374 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 985/1766] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:24 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:25.127830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.128632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:25.135240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.135689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.136709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.137164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.239893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.255860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.258742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.262113 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3699f451-6ca5-4e97-bd67-35aeae983570 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.138453 Apr 02 20:57:25.274213 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 782/1767] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:25.364729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e337cf13-11df-4f67-8e3f-32e51ed023e3 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.366169 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.366169 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:57:25.367479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e337cf13-11df-4f67-8e3f-32e51ed023e3 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.367993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e337cf13-11df-4f67-8e3f-32e51ed023e3 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.368942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e337cf13-11df-4f67-8e3f-32e51ed023e3 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.369839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e337cf13-11df-4f67-8e3f-32e51ed023e3 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.398519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e337cf13-11df-4f67-8e3f-32e51ed023e3 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.284698 Apr 02 20:57:25.399314 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 986/1768] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/os-services => generated 947 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:25.403759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c7ecf5c-94ea-448e-9cc7-7df20b26458c tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.404751 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.404751 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:57:25.424160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c7ecf5c-94ea-448e-9cc7-7df20b26458c tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/8db7a0c6-f3d4-467b-8dd1-8c3146b98f54" status: 202 len: 0 microversion: 2.1 time: 0.023558 Apr 02 20:57:25.426320 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 987/1769] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:57:25 2022] DELETE /compute/v2.1/flavors/8db7a0c6-f3d4-467b-8dd1-8c3146b98f54 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:57:25.431226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a740e26-27b2-4d22-bb96-25a630f8a3df tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.431486 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.431486 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:57:25.432729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a740e26-27b2-4d22-bb96-25a630f8a3df tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.433175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a740e26-27b2-4d22-bb96-25a630f8a3df tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.433982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a740e26-27b2-4d22-bb96-25a630f8a3df tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.434432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a740e26-27b2-4d22-bb96-25a630f8a3df tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.461663 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a740e26-27b2-4d22-bb96-25a630f8a3df tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.035650 Apr 02 20:57:25.462273 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 988/1770] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:25.467444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e14d73f5-e87a-4273-9786-7955896c17db tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.488422 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e14d73f5-e87a-4273-9786-7955896c17db tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024653 Apr 02 20:57:25.489746 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 989/1771] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:25.495348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-236f4f06-ca18-481a-88eb-79fe95367fbe tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.497195 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.497195 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:57:25.499506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-236f4f06-ca18-481a-88eb-79fe95367fbe tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.501683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-236f4f06-ca18-481a-88eb-79fe95367fbe tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.503303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-236f4f06-ca18-481a-88eb-79fe95367fbe tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.503919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-236f4f06-ca18-481a-88eb-79fe95367fbe tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.529655 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-236f4f06-ca18-481a-88eb-79fe95367fbe tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038544 Apr 02 20:57:25.530508 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 990/1772] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/os-services => generated 947 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:25.535259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:25.536938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:25.542747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.543201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.543965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.544397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.587804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cbfff1ea-9438-4c5b-818c-4504c1fcbfb8 tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] Calling method '.version_select at 0x7f54d4ab0430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.588712 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.588712 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:25.601839 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cbfff1ea-9438-4c5b-818c-4504c1fcbfb8 tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.326480 Apr 02 20:57:25.602647 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 783/1773] 10.222.0.18 () {60 vars in 1225 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:57:25.607294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-527d6984-3edf-4bc6-b7c1-8d969d61a50f tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.608672 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.608672 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:25.609935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-527d6984-3edf-4bc6-b7c1-8d969d61a50f tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.610452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-527d6984-3edf-4bc6-b7c1-8d969d61a50f tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.611327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-527d6984-3edf-4bc6-b7c1-8d969d61a50f tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.611767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-527d6984-3edf-4bc6-b7c1-8d969d61a50f tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.636525 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-527d6984-3edf-4bc6-b7c1-8d969d61a50f tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.032830 Apr 02 20:57:25.637406 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 784/1774] 10.222.0.18 () {58 vars in 1195 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:57:25.644101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.644763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:25.650696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.651152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.651983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.652422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.798367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.804486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.806604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Old instance type tempest-test_resize_flavor_-900522853, new instance type m1.heat {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 20:57:25.812901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.814059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:57:25.814416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:25.814555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:57:25.814956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:57:25.816228 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d64d689f-4b71-4ff9-a00b-cd8dbc189464 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1558 microversion: 2.25 time: 0.177741 Apr 02 20:57:25.816534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:57:25.816892 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 785/1775] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:25.821275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:57:25.821695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-830b03a7-d8c3-4727-b88d-d90f3c3148d1 tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] Action: 'update', calling method: .version_select at 0x7f54d4c3ac10>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:25.823200 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.823200 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:25.935024 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9586753-6b7f-4d2d-9313-af5937e966c4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24/action" status: 202 len: 0 microversion: 2.1 time: 0.403284 Apr 02 20:57:25.935638 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 991/1776] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:25 2022] POST /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:57:25.944376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d059df4e-d6b9-4323-a86f-c48c89404ea0 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:25.945870 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:25.945870 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:57:25.947343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d059df4e-d6b9-4323-a86f-c48c89404ea0 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.947985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d059df4e-d6b9-4323-a86f-c48c89404ea0 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.949002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d059df4e-d6b9-4323-a86f-c48c89404ea0 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:25.949648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d059df4e-d6b9-4323-a86f-c48c89404ea0 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:25.981403 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d059df4e-d6b9-4323-a86f-c48c89404ea0 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.041680 Apr 02 20:57:25.982037 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 992/1777] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:26.041278 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-830b03a7-d8c3-4727-b88d-d90f3c3148d1 tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.223097 Apr 02 20:57:26.042187 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 786/1778] 10.222.0.18 () {62 vars in 1246 bytes} [Sat Apr 2 20:57:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:57:26.048124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.049049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:26.057407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.058697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.059670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.060275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.236326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:26.257376 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fdd09d4e-90a5-4c9f-8a34-4c6888c84b8b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1530 microversion: 2.1 time: 0.213625 Apr 02 20:57:26.258335 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 787/1779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:26 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1530 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:26.266650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.267519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:26.270832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.271458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:26.278075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.278447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.278668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.279507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.279800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.280115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.281201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.282054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.571748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:26.581382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2207f39e-8c69-4214-9191-a8a960c4b975 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1537 microversion: 2.1 time: 0.321281 Apr 02 20:57:26.581984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 788/1780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:26 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1537 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:26.589259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60781cd7-8cf7-42b9-ab19-61b7f0fc6743 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.590131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 282887e6-5c5b-4492-8a31-c1cf713cf95f {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:26.611044 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:26.611044 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:26.612593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60781cd7-8cf7-42b9-ab19-61b7f0fc6743 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.613063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60781cd7-8cf7-42b9-ab19-61b7f0fc6743 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.613882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60781cd7-8cf7-42b9-ab19-61b7f0fc6743 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.618238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60781cd7-8cf7-42b9-ab19-61b7f0fc6743 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.674473 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60781cd7-8cf7-42b9-ab19-61b7f0fc6743 tempest-ServicesAdminNegativeTestJSON-1864633936 tempest-ServicesAdminNegativeTestJSON-1864633936-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.088661 Apr 02 20:57:26.675304 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 789/1781] 10.222.0.18 () {58 vars in 1197 bytes} [Sat Apr 2 20:57:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:57:26.703299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c975f2bf-eccf-4128-9d09-a05108b99f5f tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] Calling method '.version_select at 0x7f54d4aff9d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.705573 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:26.705573 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:26.718336 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e48815b-ac6d-49bd-9b4b-eb16a43e9375 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 2050 microversion: 2.25 time: 0.733362 Apr 02 20:57:26.719293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 993/1782] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:25 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 2050 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:26.729654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.730272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:26.731666 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c975f2bf-eccf-4128-9d09-a05108b99f5f tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.055125 Apr 02 20:57:26.732571 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 790/1783] 10.222.0.18 () {60 vars in 1225 bytes} [Sat Apr 2 20:57:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:57:26.741637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:26.742510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:26.749226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.749692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.750496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.750942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.753096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.753605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:26.757553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:26.758761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.040274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:27.056572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee0456f5-d3e2-4790-ba75-c31d38365b66 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1489 microversion: 2.1 time: 0.335465 Apr 02 20:57:27.069552 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 994/1784] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:26 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1489 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:27.348395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e3aad3d-2c04-4a04-916a-8126b32a7025 tempest-ServicesAdminNegativeTestJSON-188286873 tempest-ServicesAdminNegativeTestJSON-188286873-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:27.349710 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:27.349710 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:57:27.350962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3e3aad3d-2c04-4a04-916a-8126b32a7025 tempest-ServicesAdminNegativeTestJSON-188286873 tempest-ServicesAdminNegativeTestJSON-188286873-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5e10a6edd86a492b8e51e40c176b1084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82778196a3e64b9ebad84d9ca398da76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:27.353174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e3aad3d-2c04-4a04-916a-8126b32a7025 tempest-ServicesAdminNegativeTestJSON-188286873 tempest-ServicesAdminNegativeTestJSON-188286873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:27.356845 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e3aad3d-2c04-4a04-916a-8126b32a7025 tempest-ServicesAdminNegativeTestJSON-188286873 tempest-ServicesAdminNegativeTestJSON-188286873-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.283072 Apr 02 20:57:27.357445 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 995/1785] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 20:57:27 2022] GET /compute/v2.1/os-services => generated 112 bytes in 287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:57:27.366531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:27.368083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:27.378484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.379336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.380359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.381045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.396728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:27.408208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:27.409878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:27.412273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ffbbc22-3f21-4a3d-bab9-5e26a875c887 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.678545 Apr 02 20:57:27.417622 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 791/1786] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:26 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:27.425225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ce70d3d7-0b4f-43f6-b31a-d7ec520141e9 tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] Action: 'update', calling method: .version_select at 0x7f54d49f84c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:27.432372 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:27.432372 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:27.581787 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ce70d3d7-0b4f-43f6-b31a-d7ec520141e9 tempest-QuotaClassesAdmin257Test-1610770565 tempest-QuotaClassesAdmin257Test-1610770565-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.162483 Apr 02 20:57:27.583383 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 792/1787] 10.222.0.18 () {62 vars in 1246 bytes} [Sat Apr 2 20:57:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:57:27.589183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:27.590126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:27.595271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 282887e6-5c5b-4492-8a31-c1cf713cf95f {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:27.619736 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d717bb3-4826-4f29-a4b3-dd35a26ed1e7 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 2050 microversion: 2.25 time: 0.260936 Apr 02 20:57:27.621923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 996/1788] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:27 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 2050 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:27.627255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-124eb13a-ed9a-4142-90f4-a873823a1d26 req-cb9e9e27-3879-4249-824d-9c0b32e222c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88c5184-0805-4677-a11d-4077b9465e11", "name": "network-vif-plugged", "status": "completed", "tag": "f4087e3e-4f59-4105-bdf5-e1707ada38cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:27.637434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.638667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.639143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-124eb13a-ed9a-4142-90f4-a873823a1d26 req-cb9e9e27-3879-4249-824d-9c0b32e222c2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.639779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-124eb13a-ed9a-4142-90f4-a873823a1d26 req-cb9e9e27-3879-4249-824d-9c0b32e222c2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.640807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.641985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.665184 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-124eb13a-ed9a-4142-90f4-a873823a1d26 req-cb9e9e27-3879-4249-824d-9c0b32e222c2 service nova] Creating event network-vif-plugged:f4087e3e-4f59-4105-bdf5-e1707ada38cb for instance d88c5184-0805-4677-a11d-4077b9465e11 on nch2-master-1 Apr 02 20:57:27.678339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-124eb13a-ed9a-4142-90f4-a873823a1d26 req-cb9e9e27-3879-4249-824d-9c0b32e222c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054514 Apr 02 20:57:27.680214 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 997/1789] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:27.689600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:27.690698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:27.714921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.715730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.719622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.720466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.802265 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b930efb5-3e65-4593-afd2-d8405564bc6b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500/action" status: 202 len: 0 microversion: 2.1 time: 0.217237 Apr 02 20:57:27.822251 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 793/1790] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:27 2022] POST /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:57:27.838315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:27.839537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:27.863396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.864361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:27.866546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:27.869858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:28.560851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:28.570769 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ebfea1dd-bc9f-4d0a-ad7d-cbfb37cc7dde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1537 microversion: 2.1 time: 0.745900 Apr 02 20:57:28.585122 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 794/1791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:27 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1537 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:28.617789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d2bf7d11-463f-4d4f-9afb-65f5068f3063 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:28.631707 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:28.631707 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:28.646153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2bf7d11-463f-4d4f-9afb-65f5068f3063 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:28.647040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2bf7d11-463f-4d4f-9afb-65f5068f3063 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:28.647719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2bf7d11-463f-4d4f-9afb-65f5068f3063 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:28.648232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2bf7d11-463f-4d4f-9afb-65f5068f3063 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:28.741744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:28.754573 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f4bfbc3-d80e-4165-980f-7ed148174177 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 1.071355 Apr 02 20:57:28.755154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 998/1792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:27 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:28.773161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:28.781426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:28.792408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:28.792924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:28.793802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:28.794263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:28.796166 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d2bf7d11-463f-4d4f-9afb-65f5068f3063 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.209033 Apr 02 20:57:28.796843 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 795/1793] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Apr 2 20:57:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:57:28.817308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:28.818678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:28.840692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:28.846611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:28.848414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:28.850544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:29.071942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:29.142809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:29.152965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:29.159874 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-783ffd42-2162-4ce2-a8f7-ff2fa2014cc4 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.360551 Apr 02 20:57:29.160856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 796/1794] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:28 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:29.185917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:29.187342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:29.205271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:29.206032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:29.207043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:29.207661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:29.238625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'flavor' on Instance uuid 282887e6-5c5b-4492-8a31-c1cf713cf95f {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:29.251614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Going to try to live migrate instance to nch2-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:57:29.301375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:29.316512 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-908708d2-1946-402c-a7b6-55cc7e4440ae tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 200 len: 1474 microversion: 2.1 time: 0.560287 Apr 02 20:57:29.323298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 999/1795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:28 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 1474 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:29.378372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-666259247"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:29.383578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:29.411973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:29.413178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:29.414368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:29.415214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.040177 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe817424-2e9c-4a5f-a12e-e0a81b4b28f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500/action" status: 202 len: 0 microversion: 2.1 time: 0.695591 Apr 02 20:57:30.041255 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1000/1796] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:29 2022] POST /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500/action => generated 0 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 20:57:30.074564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:30.076014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:30.084762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:30.085663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.086852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:30.087455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.274982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:30.286412 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d34a857d-2db3-432f-8a2e-f79dadbb2c2d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1537 microversion: 2.1 time: 0.227627 Apr 02 20:57:30.290262 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1001/1797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:30 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:30.298370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:30.303166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:30.317480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:30.318229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.321334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:30.321959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.527279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:30.542044 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b65bd8f1-c098-4bec-aea4-d28e3bde92c3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 0.250442 Apr 02 20:57:30.543238 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1002/1798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:30 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:30.564186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b89d9e2-7ae6-48ee-9921-e3a1ea7568e0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d46f2ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:30.666476 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b89d9e2-7ae6-48ee-9921-e3a1ea7568e0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.121094 Apr 02 20:57:30.667351 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1003/1799] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:30 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:30.683094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:30.683719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:30.717294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:30.717873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.726353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:30.726926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:30.866188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:30.879204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:30.882637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:30.887702 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d71192b0-5826-4028-b2ae-4b9c6da08495 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1366 microversion: 2.47 time: 0.218013 Apr 02 20:57:30.890237 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1004/1800] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:30 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:31.307204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:31.307893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:31.328165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:31.331392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:31.332809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:31.333767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:31.582151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:31.600778 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e0ae1ae-6ac1-4eed-bc24-3e45064a5b43 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1542 microversion: 2.1 time: 0.296789 Apr 02 20:57:31.603834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1005/1801] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:31 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1542 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:31.622406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:31.624656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:31.648155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:31.648967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:31.650514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:31.653033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:31.982067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:31.998709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d0d2e3f-c2c6-4e20-8689-e8c7398da11b tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 0.389388 Apr 02 20:57:31.999528 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1006/1802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:31 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:32.010044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4774fc33-e456-4886-adfe-539e83907d9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45cf670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:32.086842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4774fc33-e456-4886-adfe-539e83907d9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.085630 Apr 02 20:57:32.094426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1007/1803] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:31 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:32.100155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:32.103352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:32.115643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:32.120770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:32.121899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:32.122570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:32.246395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:32.257090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:32.262750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:32.264818 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8788d9de-ca3f-4db9-8e6e-d421746470b0 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1384 microversion: 2.47 time: 0.172625 Apr 02 20:57:32.283412 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1008/1804] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:32 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1384 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:32.365853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a163d24-892d-4ee0-8256-923c08300b92 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f/action" status: 202 len: 0 microversion: 2.25 time: 3.203650 Apr 02 20:57:32.368164 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 797/1805] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 20:57:29 2022] POST /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f/action => generated 0 bytes in 3205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:57:32.379204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:32.379944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:32.395749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:32.398379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:32.399986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:32.401961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:32.618988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:32.619617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:32.642024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:32.643645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:32.652372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:32.655744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:32.720247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:32.732953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:32.741740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:32.743884 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a5a8dfa-935e-49f7-9c68-2e5161c9485a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 0.371089 Apr 02 20:57:32.746437 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1009/1806] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:32 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:33.018283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:33.018832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:33.035192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:33.036424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:33.037304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:33.038150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:33.351001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:33.362810 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-50c86ad3-9071-4ca4-a6f7-9daa6f3f5ffb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 0.349192 Apr 02 20:57:33.364308 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1010/1807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:33 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:57:33.370326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5073ad30-3bc9-4e43-8e64-c5189d2b5ca4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d46be790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:33.426546 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5073ad30-3bc9-4e43-8e64-c5189d2b5ca4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.061393 Apr 02 20:57:33.428293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1011/1808] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:33 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:33.441247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:33.442138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:33.457121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:33.458107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:33.460131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:33.462173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:33.679697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:33.688343 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46e6637f-3662-4343-a235-207008d6f9e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1542 microversion: 2.1 time: 1.073238 Apr 02 20:57:33.693715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:33.701140 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 798/1809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:32 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1542 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:33.706644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:33.708275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:33.709508 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c9c1e3f-35a9-4edc-a5b0-c94f0555ff0f tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1372 microversion: 2.47 time: 0.280029 Apr 02 20:57:33.710103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1012/1810] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:33 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:33.774775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:33.775404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:33.786950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:33.787470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:33.788263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:33.788736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.091190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Calling method '.version_select at 0x7f54d4c32dc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:34.092392 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:57:34.092392 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:57:34.093933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.095510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.120901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:34.129780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:34.135183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.136353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.137532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:34.141118 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-245c1bd1-8911-4d3c-b5c8-440687512202 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 0.378167 Apr 02 20:57:34.152283 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1013/1811] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:33 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:34.167370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.167832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.175051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aa3dd775-8d95-450e-8bbe-1a28999ec4cd tempest-PortsAdminExtendedAttrsTestJSON-1401881253 tempest-PortsAdminExtendedAttrsTestJSON-1401881253-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.472716 Apr 02 20:57:34.175646 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 799/1812] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:57:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:34.383504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:34.389250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:34.408258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.411899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.412970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.413580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.441341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-100d95c5-8435-47c8-9943-17fcb25ef5b0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4c79b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:34.522127 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-100d95c5-8435-47c8-9943-17fcb25ef5b0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.085256 Apr 02 20:57:34.529663 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 800/1813] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:34 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:34.707248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:34.708788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:34.716610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.721122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.724741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.725381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.907554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:34.915150 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67eecb42-2bfa-4c10-a8ee-dd0aaca29dbd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 0.538057 Apr 02 20:57:34.918192 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1014/1814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:34 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:34.934732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:34.935658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:34.947821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.951946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:34.953622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:34.954319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:35.124741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.136877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.148820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.150419 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7ef34c5-13a0-4e9b-b270-5e41b4d988c9 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1357 microversion: 2.47 time: 0.228481 Apr 02 20:57:35.151708 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1015/1815] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:34 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:35.196124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.208286 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7761daf9-3d11-4606-8b4c-2ebdf8596000 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1542 microversion: 2.1 time: 0.505290 Apr 02 20:57:35.212393 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 801/1816] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:34 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1542 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:35.223181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:35.226631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:35.246848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:35.248207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:35.249296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:35.249972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:35.409932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-817021675", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:35.494698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:57:35.572255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.589417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.594635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.601463 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a022251-586c-4da5-bb3a-2c23536a61ee tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 0.384250 Apr 02 20:57:35.614093 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 802/1817] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:35 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:35.622758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:35.626911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.630113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Searching by: {'deleted': False, 'project_id': '39ae799bc6f1400186ad8199388612a1'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:57:35.637154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:35.637787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:35.638720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:35.639169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:35.826829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:57:35.951888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:35.966570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:35.967045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:35.989368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:36.005921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:36.042890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:57:36.043948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:57:36.044638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:57:36.045214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:57:36.045888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:57:36.069325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.070323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.077278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.081871 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a6e2843-2ccd-4e68-a4f3-bd9f915636de tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.466534 Apr 02 20:57:36.082245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.082515 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 803/1818] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Apr 2 20:57:35 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:36.097360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b1318e2-67c7-4852-97e1-9a646ba2af61 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4c32af0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:36.149083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Getting quotas for project d84de315abb1452fa5187770db66041e. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:57:36.158122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Getting quotas for user a9953e57681446849124a494fa1cdf44 and project d84de315abb1452fa5187770db66041e. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:57:36.175274 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b1318e2-67c7-4852-97e1-9a646ba2af61 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.091146 Apr 02 20:57:36.175999 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 804/1819] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:36 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:36.180447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:57:36.183423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:57:36.184855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:36.185501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:36.211094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.211542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.212470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.212935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.290755 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c318a7b2-d96d-4fd5-a93c-2e45101a6e57 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137641 Apr 02 20:57:36.291829 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1016/1820] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:57:36.312675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:36.315758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:36.329746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.331014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.333354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.334525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.417261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:36.613761 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f434b325-58ce-41c0-828f-aa7946645a56 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "DELETE /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 204 len: 0 microversion: 2.47 time: 0.320210 Apr 02 20:57:36.614820 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1017/1821] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 20:57:36 2022] DELETE /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:57:36.636885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a311c371-7966-43d1-994f-4e9a79f3d6e4 req-4d860349-c571-4e84-b0dc-9fdc3e3ce55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282887e6-5c5b-4492-8a31-c1cf713cf95f", "name": "network-vif-unplugged", "status": "completed", "tag": "b729c68d-47c0-4cf5-b93a-585056bd9955"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:36.661244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a311c371-7966-43d1-994f-4e9a79f3d6e4 req-4d860349-c571-4e84-b0dc-9fdc3e3ce55a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.661833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a311c371-7966-43d1-994f-4e9a79f3d6e4 req-4d860349-c571-4e84-b0dc-9fdc3e3ce55a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.693581 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a311c371-7966-43d1-994f-4e9a79f3d6e4 req-4d860349-c571-4e84-b0dc-9fdc3e3ce55a service nova] Creating event network-vif-unplugged:b729c68d-47c0-4cf5-b93a-585056bd9955 for instance 282887e6-5c5b-4492-8a31-c1cf713cf95f on nch1-master-1 Apr 02 20:57:36.704491 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a311c371-7966-43d1-994f-4e9a79f3d6e4 req-4d860349-c571-4e84-b0dc-9fdc3e3ce55a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088205 Apr 02 20:57:36.709262 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1018/1822] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:36.726828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:36.727701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:36.740792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.740792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:36.740792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:36.740792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:37.202356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:37.217435 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb2001dc-a6f1-4089-aff6-e003d5b96f91 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1542 microversion: 2.1 time: 0.506163 Apr 02 20:57:37.218431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1019/1823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:36 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1542 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:37.254233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-775a6e41-452c-4b1e-adfc-12bb99f393ad req-91b73de6-06cd-4c01-9a44-c65ec78d5992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea0ad92-ff3e-49af-b783-93700d77d500", "name": "network-vif-plugged", "status": "completed", "tag": "2faa1981-89af-49a0-9dd1-17e23172df4b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:37.271270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-775a6e41-452c-4b1e-adfc-12bb99f393ad req-91b73de6-06cd-4c01-9a44-c65ec78d5992 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:37.295413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-775a6e41-452c-4b1e-adfc-12bb99f393ad req-91b73de6-06cd-4c01-9a44-c65ec78d5992 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:37.338628 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-775a6e41-452c-4b1e-adfc-12bb99f393ad req-91b73de6-06cd-4c01-9a44-c65ec78d5992 service nova] Creating event network-vif-plugged:2faa1981-89af-49a0-9dd1-17e23172df4b for instance 3ea0ad92-ff3e-49af-b783-93700d77d500 on nch1-master-1 Apr 02 20:57:37.352763 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-775a6e41-452c-4b1e-adfc-12bb99f393ad req-91b73de6-06cd-4c01-9a44-c65ec78d5992 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121874 Apr 02 20:57:37.360441 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1020/1824] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:37.379095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-723959813", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:37.559500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:37.575009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aa82dd00-18b2-435e-b613-4402c6649584 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 1.396223 Apr 02 20:57:37.578130 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 805/1825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:36 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:37.590351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:37.591038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:37.606492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:37.606922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:37.607728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:37.608176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:37.625829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:57:38.030836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:57:38.031334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:57:38.032099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:57:38.032860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:57:38.033490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:57:38.054739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:38.061366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:38.062601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:38.063281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:38.117479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Getting quotas for project d84de315abb1452fa5187770db66041e. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:57:38.138131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Getting quotas for user a9953e57681446849124a494fa1cdf44 and project d84de315abb1452fa5187770db66041e. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:57:38.160165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:57:38.170060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:57:38.239225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c20ff116-c5b9-436b-bd4f-75860b9d73c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864939 Apr 02 20:57:38.244705 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1021/1826] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:57:38.250163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:38.250948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:38.275230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:38.287500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:38.288831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:38.289691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:38.417763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:38.429646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:38.436258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:38.437541 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9f0a11a-70e2-469d-b9c5-932028efc9cd tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 200 len: 1363 microversion: 2.47 time: 0.195999 Apr 02 20:57:38.448365 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1022/1827] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:38 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:38.470331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42a155fc-94ac-451c-a71b-1ef08fdf0fa1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4650790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:39.927209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:39.942638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:39.944656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:39.951447 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19969669-06af-4a2e-802d-5d87cfee39b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 2.371939 Apr 02 20:57:39.952624 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 806/1828] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:37 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 2373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:39.967118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:39.968029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:39.984313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:39.989054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:39.990090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:39.991083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:41.271175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:41.280105 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d4273a9-ed34-498f-a751-242d27caaf5a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1542 microversion: 2.1 time: 1.326242 Apr 02 20:57:41.285445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 807/1829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:39 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1542 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:41.298381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:41.299405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:41.311431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:41.317786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:41.318944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:41.319598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:41.476205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:41.484851 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c8538c9-e2b6-409b-8deb-e950a66dcdf8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1271 microversion: 2.1 time: 0.198004 Apr 02 20:57:41.494516 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 808/1830] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:41 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:41.500010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:41.500959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:41.514281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:41.521182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:41.522359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:41.523119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:42.699997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:42.713594 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d8b52c25-7dfb-4a42-bdca-8fff5f1ce66c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 1.217298 Apr 02 20:57:42.714597 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 809/1831] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:42.727612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-14778684-0fdb-49ce-853c-ff8646abc96b req-468217e1-a9e0-4309-bcdf-ca9963d37730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282887e6-5c5b-4492-8a31-c1cf713cf95f", "tag": "b729c68d-47c0-4cf5-b93a-585056bd9955"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:42.742342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-14778684-0fdb-49ce-853c-ff8646abc96b req-468217e1-a9e0-4309-bcdf-ca9963d37730 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:42.742804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-14778684-0fdb-49ce-853c-ff8646abc96b req-468217e1-a9e0-4309-bcdf-ca9963d37730 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:42.780969 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-14778684-0fdb-49ce-853c-ff8646abc96b req-468217e1-a9e0-4309-bcdf-ca9963d37730 service nova] Creating event network-changed:b729c68d-47c0-4cf5-b93a-585056bd9955 for instance 282887e6-5c5b-4492-8a31-c1cf713cf95f on nch1-master-1 Apr 02 20:57:42.786759 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-14778684-0fdb-49ce-853c-ff8646abc96b req-468217e1-a9e0-4309-bcdf-ca9963d37730 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070532 Apr 02 20:57:42.787670 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 810/1832] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:42.793031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:42.800959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: 56540e8e-2568-4073-9058-5e42a69df140] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:42.814530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:42.815801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:42.816806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:42.826431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:42.854289 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] HTTP exception thrown: Instance 56540e8e-2568-4073-9058-5e42a69df140 could not be found. Apr 02 20:57:42.855151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Returning 404 to user: Instance 56540e8e-2568-4073-9058-5e42a69df140 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:42.856211 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4fd159e-25b0-4417-81cd-67360d930b37 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140" status: 404 len: 111 microversion: 2.47 time: 0.067227 Apr 02 20:57:42.863903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 811/1833] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:42 2022] GET /compute/v2.1/servers/56540e8e-2568-4073-9058-5e42a69df140 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:57:42.869075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:42.872611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:42.897457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:42.898239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:42.899216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:42.899815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:44.294363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:44.331098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:44.349164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:44.352881 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-072b7205-9c8d-422b-aa25-7506efefc01d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 1.487615 Apr 02 20:57:44.360432 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 812/1834] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:42 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:44.389108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:44.389748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:44.414133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:44.414583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:44.415397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:44.415849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:46.055855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:46.066056 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe65fd1b-7eec-4281-ba2c-18a32c984a82 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1542 microversion: 2.1 time: 1.704277 Apr 02 20:57:46.068303 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 813/1835] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:44 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1542 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:46.081568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:46.088978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:46.102592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:46.105245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:46.106326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:46.107294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:46.753866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42a155fc-94ac-451c-a71b-1ef08fdf0fa1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 8.282909 Apr 02 20:57:46.756163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1023/1836] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:38 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 8307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:46.775035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:46.775966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:46.792908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:46.797228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:46.798311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:46.798920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:46.857405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:57:46.994502 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46e804e4-81d2-436c-bb87-4887ec7c940e tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247" status: 204 len: 0 microversion: 2.47 time: 0.236576 Apr 02 20:57:46.997716 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1024/1837] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 20:57:46 2022] DELETE /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:57:47.006357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:47.007491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:47.016508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:47.017392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:47.023076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:47.024586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:47.561998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:47.573863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-740dcdba-1ed3-42fe-ae13-f2805d1347aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1525 microversion: 2.1 time: 0.574579 Apr 02 20:57:47.581176 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1025/1838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:46 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1525 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:47.590128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:47.590670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:47.631281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:47.632044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:47.635057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:47.635711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:47.785399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:47.799237 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3938e1f-631b-46f7-9fa9-9b1862680038 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 1.721841 Apr 02 20:57:47.812794 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 814/1839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:46 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:47.842507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:47.843669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:47.892578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:47.898077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:47.903604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:47.904194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:48.421334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:48.435089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:48.443397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:48.454611 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eba13b7c-0e80-4433-8516-293c23ed55e5 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247" status: 200 len: 1363 microversion: 2.47 time: 0.639679 Apr 02 20:57:48.460921 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 815/1840] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:47 2022] GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247 => generated 1363 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:48.483432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:48.484596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:48.495221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:48.496046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:48.497120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:48.497733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:48.726509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:48.734672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:48.743036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:48.744802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69c5ff54-2264-41b8-9c26-bb4f3d722f6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 1.162534 Apr 02 20:57:48.745635 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1026/1841] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:47 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:48.754159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-578b59c9-f93e-4989-bbf6-e40dac24378a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d46bee50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:48.827260 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-578b59c9-f93e-4989-bbf6-e40dac24378a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.080340 Apr 02 20:57:48.828369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1027/1842] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:48 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:48.840054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c07f855f-a931-43f8-9fa1-247ca45a59cd req-75116189-3f1e-4a85-ab8b-4359ba9427f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:48.859324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c07f855f-a931-43f8-9fa1-247ca45a59cd req-75116189-3f1e-4a85-ab8b-4359ba9427f4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:48.867458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c07f855f-a931-43f8-9fa1-247ca45a59cd req-75116189-3f1e-4a85-ab8b-4359ba9427f4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:48.891989 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c07f855f-a931-43f8-9fa1-247ca45a59cd req-75116189-3f1e-4a85-ab8b-4359ba9427f4 service nova] Creating event network-changed:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 20:57:48.897925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c07f855f-a931-43f8-9fa1-247ca45a59cd req-75116189-3f1e-4a85-ab8b-4359ba9427f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068087 Apr 02 20:57:48.899813 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1028/1843] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:48.919491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:48.920425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:48.927306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:48.928022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:48.929853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:48.932146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:49.183521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:49.197760 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-214ffda9-30c1-4cb4-93a7-d4e14f7807b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1541 microversion: 2.1 time: 0.732760 Apr 02 20:57:49.199287 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 816/1844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:48 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1541 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:49.207335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:49.210398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:49.219050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:49.219878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:49.221065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:49.222271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:49.521236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:49.530998 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fde333ec-74f6-455a-a114-ba3b6568c3e2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1507 microversion: 2.1 time: 0.629525 Apr 02 20:57:49.535297 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1029/1845] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:48 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:49.544009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:49.549834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:49.565560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:49.567857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:49.569044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:49.573467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:49.744753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:49.777037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:49.781852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '369aaa621e1a4e8788a3e18afeea57a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39ae799bc6f1400186ad8199388612a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:49.786033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-157c1195-061e-4935-ba56-ecf64744fa89 tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247" status: 200 len: 1363 microversion: 2.47 time: 0.249380 Apr 02 20:57:49.786961 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1030/1846] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:49 2022] GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:49.801071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:49.801831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:49.829307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:49.829946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:49.831544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:49.834087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:50.201125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:50.325537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efa8084b-63d9-4466-8db6-fd12d05540f5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 1.124806 Apr 02 20:57:50.328688 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 817/1847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:49 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:50.333190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e83149e2-2bd7-4289-b202-9c86ba2b7a91 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4d3f700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:50.419079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:50.420251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e83149e2-2bd7-4289-b202-9c86ba2b7a91 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.092705 Apr 02 20:57:50.421479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 818/1848] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:50 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:50.440798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:50.448231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:50.449825 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6629b193-1bd9-41f6-8ae8-bb5939010357 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 0.661833 Apr 02 20:57:50.450941 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1031/1849] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:49 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:50.487937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:50.489623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:50.503594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:50.504404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:50.505402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:50.510033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:50.556237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-708672fc-d65b-41a6-93ba-fb21a5b62f8f req-e0ea7f14-8346-4936-9155-09263c7bd651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "name": "network-vif-unplugged", "status": "completed", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:50.575788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-708672fc-d65b-41a6-93ba-fb21a5b62f8f req-e0ea7f14-8346-4936-9155-09263c7bd651 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:50.576539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-708672fc-d65b-41a6-93ba-fb21a5b62f8f req-e0ea7f14-8346-4936-9155-09263c7bd651 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:50.608213 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-708672fc-d65b-41a6-93ba-fb21a5b62f8f req-e0ea7f14-8346-4936-9155-09263c7bd651 service nova] Creating event network-vif-unplugged:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch2-master-1 Apr 02 20:57:50.623844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-708672fc-d65b-41a6-93ba-fb21a5b62f8f req-e0ea7f14-8346-4936-9155-09263c7bd651 service nova] Instance db9db7f5-298f-4032-90f6-c9766b263c24 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:57:50.660125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-708672fc-d65b-41a6-93ba-fb21a5b62f8f req-e0ea7f14-8346-4936-9155-09263c7bd651 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.237154 Apr 02 20:57:50.664099 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 819/1850] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:50.677246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:50.677973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:50.707725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:50.708519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:50.713102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:50.713502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.279349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:51.290390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-41333be4-a020-40a5-96cc-3880231984d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1541 microversion: 2.1 time: 0.819077 Apr 02 20:57:51.292518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1032/1851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:50 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1541 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:51.298543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:51.300332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] [instance: d8bb01bc-7cd9-4480-a0a0-29306a94f247] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:51.308690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.310054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.311885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.312929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.345266 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] HTTP exception thrown: Instance d8bb01bc-7cd9-4480-a0a0-29306a94f247 could not be found. Apr 02 20:57:51.348311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] Returning 404 to user: Instance d8bb01bc-7cd9-4480-a0a0-29306a94f247 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:51.349995 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6def01a7-dea2-4b8c-9772-cbd0cb99d3af tempest-ServerShowV247Test-69246232 tempest-ServerShowV247Test-69246232-project] 10.222.0.18 "GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247" status: 404 len: 111 microversion: 2.47 time: 0.055661 Apr 02 20:57:51.351577 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1033/1852] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:51 2022] GET /compute/v2.1/servers/d8bb01bc-7cd9-4480-a0a0-29306a94f247 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:57:51.385300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f82d9824-930b-48fe-a2a2-8eb42d7c2b6f req-db652c9c-0888-4ef1-8cbe-1fbcabc9c263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be683205-2b54-4939-9129-7bb9eebeb181", "tag": "2331c06a-ee7d-4041-8052-210fa1ebd75e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:51.400872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f82d9824-930b-48fe-a2a2-8eb42d7c2b6f req-db652c9c-0888-4ef1-8cbe-1fbcabc9c263 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.401415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f82d9824-930b-48fe-a2a2-8eb42d7c2b6f req-db652c9c-0888-4ef1-8cbe-1fbcabc9c263 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.415355 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f82d9824-930b-48fe-a2a2-8eb42d7c2b6f req-db652c9c-0888-4ef1-8cbe-1fbcabc9c263 service nova] Creating event network-changed:2331c06a-ee7d-4041-8052-210fa1ebd75e for instance be683205-2b54-4939-9129-7bb9eebeb181 on nch2-master-1 Apr 02 20:57:51.420677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f82d9824-930b-48fe-a2a2-8eb42d7c2b6f req-db652c9c-0888-4ef1-8cbe-1fbcabc9c263 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067274 Apr 02 20:57:51.421877 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1034/1853] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:51.427828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4c975baf-3aa7-4bd9-8709-04aa3952f53e req-a1a3ec4f-ceda-4467-a4a7-05ed9c9d9d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88c5184-0805-4677-a11d-4077b9465e11", "name": "network-vif-unplugged", "status": "completed", "tag": "f4087e3e-4f59-4105-bdf5-e1707ada38cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:51.440790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4c975baf-3aa7-4bd9-8709-04aa3952f53e req-a1a3ec4f-ceda-4467-a4a7-05ed9c9d9d98 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.441969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4c975baf-3aa7-4bd9-8709-04aa3952f53e req-a1a3ec4f-ceda-4467-a4a7-05ed9c9d9d98 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.465660 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4c975baf-3aa7-4bd9-8709-04aa3952f53e req-a1a3ec4f-ceda-4467-a4a7-05ed9c9d9d98 service nova] Creating event network-vif-unplugged:f4087e3e-4f59-4105-bdf5-e1707ada38cb for instance d88c5184-0805-4677-a11d-4077b9465e11 on nch2-master-1 Apr 02 20:57:51.485764 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4c975baf-3aa7-4bd9-8709-04aa3952f53e req-a1a3ec4f-ceda-4467-a4a7-05ed9c9d9d98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062293 Apr 02 20:57:51.488192 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1035/1854] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:51.503857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:51.505005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:51.520781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.521468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.524376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.525045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.525550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:51.536264 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a0b3fa56-24f5-4eb2-8e13-367f4ee62778 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1507 microversion: 2.1 time: 0.870424 Apr 02 20:57:51.541993 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 820/1855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:50 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1507 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:51.552244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c7e04e2-76f2-4044-ae51-eda5df5adb08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4c94f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:51.667378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c7e04e2-76f2-4044-ae51-eda5df5adb08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.124138 Apr 02 20:57:51.667996 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 821/1856] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:51 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:51.683266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:51.687496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:51.713670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.714175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.721038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:51.721517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:51.961587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:51.979616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f99129a-ca9f-46ae-8a08-a699ebec9f23 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 0.489354 Apr 02 20:57:51.980735 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1036/1857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:51 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:52.309771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:52.310455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:52.318834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:52.319287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:52.320084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:52.320815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:52.822693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:52.832700 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de25f3fe-1b78-4f98-a3ca-1c2c9c944423 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1541 microversion: 2.1 time: 0.527532 Apr 02 20:57:52.834298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1037/1858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:52 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1541 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:52.847739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:52.848722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:52.858664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:52.859860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:52.861352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:52.862171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:52.981180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:52.989680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:52.996279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:52.999889 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-68e1cb68-bfa1-4143-bb97-0662d1796853 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1568 microversion: 2.25 time: 1.322947 Apr 02 20:57:53.000700 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 822/1859] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:51 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1568 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:53.019678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b085e7c6-0353-4ddb-8bad-24bdb9ddbbdf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4d3fe50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:53.074133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:53.093738 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5479fac7-9209-44fb-a92e-0779757fdb69 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1450 microversion: 2.1 time: 0.254925 Apr 02 20:57:53.106136 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1038/1860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:52 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1450 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:53.109308 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b085e7c6-0353-4ddb-8bad-24bdb9ddbbdf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.098812 Apr 02 20:57:53.110898 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 823/1861] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:53 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:53.120324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:53.121224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:53.128567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.129262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.130231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.130846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.136189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b68ba9be-7eae-477e-9df5-8f135014334f req-6b1a5b72-08c7-4aef-b88f-0a0fe2940f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:53.156561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b68ba9be-7eae-477e-9df5-8f135014334f req-6b1a5b72-08c7-4aef-b88f-0a0fe2940f55 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.159417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b68ba9be-7eae-477e-9df5-8f135014334f req-6b1a5b72-08c7-4aef-b88f-0a0fe2940f55 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.194748 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b68ba9be-7eae-477e-9df5-8f135014334f req-6b1a5b72-08c7-4aef-b88f-0a0fe2940f55 service nova] Creating event network-changed:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch2-master-1 Apr 02 20:57:53.204313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-b68ba9be-7eae-477e-9df5-8f135014334f req-6b1a5b72-08c7-4aef-b88f-0a0fe2940f55 service nova] Instance db9db7f5-298f-4032-90f6-c9766b263c24 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:57:53.228735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b68ba9be-7eae-477e-9df5-8f135014334f req-6b1a5b72-08c7-4aef-b88f-0a0fe2940f55 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123817 Apr 02 20:57:53.230922 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1039/1862] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:57:53.239637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:53.241237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:53.251079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.251557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.253481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.253933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.804637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:53.817923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7b5411a-1277-4e4d-aeaf-9f9882b0ed0d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 0.705271 Apr 02 20:57:53.821207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 824/1863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:53 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:53.854894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:53.856042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:53.871602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.873808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.875028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:53.881439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:53.918224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:53.931971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8bf3b6e4-2c63-46f8-9986-bd8f0bfc782f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1450 microversion: 2.1 time: 0.694663 Apr 02 20:57:53.956834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1040/1864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:53 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1450 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:54.019595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:54.020211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:54.039148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:54.040355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:54.043994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:54.046967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:54.741204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:54.756399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:54.759098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:54.760614 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd9b1107-db1f-405e-895f-b98172027642 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1558 microversion: 2.25 time: 0.744955 Apr 02 20:57:54.778887 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1041/1865] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:54 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1558 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:54.786054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:54.787073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:54.795649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:54.796500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:54.797567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:54.799825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:54.837211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lazy-loading 'flavor' on Instance uuid d88c5184-0805-4677-a11d-4077b9465e11 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:54.857980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'shelve' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state shelved_offloaded Apr 02 20:57:54.859060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'shelve' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state shelved_offloaded {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:57:54.861019 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0bba094-8f58-4f86-a46d-9d83ef2f2155 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 155 microversion: 2.1 time: 0.080292 Apr 02 20:57:54.864199 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1042/1866] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:54 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 155 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:57:54.871336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1c7faee-1be4-4759-8f52-d0abd93df623 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4575b80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:54.942175 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1c7faee-1be4-4759-8f52-d0abd93df623 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.076459 Apr 02 20:57:54.943074 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1043/1867] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:54 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:54.949480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d235802d-f9bf-4bf1-af7c-d7b7b71c4059 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '.version_select at 0x7f54d45a41f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:54.952536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d235802d-f9bf-4bf1-af7c-d7b7b71c4059 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:54.953211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d235802d-f9bf-4bf1-af7c-d7b7b71c4059 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:54.969162 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d235802d-f9bf-4bf1-af7c-d7b7b71c4059 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.025011 Apr 02 20:57:54.979999 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1044/1868] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Apr 2 20:57:54 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:54.987350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:54.990555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:55.004562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.006319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.011976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.013854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.038927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:55.047696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f1729218-13b0-46be-a341-42ab886662de tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1473 microversion: 2.1 time: 1.200165 Apr 02 20:57:55.063180 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 825/1869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:53 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1473 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:55.073693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:55.077159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:55.090520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.090996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.091802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.092254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.422955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:55.436147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-829e0f1e-b146-4808-a8c8-e5cf32b23aa2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 0.454313 Apr 02 20:57:55.446520 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1045/1870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:54 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:55.452376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:55.452376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:55.463190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.463190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.464297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.464870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.687458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 282887e6-5c5b-4492-8a31-c1cf713cf95f {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:57:55.718006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51fab9c1-8643-4fb7-8e97-b50f960ff3d0 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 2050 microversion: 2.25 time: 0.277114 Apr 02 20:57:55.722138 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1046/1871] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:55 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 2050 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:57:55.726814 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6583ee3-53b4-49b3-abf0-359abbd05382 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 202 len: 0 microversion: 2.1 time: 0.662346 Apr 02 20:57:55.738897 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 826/1872] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:55 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:57:55.757481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:55.758423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:55.771953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.772871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.781680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:55.782608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:55.949538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-704128747", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "eb9b7612-59b4-4022-aa4f-4de8d7979f06"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:56.162343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:56.173850 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6637b0fa-8c2d-4f4e-a951-f5e83d1c57a0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1458 microversion: 2.1 time: 0.433322 Apr 02 20:57:56.185579 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1047/1873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:55 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1458 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:56.194551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9906fe95-240e-419f-9a6d-4e3ce43782c3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d46beb80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:56.378372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] validate_networks() for [('eb9b7612-59b4-4022-aa4f-4de8d7979f06', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:57:56.538392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9906fe95-240e-419f-9a6d-4e3ce43782c3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1411 microversion: 2.1 time: 0.355797 Apr 02 20:57:56.538991 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1048/1874] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:56 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1411 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:56.563308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:56.563937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:56.598655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:56.599162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:56.609537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:56.610454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:57.133666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:57.145528 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5552995-e4a5-4858-ad33-1097356799fd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1470 microversion: 2.1 time: 0.600207 Apr 02 20:57:57.147297 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1049/1875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:56 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:57.185257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:57.186055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:57.197446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:57.208768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:57.211032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:57.217597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:57.855506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:57:57.856051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:57:57.856395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:57:57.857089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:57:57.857653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:57:57.877174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:57.878199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:57.879023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:57.879477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:57.969632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:57:57.977908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for user 4eaee1ddad0041828fb2e65677e2da25 and project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:57:58.042601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:57:58.047500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:57:58.153352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-491d1ab5-2238-4fa7-a18f-7c8f21551ef7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.207841 Apr 02 20:57:58.155762 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 827/1876] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 02 20:57:58.554341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:58.588436 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b929a92-297f-4e65-8d6e-d809520412ba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 1.436247 Apr 02 20:57:58.589079 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1050/1877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:57 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:58.620502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:58.621045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:58.639090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:58.639561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:58.640435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:58.640912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:58.720892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:58.721958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:58.722799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:58.723250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:58.789570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for project bf81401733804432b781dd367ab7bd82. Resources: {'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:57:58.807819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for user c1d982c5db7e47a6ae521f2137af3204 and project bf81401733804432b781dd367ab7bd82. Resources: {'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:57:58.843082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-712056623", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "58fa3672-fa03-4f54-a24a-d36533b2e021"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:57:58.959277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] validate_networks() for [('58fa3672-fa03-4f54-a24a-d36533b2e021', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:57:59.138357 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73872589-22f0-4e5c-9513-7334b2d34771 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24/action" status: 202 len: 0 microversion: 2.1 time: 0.535017 Apr 02 20:57:59.139703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1051/1878] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:57:58 2022] POST /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:57:59.162835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:59.167080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:59.183954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:59.184480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:59.189617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:59.191031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:59.818179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:57:59.829721 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b802e24b-93b0-4abf-a23d-0adaa96f30a5 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.677694 Apr 02 20:57:59.830569 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1052/1879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:57:59 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:59.865150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a6360e4c-f639-4b57-b6d5-8db08e9ae9f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d453e3a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:59.931241 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a6360e4c-f639-4b57-b6d5-8db08e9ae9f6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1420 microversion: 2.1 time: 0.089103 Apr 02 20:57:59.939555 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1053/1880] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:57:59 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:57:59.945903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:57:59.946874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:57:59.955489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:59.956550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:57:59.958194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:57:59.958864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.055165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:00.065695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:00.068263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:00.070739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-388c139b-2f75-4af9-a4e2-55f7be27496d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1313 microversion: 2.25 time: 0.129411 Apr 02 20:58:00.078555 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1054/1881] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:57:59 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:00.097189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:00.098327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:00.106921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.107854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.109061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.109791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.707726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:00.716214 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f726443-0554-4ba1-864f-5374988ee6d3 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1469 microversion: 2.1 time: 0.624762 Apr 02 20:58:00.738582 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1055/1882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:00 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1469 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:00.743819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d1290f31-ce61-4e7a-9a72-207492913c33 req-e24f82a5-dea1-4a61-a788-21bef839cf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "name": "network-vif-plugged", "status": "completed", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:00.759503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d1290f31-ce61-4e7a-9a72-207492913c33 req-e24f82a5-dea1-4a61-a788-21bef839cf2e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.759959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d1290f31-ce61-4e7a-9a72-207492913c33 req-e24f82a5-dea1-4a61-a788-21bef839cf2e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.801323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:00.802721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:00.803392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:00.805228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:00.805863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:00.808746 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d1290f31-ce61-4e7a-9a72-207492913c33 req-e24f82a5-dea1-4a61-a788-21bef839cf2e service nova] Creating event network-vif-plugged:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 20:58:00.816565 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d1290f31-ce61-4e7a-9a72-207492913c33 req-e24f82a5-dea1-4a61-a788-21bef839cf2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076499 Apr 02 20:58:00.817513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1056/1883] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:00.824896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:00.826455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:00.834663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.835519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.836148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.838600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.839204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.841481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.842498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:00.842961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:00.895572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Getting quotas for project d0e22715a8e849e0871b68d772ed29fd. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:00.917655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Getting quotas for user 821ac6c697bc4706ad36b8be4e9276a5 and project d0e22715a8e849e0871b68d772ed29fd. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:00.948371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:00.955523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:01.031285 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7bd83da-1df2-4221-9e32-39dc6f0364f1 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.872757 Apr 02 20:58:01.037430 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 828/1884] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:58:01.048062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd4a19e5-ae55-4f58-8f87-2ef454cd5eb6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4c66af0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:01.141605 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd4a19e5-ae55-4f58-8f87-2ef454cd5eb6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 200 len: 1420 microversion: 2.1 time: 0.100885 Apr 02 20:58:01.145683 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 829/1885] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:58:01 2022] GET /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:01.159151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:01.160856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:01.182349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:01.182990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:01.186246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:01.188344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:01.530453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:01.539015 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21154d55-86db-49df-9ad3-ca8cc33a2441 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.388522 Apr 02 20:58:01.541834 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 830/1886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:01 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:01.561488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-550a3cfe-6aeb-4444-96e0-eb5801aa6ce2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:01.562213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:01.573537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-550a3cfe-6aeb-4444-96e0-eb5801aa6ce2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:01.581666 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78a0c059-be48-4099-8a34-2940059c9993 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 0.759535 Apr 02 20:58:01.584023 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1057/1887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:00 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:01.630032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:01.634143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:01.655330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:01.656079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:01.659359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-550a3cfe-6aeb-4444-96e0-eb5801aa6ce2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:01.660749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:01.661314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:01.667680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-550a3cfe-6aeb-4444-96e0-eb5801aa6ce2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1223 microversion: 2.1 time: 0.110395 Apr 02 20:58:01.683942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 831/1888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:01 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:01.690096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-badded78-a5d7-487c-8a99-03c02e22fc0f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4c66c10>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:01.871492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:01.881593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:01.883914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:01.886734 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3267c506-c886-4512-bd6d-11d857e503af tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1319 microversion: 2.25 time: 0.289894 Apr 02 20:58:01.891278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1058/1889] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:01 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:01.901023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:01.903598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:01.916722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:01.918075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:01.919975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:01.925416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:02.752291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:02.762828 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23ddc7cf-f213-4b73-bfde-d17301fce5ea tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1469 microversion: 2.1 time: 0.868388 Apr 02 20:58:02.765453 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1059/1890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:01 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1469 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:02.780050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:02.780878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:02.797042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:02.798547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:02.800622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:02.801949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:03.129662 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-badded78-a5d7-487c-8a99-03c02e22fc0f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 204 len: 0 microversion: 2.1 time: 1.443174 Apr 02 20:58:03.130387 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 832/1891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:01 2022] DELETE /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:58:03.137448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:03.139277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:03.153669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:03.155278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:03.160330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:03.162171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:03.657955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:03.670984 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec3de57c-93c1-45ff-9c9c-91c6e279856f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.904354 Apr 02 20:58:03.691022 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1060/1892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:02 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:03.708167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:03.710483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:03.736427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:03.745092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:03.747025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:03.749837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:04.702454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:04.712311 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bce37027-b63e-40f4-96de-2e126f6c16d2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1281 microversion: 2.1 time: 1.019754 Apr 02 20:58:04.722685 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1061/1893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:03 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1281 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:04.747477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "name": "network-vif-plugged", "status": "completed", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}, {"server_uuid": "be683205-2b54-4939-9129-7bb9eebeb181", "name": "network-vif-plugged", "status": "completed", "tag": "2331c06a-ee7d-4041-8052-210fa1ebd75e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:04.781929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:04.785262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:04.805910 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] Creating event network-vif-plugged:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 20:58:04.806909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] Creating event network-vif-plugged:2331c06a-ee7d-4041-8052-210fa1ebd75e for instance be683205-2b54-4939-9129-7bb9eebeb181 on nch2-master-1 Apr 02 20:58:04.817811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] Instance db9db7f5-298f-4032-90f6-c9766b263c24 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:58:04.846899 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ebb51163-90cd-4cc1-b972-86270942fb68 req-dd4ac4ab-31ef-434d-966d-57b8e8a292c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120503 Apr 02 20:58:04.847943 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1062/1894] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:04.858274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:04.859386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:04.879979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:04.887240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:04.889348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:04.890495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:05.391383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:05.399560 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-98c06edc-bd39-463e-8125-228c4a3672d8 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 2.267887 Apr 02 20:58:05.406239 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 833/1895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:03 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:05.414794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:05.421560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:05.439356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:05.450925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:05.452330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:05.455864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:05.578528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:05.587979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:58:05.607817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:05.619591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:05.622961 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa7c14c9-9873-4d71-a02e-a0717da95dbe tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 0.772875 Apr 02 20:58:05.630725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1063/1896] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:04 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:05.652527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:05.656982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:05.696385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:05.698573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:05.702573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:05.704770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:05.863924 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-96ad72b3-a245-40c4-a2ac-9d7609552fe4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 204 len: 0 microversion: 2.1 time: 0.450211 Apr 02 20:58:05.864959 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 834/1897] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:58:05 2022] DELETE /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:58:05.878434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:05.879487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:05.896815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:05.897547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:05.899490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:05.901515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:06.493676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:06.512086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9afb2574-d84b-4c27-820b-088d94eb612a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 0.872865 Apr 02 20:58:06.513682 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1064/1898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:05 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:06.524951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:06.528275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:06.545785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:06.547274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:06.550590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:06.552010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:06.772675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:06.785038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1ca0300-f4b6-44b6-b85f-408b6b35955f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1281 microversion: 2.1 time: 0.269903 Apr 02 20:58:06.796321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1065/1899] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:06 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1281 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:06.803592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-270961375", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "f2d4ece6-a97d-4f79-921c-5a419ec5ae76"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:06.897004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] validate_networks() for [('f2d4ece6-a97d-4f79-921c-5a419ec5ae76', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:58:07.114808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:07.126227 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-75697c8e-64a6-4a27-8c9b-1e334ae04991 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 1.259441 Apr 02 20:58:07.136447 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 835/1900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:05 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:07.141596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d9a32c24-ed71-4d41-b138-521f439818ab req-eb630970-b3bb-41a3-aa5a-d68975e14235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d2897f-4f31-4c6f-87ee-0279c8e9a3af", "tag": "7f987878-99ad-40c2-b531-b8c74a1c3c64"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:07.151281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d9a32c24-ed71-4d41-b138-521f439818ab req-eb630970-b3bb-41a3-aa5a-d68975e14235 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:07.152052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d9a32c24-ed71-4d41-b138-521f439818ab req-eb630970-b3bb-41a3-aa5a-d68975e14235 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:07.167169 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d9a32c24-ed71-4d41-b138-521f439818ab req-eb630970-b3bb-41a3-aa5a-d68975e14235 service nova] Creating event network-changed:7f987878-99ad-40c2-b531-b8c74a1c3c64 for instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af on nch2-master-1 Apr 02 20:58:07.172570 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d9a32c24-ed71-4d41-b138-521f439818ab req-eb630970-b3bb-41a3-aa5a-d68975e14235 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034463 Apr 02 20:58:07.173964 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 836/1901] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:07.180345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:07.181325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:07.188554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:07.189365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:07.190932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:07.191580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.029617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:08.041686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:08.042242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:08.042577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:08.043224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:08.043906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:08.044320 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3118c0e0-cc42-4c67-b1b9-3cef4586337c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1313 microversion: 2.1 time: 0.863789 Apr 02 20:58:08.045052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 837/1902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:07 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1313 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:08.077151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:08.078496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:08.089072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.089534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.094122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.095319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.120527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.129083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.149092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.149890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.162887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:08.171156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for user 2e7bca7cae174c2c9b83217ea73a973e and project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:08.208682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:08.211914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:08.342886 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fca6fdef-9b12-4d66-b4dd-e8f0449ee05a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544669 Apr 02 20:58:08.350861 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1066/1903] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:58:08.359671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-88b07b0d-9a8c-4287-89cd-b38eb3ce43aa req-6bf79d15-5d1c-4085-84ae-cf521bf4294a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea0ad92-ff3e-49af-b783-93700d77d500", "name": "network-vif-unplugged", "status": "completed", "tag": "2faa1981-89af-49a0-9dd1-17e23172df4b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:08.390574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-88b07b0d-9a8c-4287-89cd-b38eb3ce43aa req-6bf79d15-5d1c-4085-84ae-cf521bf4294a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.394117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-88b07b0d-9a8c-4287-89cd-b38eb3ce43aa req-6bf79d15-5d1c-4085-84ae-cf521bf4294a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.435167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-88b07b0d-9a8c-4287-89cd-b38eb3ce43aa req-6bf79d15-5d1c-4085-84ae-cf521bf4294a service nova] Creating event network-vif-unplugged:2faa1981-89af-49a0-9dd1-17e23172df4b for instance 3ea0ad92-ff3e-49af-b783-93700d77d500 on nch1-master-1 Apr 02 20:58:08.461176 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-88b07b0d-9a8c-4287-89cd-b38eb3ce43aa req-6bf79d15-5d1c-4085-84ae-cf521bf4294a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108262 Apr 02 20:58:08.462764 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1067/1904] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:08.471857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:08.473813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:08.482575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.483854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:08.485047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:08.485715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:09.473258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:09.482602 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5ebc6538-9548-4304-9898-f6429c29d9e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 1.016756 Apr 02 20:58:09.485290 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1068/1905] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:08 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:09.525464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:09.529839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:09.557277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:09.557753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:09.564415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:09.567460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:09.614366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:09.626924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:09.626924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:09.626924 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1778db43-c3db-4e29-9e80-9fc415bca44f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 1.574517 Apr 02 20:58:09.661956 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 838/1906] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:08 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:09.667098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-189eea55-091e-418b-b49b-f2f736724193 req-83067417-f9b9-4c30-8325-e021ae0a2e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "name": "network-vif-unplugged", "status": "completed", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:09.724807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-189eea55-091e-418b-b49b-f2f736724193 req-83067417-f9b9-4c30-8325-e021ae0a2e3a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:09.725270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-189eea55-091e-418b-b49b-f2f736724193 req-83067417-f9b9-4c30-8325-e021ae0a2e3a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:09.784772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-189eea55-091e-418b-b49b-f2f736724193 req-83067417-f9b9-4c30-8325-e021ae0a2e3a service nova] Creating event network-vif-unplugged:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 20:58:09.817893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-189eea55-091e-418b-b49b-f2f736724193 req-83067417-f9b9-4c30-8325-e021ae0a2e3a service nova] Instance db9db7f5-298f-4032-90f6-c9766b263c24 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:58:09.844406 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-189eea55-091e-418b-b49b-f2f736724193 req-83067417-f9b9-4c30-8325-e021ae0a2e3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180767 Apr 02 20:58:09.848279 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 839/1907] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:09.869768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:09.870493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:09.887429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:09.888738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:09.890763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:09.891963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:10.150005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:10.192137 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-394cd3b8-0627-4912-b877-391b8e34069c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.677674 Apr 02 20:58:10.192137 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1069/1908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:09 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:10.206111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:10.206885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:10.233466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:10.233920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:10.241018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:10.241668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:10.463258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:10.476826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd88e4ed-e4b4-46cf-aaea-97fe31e76db0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1267 microversion: 2.1 time: 0.287196 Apr 02 20:58:10.477616 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1070/1909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:10 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:10.493453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:10.494559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:10.502704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:10.504051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:10.505213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:10.506029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:10.934964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:10.951399 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5d6c2a2-d142-4b49-ae7d-a984d2313ed9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1463 microversion: 2.1 time: 0.471472 Apr 02 20:58:10.952484 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1071/1910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:10 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1463 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:10.960081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:10.961199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:10.979526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:10.980392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:10.984655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:10.985320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:11.267222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:11.280969 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9fdcc524-1585-46d0-983b-0f62f97ac674 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 1.429698 Apr 02 20:58:11.282820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 840/1911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:09 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:11.302694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fc6360ce-ceaa-424f-b9c6-c315bc3aa172 req-7df0c5b9-3259-4984-88c2-de6550617cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea0ad92-ff3e-49af-b783-93700d77d500", "name": "network-vif-deleted", "tag": "2faa1981-89af-49a0-9dd1-17e23172df4b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:11.332300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fc6360ce-ceaa-424f-b9c6-c315bc3aa172 req-7df0c5b9-3259-4984-88c2-de6550617cb0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:11.335305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fc6360ce-ceaa-424f-b9c6-c315bc3aa172 req-7df0c5b9-3259-4984-88c2-de6550617cb0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:11.360268 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fc6360ce-ceaa-424f-b9c6-c315bc3aa172 req-7df0c5b9-3259-4984-88c2-de6550617cb0 service nova] Creating event network-vif-deleted:2faa1981-89af-49a0-9dd1-17e23172df4b for instance 3ea0ad92-ff3e-49af-b783-93700d77d500 on nch1-master-1 Apr 02 20:58:11.366396 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fc6360ce-ceaa-424f-b9c6-c315bc3aa172 req-7df0c5b9-3259-4984-88c2-de6550617cb0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080440 Apr 02 20:58:11.367597 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 841/1912] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:11.378394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:11.380596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:11.409940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:11.410666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:11.411641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:11.412248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.051281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:12.074713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4c811777-6e6e-41bd-83af-4717eeb8d1ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 1.120901 Apr 02 20:58:12.076041 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1072/1913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:10 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:12.082006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:12.082832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:12.091799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:12.092901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.093977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:12.094660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.420496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:12.435294 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc14e9ae-34b0-44c0-b3de-0883619b4967 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1463 microversion: 2.1 time: 0.357790 Apr 02 20:58:12.435915 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1073/1914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:12 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1463 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:12.465869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:12.483056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:12.500484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:12.502541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.503582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:12.504207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.878728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:12.891961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:12.900879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:12.904688 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a2357650-f0bf-4054-bf99-23ca1cd93a69 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 1.535694 Apr 02 20:58:12.907150 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 842/1915] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:11 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:12.929853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:12.932851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:12.953333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:12.954206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.955770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:12.957394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:12.999211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:13.007992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28c13632-3dbd-4048-949c-40fefb3b5574 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.546149 Apr 02 20:58:13.015532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1074/1916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:12 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:13.028398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a0448459-8555-4703-ab87-a02110a7a818 req-5aed62a4-13fb-4c7c-b5e8-2ba9c0db5e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:13.059989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a0448459-8555-4703-ab87-a02110a7a818 req-5aed62a4-13fb-4c7c-b5e8-2ba9c0db5e31 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:13.069172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a0448459-8555-4703-ab87-a02110a7a818 req-5aed62a4-13fb-4c7c-b5e8-2ba9c0db5e31 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:13.102768 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a0448459-8555-4703-ab87-a02110a7a818 req-5aed62a4-13fb-4c7c-b5e8-2ba9c0db5e31 service nova] Creating event network-changed:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 20:58:13.118429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-a0448459-8555-4703-ab87-a02110a7a818 req-5aed62a4-13fb-4c7c-b5e8-2ba9c0db5e31 service nova] Instance db9db7f5-298f-4032-90f6-c9766b263c24 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:58:13.144406 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a0448459-8555-4703-ab87-a02110a7a818 req-5aed62a4-13fb-4c7c-b5e8-2ba9c0db5e31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126924 Apr 02 20:58:13.150202 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1075/1917] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:13.164935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:13.171650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:13.180245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:13.188077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:13.190310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:13.191024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:13.579496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:13.588417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-467a6846-5332-4ebb-af10-af96f7ca1c0d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.678621 Apr 02 20:58:13.607017 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 843/1918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:12 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:13.627092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1709764352", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7b367d88-0807-449d-bd01-d227a66e6958"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:13.770026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:58:14.095345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:14.109139 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac4ff31c-2b43-4493-ab65-4d13a2d8c9ae tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.956686 Apr 02 20:58:14.110315 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1076/1919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:13 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:14.119672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:14.123768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:14.137645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:14.138575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:14.139627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:14.140262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:14.417612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:14.429290 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f49b7a2-bb92-46c9-bbe4-37707bb590da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 0.314847 Apr 02 20:58:14.441103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1077/1920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:14 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:14.454615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:14.458842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:14.475453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:14.477853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:14.482566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:14.483233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:14.917590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:14.931288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:14.935207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:14.940743 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5b75fb6-15c4-4af6-9ab2-6c5a032ef48a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 0.497940 Apr 02 20:58:14.943607 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1078/1921] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:14 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:14.953308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:14.957739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:14.967786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:14.969039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:14.971413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:14.972357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.145172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:15.153951 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-44284ff8-8986-4e32-8f45-e0d99d2755e3 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.208966 Apr 02 20:58:15.154999 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1079/1922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:14 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:15.160909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:15.161674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:15.167868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.168360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.169184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.169626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.324552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:15.333530 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4aca61f8-3fc4-45cb-a7c6-fffddc48214f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.177236 Apr 02 20:58:15.334736 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1080/1923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:15 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:15.339757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:15.340619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:15.347390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.347849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.348661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.349127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.530042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:15.539569 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fef89a28-b2af-4268-bc42-035cc9fc50d4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.202945 Apr 02 20:58:15.553911 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1081/1924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:15 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:15.560440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f2e18d8b-58f2-45c7-881f-7ce14d0028d1 req-e9071e18-385d-40b5-b3f4-206f963492af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:15.569540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f2e18d8b-58f2-45c7-881f-7ce14d0028d1 req-e9071e18-385d-40b5-b3f4-206f963492af service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.570054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f2e18d8b-58f2-45c7-881f-7ce14d0028d1 req-e9071e18-385d-40b5-b3f4-206f963492af service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.582403 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f2e18d8b-58f2-45c7-881f-7ce14d0028d1 req-e9071e18-385d-40b5-b3f4-206f963492af service nova] Creating event network-changed:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:58:15.588101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f2e18d8b-58f2-45c7-881f-7ce14d0028d1 req-e9071e18-385d-40b5-b3f4-206f963492af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032275 Apr 02 20:58:15.589426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1082/1925] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:15.595918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:15.595918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:15.604097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.604097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.604097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.604097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.700593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:15.701183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:15.701689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:15.702375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:15.702890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:15.714908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.715919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.717747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.718449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.738439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Getting quotas for project d84de315abb1452fa5187770db66041e. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:15.743437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Getting quotas for user a9953e57681446849124a494fa1cdf44 and project d84de315abb1452fa5187770db66041e. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:15.758306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:15.761036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:15.825029 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72817c69-24d6-400f-853c-1054a0d7b49b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.209906 Apr 02 20:58:15.829043 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 844/1926] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:58:15.840641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:15.841091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a3d24b2-b917-449d-8954-52b74c8b0224 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:15.841888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a3d24b2-b917-449d-8954-52b74c8b0224 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:15.851626 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4f4e2172-14ab-45bc-9158-08fe2934b720 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 0.260960 Apr 02 20:58:15.854117 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1083/1927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:15 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:15.962306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:15.963215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:15.985070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.985671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:15.986754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:15.987316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.012279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a3d24b2-b917-449d-8954-52b74c8b0224 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.023885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a3d24b2-b917-449d-8954-52b74c8b0224 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1214 microversion: 2.1 time: 0.188127 Apr 02 20:58:16.025291 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 845/1928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:15 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:16.181450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:16.182316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:16.203169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.204259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.207153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.207830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.291426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.305938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.308083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.309723 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-447f114b-f8c8-40a7-9ab7-9cea949e7f4c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 0.352974 Apr 02 20:58:16.310843 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1084/1929] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:15 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:16.352949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:16.353914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:16.361240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.362631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.364815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.365480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.578458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.592709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cb986345-cdfb-45a1-bff7-9aa460daea97 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.244129 Apr 02 20:58:16.598275 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1085/1930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:16 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:16.603978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:16.604831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:16.613208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.613659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.614475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.614913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.789824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.798108 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-24fa0fea-a667-4446-b3f4-5d482639bcf0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.198236 Apr 02 20:58:16.799289 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1086/1931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:16 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:16.863592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:16.872397 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-97a0e4ce-78ff-4aaf-b135-21b8c42bd918 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.704988 Apr 02 20:58:16.873017 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 846/1932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:16 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:16.876596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:16.876596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:16.884278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.884772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:16.885956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:16.886417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.176790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:17.188189 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-600de493-329a-4057-9968-17a75b78e0e4 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 0.321540 Apr 02 20:58:17.189539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1087/1933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:16 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:17.198281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:17.198908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:17.205150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.206026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.207139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.208350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.239553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8716dc38-958f-4e60-b0ce-7551a861ad09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: .version_select at 0x7f54d4d898b0>, body: {"keypair": {"name": "tempest-keypair-429665395"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:17.262057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-8716dc38-958f-4e60-b0ce-7551a861ad09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:17.267952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-8716dc38-958f-4e60-b0ce-7551a861ad09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for user 449253ed73e04f47bcd09c3a1cca6e8c and project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:17.303113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:17.331188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9eae4d6b-ea7b-4931-83c1-38ee3b7a2f42 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1266 microversion: 2.1 time: 0.138020 Apr 02 20:58:17.332560 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1088/1934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:17 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:17.340000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:17.345540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:17.358745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.365554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.366766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.367458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.732292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-8716dc38-958f-4e60-b0ce-7551a861ad09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:17.744007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-8716dc38-958f-4e60-b0ce-7551a861ad09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for user 449253ed73e04f47bcd09c3a1cca6e8c and project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:17.751024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:17.762873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:17.771251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:17.774451 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4c7dbb82-20ba-43cf-8de7-4117bf3b7fe6 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 0.439255 Apr 02 20:58:17.776382 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1089/1935] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:17 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:17.789491 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8716dc38-958f-4e60-b0ce-7551a861ad09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.756613 Apr 02 20:58:17.790279 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 847/1936] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 20:58:17 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:17.791307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:17.792173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:17.806459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.806825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-20ba0f1f-afeb-42c9-ae7b-ca1782fa1c0b req-ac131f7d-6236-43f7-baad-06e5de3e67e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a010647f-dc6e-4a5e-9767-100a054b5fda", "tag": "2c343cee-04a3-4dee-907f-0bea1da0e4d1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:17.807554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.808934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.810621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.828137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-20ba0f1f-afeb-42c9-ae7b-ca1782fa1c0b req-ac131f7d-6236-43f7-baad-06e5de3e67e8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.828643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-20ba0f1f-afeb-42c9-ae7b-ca1782fa1c0b req-ac131f7d-6236-43f7-baad-06e5de3e67e8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.859644 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-20ba0f1f-afeb-42c9-ae7b-ca1782fa1c0b req-ac131f7d-6236-43f7-baad-06e5de3e67e8 service nova] Creating event network-changed:2c343cee-04a3-4dee-907f-0bea1da0e4d1 for instance a010647f-dc6e-4a5e-9767-100a054b5fda on nch2-master-1 Apr 02 20:58:17.874564 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-20ba0f1f-afeb-42c9-ae7b-ca1782fa1c0b req-ac131f7d-6236-43f7-baad-06e5de3e67e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077514 Apr 02 20:58:17.876818 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 848/1937] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:17.899149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:17.903402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:17.917945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.918838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:17.921095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:17.923398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.200100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:18.211433 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72d6e238-9643-4477-b0e7-afe6eb4fb62a tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.433643 Apr 02 20:58:18.215304 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1090/1938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:17 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:18.231108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:18.232140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:18.239145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.239957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.241018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.241627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.818576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:18.838329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef988a69-3ef0-4ecb-b869-ff0b63039ce4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.610851 Apr 02 20:58:18.850994 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1091/1939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:18 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:18.854830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:18.863081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-cb01c050-4355-4c52-ba4e-1ecb8039bf57 req-ed6a37d1-a11d-42c3-b5a0-1cbcb976b08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d2897f-4f31-4c6f-87ee-0279c8e9a3af", "name": "network-vif-plugged", "status": "completed", "tag": "7f987878-99ad-40c2-b531-b8c74a1c3c64"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:18.867182 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ef0e130d-1866-45e6-96f2-adfa976d16cd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.987128 Apr 02 20:58:18.868748 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 849/1940] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:17 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:18.878284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cb01c050-4355-4c52-ba4e-1ecb8039bf57 req-ed6a37d1-a11d-42c3-b5a0-1cbcb976b08a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.880905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:18.883147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cb01c050-4355-4c52-ba4e-1ecb8039bf57 req-ed6a37d1-a11d-42c3-b5a0-1cbcb976b08a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.883829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:18.900740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.901528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.904044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.904732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.910894 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-cb01c050-4355-4c52-ba4e-1ecb8039bf57 req-ed6a37d1-a11d-42c3-b5a0-1cbcb976b08a service nova] Creating event network-vif-plugged:7f987878-99ad-40c2-b531-b8c74a1c3c64 for instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af on nch2-master-1 Apr 02 20:58:18.922570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-cb01c050-4355-4c52-ba4e-1ecb8039bf57 req-ed6a37d1-a11d-42c3-b5a0-1cbcb976b08a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069275 Apr 02 20:58:18.925809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1092/1941] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:18.937958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:18.939939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:18.953347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.958408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:18.959562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:18.960279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.135172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:19.145349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5fa8b45f-ba30-4f0d-9e93-74f60cb93495 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1272 microversion: 2.1 time: 0.217814 Apr 02 20:58:19.157851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1093/1942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:18 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1272 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:19.176389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:19.178690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:19.192388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.198398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.214070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.217828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.340523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:19.349846 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-baaf8c9d-b5b3-42a3-97fc-a3e31fc9c31d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1535 microversion: 2.1 time: 0.479827 Apr 02 20:58:19.354619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 850/1943] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:18 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1535 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:19.366387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:19.367314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:19.383717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.385756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.387851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.390946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.894185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:19.904532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:19.910490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:19.911673 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a045e1fe-2cc8-4e8d-9df9-2c9eecab8925 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 0.751931 Apr 02 20:58:19.912549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:19.913934 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1094/1944] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:19 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:19.922436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:19.923053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:19.931064 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d807009d-8666-4d8e-89c7-2312f26a5af4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.572491 Apr 02 20:58:19.933056 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 851/1945] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:19 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:19.943821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.944284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.945113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.945814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.949946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:19.953602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:19.967457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.968820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:19.972250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:19.974304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.267782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:20.287282 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7879605a-5ed4-47fe-a9cf-397509b66016 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.351581 Apr 02 20:58:20.288937 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 852/1946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:19 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:20.295611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:20.297419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:20.311642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.312480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.315659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.316720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.336538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:20.351839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ccee94f7-d8e1-4756-8ea6-1281447ab881 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.436388 Apr 02 20:58:20.353712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1095/1947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:19 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:20.379217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:20.380188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:20.391188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.391867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.393107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.393931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.663791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:20.671541 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be435343-d163-43b8-a6de-c018f41edc26 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.381102 Apr 02 20:58:20.681660 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 853/1948] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:20 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:20.864681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:20.872880 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-740a22d3-75b6-41fa-99b1-cb23e291199d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1528 microversion: 2.1 time: 0.505433 Apr 02 20:58:20.884198 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1096/1949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:20 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1528 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:20.893737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:20.894370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:20.904751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.905218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.909283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.909959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.930666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:20.931947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:20.952087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.952874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:20.953864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:20.957136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:21.355575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:21.369435 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f8f9cf6-5701-4c2c-96e9-5c46d6cb3748 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1528 microversion: 2.1 time: 0.480128 Apr 02 20:58:21.370566 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 854/1950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:20 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1528 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:21.378978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:21.383512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:21.395648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:21.396040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:21.397693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:21.398150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:21.506717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:21.529676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:21.549494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:21.551234 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-57b71fba-298c-4498-be61-792b4ddc1ed5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1361 microversion: 2.25 time: 0.624684 Apr 02 20:58:21.552056 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1097/1951] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:20 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1361 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:21.558091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:21.558952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:21.575390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:21.576121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:21.577174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:21.579448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:21.877106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:21.887489 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc6ec0ce-7857-497a-97fa-6a91e12aa79c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.513286 Apr 02 20:58:21.888409 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 855/1952] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:21 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:21.895062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:21.895705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:21.913634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:21.914099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:21.914914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:21.915368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:22.017970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:22.032549 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d8834ad-fdcc-4dde-a86f-4d1209935fd4 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.479020 Apr 02 20:58:22.034007 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1098/1953] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:21 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:22.043074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2baf1e83-869b-4c68-90b4-736a4d78d147 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:22.056474 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:58:22.056474 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:58:22.076426 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2baf1e83-869b-4c68-90b4-736a4d78d147 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] HTTP exception thrown: Flavor 8db7a0c6-f3d4-467b-8dd1-8c3146b98f54 could not be found. Apr 02 20:58:22.077350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2baf1e83-869b-4c68-90b4-736a4d78d147 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Returning 404 to user: Flavor 8db7a0c6-f3d4-467b-8dd1-8c3146b98f54 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:22.078231 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2baf1e83-869b-4c68-90b4-736a4d78d147 tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/8db7a0c6-f3d4-467b-8dd1-8c3146b98f54" status: 404 len: 109 microversion: 2.1 time: 0.041761 Apr 02 20:58:22.082081 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1099/1954] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:58:22 2022] DELETE /compute/v2.1/flavors/8db7a0c6-f3d4-467b-8dd1-8c3146b98f54 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:22.086561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-990336a0-e370-4531-b88a-64129e1f4803 req-4f3bfdcb-7308-409c-ba23-db8e52105690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd7e09f0-6c85-492e-8a65-b8eccd7e2776", "tag": "82489312-cd93-45ff-8630-0fecf70d05db"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:22.118059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-990336a0-e370-4531-b88a-64129e1f4803 req-4f3bfdcb-7308-409c-ba23-db8e52105690 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:22.119255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-990336a0-e370-4531-b88a-64129e1f4803 req-4f3bfdcb-7308-409c-ba23-db8e52105690 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:22.139505 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-990336a0-e370-4531-b88a-64129e1f4803 req-4f3bfdcb-7308-409c-ba23-db8e52105690 service nova] Creating event network-changed:82489312-cd93-45ff-8630-0fecf70d05db for instance fd7e09f0-6c85-492e-8a65-b8eccd7e2776 on nch1-master-1 Apr 02 20:58:22.148445 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-990336a0-e370-4531-b88a-64129e1f4803 req-4f3bfdcb-7308-409c-ba23-db8e52105690 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065695 Apr 02 20:58:22.149665 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1100/1955] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:22.159631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:22.164285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:22.175677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:22.177349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:22.179132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:22.183821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:22.373444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:22.384047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de32457a-490b-4687-b39c-70a7c09cd971 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.494526 Apr 02 20:58:22.384671 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 856/1956] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:21 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:22.393079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1617472163", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:22.478000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:58:22.574121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:22.586341 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29a62449-81c6-4416-8951-6b1dce0159a6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.435196 Apr 02 20:58:22.587846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1101/1957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:22 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:22.599055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a5be7473-35c8-433b-b4ec-fc0da0773a36 req-2f83a284-4f0b-41b1-892a-a7c64ca87544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88c5184-0805-4677-a11d-4077b9465e11", "name": "network-vif-plugged", "status": "completed", "tag": "f4087e3e-4f59-4105-bdf5-e1707ada38cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:22.617341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a5be7473-35c8-433b-b4ec-fc0da0773a36 req-2f83a284-4f0b-41b1-892a-a7c64ca87544 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:22.618144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a5be7473-35c8-433b-b4ec-fc0da0773a36 req-2f83a284-4f0b-41b1-892a-a7c64ca87544 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:22.634943 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a5be7473-35c8-433b-b4ec-fc0da0773a36 req-2f83a284-4f0b-41b1-892a-a7c64ca87544 service nova] Creating event network-vif-plugged:f4087e3e-4f59-4105-bdf5-e1707ada38cb for instance d88c5184-0805-4677-a11d-4077b9465e11 on nch2-master-1 Apr 02 20:58:22.645761 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a5be7473-35c8-433b-b4ec-fc0da0773a36 req-2f83a284-4f0b-41b1-892a-a7c64ca87544 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056399 Apr 02 20:58:22.647377 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1102/1958] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:22.663967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-500991073", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "754f7ab9-bcf9-43d7-b1a5-7e428bb23b29"}], "security_groups": [{"name": "tempest-securitygroup--2133239600"}], "key_name": "tempest-keypair-429665395", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:22.941465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] validate_networks() for [('754f7ab9-bcf9-43d7-b1a5-7e428bb23b29', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:58:22.981982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:22.982744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:22.983516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:22.984404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:22.985089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:22.998681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:22.999697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.000971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.002081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.041381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:23.049137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Getting quotas for user c1d982c5db7e47a6ae521f2137af3204 and project bf81401733804432b781dd367ab7bd82. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:23.074609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:23.078251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:23.156620 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17ed3355-4323-4f21-98d3-18fd74259b58 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767006 Apr 02 20:58:23.159335 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 857/1959] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:58:23.173885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:23.174614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:23.182012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.182575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.183451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.184001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.363583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:23.374652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:23.376303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:23.379159 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bac8df91-2c95-4221-809d-8ed5023c26e1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1557 microversion: 2.25 time: 0.218198 Apr 02 20:58:23.380567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 858/1960] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:23 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:23.387850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:23.388815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:23.417022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.417691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.418669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.419699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.629141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:23.638278 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67e17609-baa6-46ff-955f-98ea971d39af tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.256313 Apr 02 20:58:23.648478 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 859/1961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:23 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:23.648478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:23.661647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:23.675437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.676436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.677740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.678187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.853217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:23.862765 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ea5797f-71cf-43b9-b43d-e68b29eaf8e3 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.220134 Apr 02 20:58:23.865310 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 860/1962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:23 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:23.870150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:23.870965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:23.879050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.879681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.880694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:23.881301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:23.967963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:23.978160 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a12ea0e-10ff-4b15-b4d3-6c36ff7b1419 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1217 microversion: 2.1 time: 0.111351 Apr 02 20:58:23.978841 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 861/1963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:23 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:23.994565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:23.995527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.002511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.003029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.003908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.004553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.054471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:24.056250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:24.056923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:24.057531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:24.059127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:24.074861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.075682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.076926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.077624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.099370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for project da03d0fc36de405d87c8e99d209af9fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:24.105824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for user 449253ed73e04f47bcd09c3a1cca6e8c and project da03d0fc36de405d87c8e99d209af9fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:24.121207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:24.123905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:24.182640 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da961a1d-f508-4fbd-a9d8-dfcd0b4e6967 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.533547 Apr 02 20:58:24.188071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1103/1964] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:58:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:58:24.188447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.189297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.196848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.197311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.198103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.198869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.199646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid d8d2897f-4f31-4c6f-87ee-0279c8e9a3af {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:24.297145 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d697c82d-b410-4ccf-a0f9-d9ee32202147 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 2049 microversion: 2.25 time: 0.316977 Apr 02 20:58:24.298154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 862/1965] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:23 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 2049 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:24.315054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.318626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.326695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.327449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.328859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.329980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.410507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:24.421511 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-74c8e8de-c9ea-4ebd-aa30-48d005d4f9cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.235961 Apr 02 20:58:24.423098 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1104/1966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:24.430961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e74abc5-a323-4c4f-a68b-96e5115efc9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.431721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e74abc5-a323-4c4f-a68b-96e5115efc9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.516359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e74abc5-a323-4c4f-a68b-96e5115efc9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:24.530371 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e74abc5-a323-4c4f-a68b-96e5115efc9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1236 microversion: 2.1 time: 0.104727 Apr 02 20:58:24.534297 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1105/1967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1236 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:24.546197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.546889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.555982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.556942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.558017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.558684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.685142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:24.704634 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b947261-f056-4657-b1e1-3e42980c5493 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.401541 Apr 02 20:58:24.705779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 863/1968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:24.710789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.711411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.739523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.740279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.741359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.741968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.820813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid d8d2897f-4f31-4c6f-87ee-0279c8e9a3af {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:24.837925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d078a66-0e28-4cbf-b9cb-f12346f2fe8a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 2049 microversion: 2.25 time: 0.301449 Apr 02 20:58:24.838511 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1106/1969] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 2049 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:24.857884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a80946a-0a8a-4c20-a6b3-c1a258912f2a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.859694 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:58:24.859694 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 20:58:24.861360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a80946a-0a8a-4c20-a6b3-c1a258912f2a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.862144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a80946a-0a8a-4c20-a6b3-c1a258912f2a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.863040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a80946a-0a8a-4c20-a6b3-c1a258912f2a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.863460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a80946a-0a8a-4c20-a6b3-c1a258912f2a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.905803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a80946a-0a8a-4c20-a6b3-c1a258912f2a tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.053693 Apr 02 20:58:24.906371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1107/1970] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:58:24.919612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:24.921304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:24.930033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.930576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:24.931693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:24.932404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.070111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:25.080862 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0044aed8-38f7-4fd9-94d7-5351aab443ba tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.373404 Apr 02 20:58:25.091643 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 864/1971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:25.098627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:25.099655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:25.107161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.107747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.109044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.109636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.198377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2b3d12ef-5b5f-4b31-abce-81a9fe6403cb tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af/action" status: 202 len: 0 microversion: 2.25 time: 0.102829 Apr 02 20:58:25.201852 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 865/1972] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 20:58:25 2022] POST /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:58:25.212991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:25.215577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:25.227399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.229454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.233890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.234644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.251701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:25.266770 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16a6f88d-f8ba-49f3-a9a3-7c7c32b57ecb tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1516 microversion: 2.1 time: 0.352200 Apr 02 20:58:25.269561 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1108/1973] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:24 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:25.281879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:25.284021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:25.300910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.301695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.302740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.306733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.407040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:25.418429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c8ec4958-fae9-4222-a295-450b8e10a9ac tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1271 microversion: 2.1 time: 0.216199 Apr 02 20:58:25.420706 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 866/1974] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:25 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:25.440891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:25.441864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:25.452694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.453228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.457488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.458269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.707459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid d8d2897f-4f31-4c6f-87ee-0279c8e9a3af {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:25.748969 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a8789caa-ffc8-45a8-a0bb-32d20bb8b9df tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 2054 microversion: 2.25 time: 0.476933 Apr 02 20:58:25.749598 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1109/1975] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:25 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 2054 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:25.754594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:25.771456 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35257aaf-6bc3-4a5b-b92b-61f50e2fec6a tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.331888 Apr 02 20:58:25.776686 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 867/1976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:25 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:25.786927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-77c4a217-c0a7-4640-a984-878aa749060d req-41479b61-1cb1-4d42-93a8-0c3fd1c5bf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010647f-dc6e-4a5e-9767-100a054b5fda", "name": "network-vif-plugged", "status": "completed", "tag": "2c343cee-04a3-4dee-907f-0bea1da0e4d1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:25.793568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:25.797249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:25.800353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-77c4a217-c0a7-4640-a984-878aa749060d req-41479b61-1cb1-4d42-93a8-0c3fd1c5bf15 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.803146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-77c4a217-c0a7-4640-a984-878aa749060d req-41479b61-1cb1-4d42-93a8-0c3fd1c5bf15 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.808974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.809442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.810243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.810701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.822315 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-77c4a217-c0a7-4640-a984-878aa749060d req-41479b61-1cb1-4d42-93a8-0c3fd1c5bf15 service nova] Creating event network-vif-plugged:2c343cee-04a3-4dee-907f-0bea1da0e4d1 for instance a010647f-dc6e-4a5e-9767-100a054b5fda on nch2-master-1 Apr 02 20:58:25.831934 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-77c4a217-c0a7-4640-a984-878aa749060d req-41479b61-1cb1-4d42-93a8-0c3fd1c5bf15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059734 Apr 02 20:58:25.841976 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1110/1977] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:25.850629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:25.853521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:25.864969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.865427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.866860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:25.867737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:25.948966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:25.960562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efeb8c1d-c1d5-4aae-8125-b38a716401d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1288 microversion: 2.1 time: 0.182616 Apr 02 20:58:25.965586 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 868/1978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:25 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1288 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:26.099265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:26.099893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:26.120562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.121030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.130478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.130478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.315554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:26.329372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d62269ad-afda-4181-a94b-6b82339ed402 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.485032 Apr 02 20:58:26.332536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1111/1979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:25 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:26.337582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:26.338226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:26.360062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.360992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.369989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.371422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.509532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:26.519339 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fd8edb87-7d83-47ac-8ed9-59e25db88a1d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1307 microversion: 2.1 time: 0.425363 Apr 02 20:58:26.520855 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 869/1980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:26 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1307 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:26.525802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:26.526643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:26.538780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.539790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.540876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.541527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.716807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:26.728279 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e8bfbcda-a177-4e42-8d38-388a70629d02 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.390952 Apr 02 20:58:26.739070 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1112/1981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:26 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:26.748406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:26.749087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:26.759624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.760091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.762437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.763072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.849921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:26.860420 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6441be14-f397-42b7-8cab-0cfe59c7adca tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1313 microversion: 2.1 time: 0.338249 Apr 02 20:58:26.862033 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 870/1982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:26 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:26.875707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:26.879818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:26.893838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.901786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:26.903120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:26.903751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.036504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:27.052753 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d556d3d8-95f9-4a21-b800-46e4018c200f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.308533 Apr 02 20:58:27.063583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1113/1983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:26 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:27.079566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:27.084793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:27.093388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.094259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.096163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.096968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.198485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid d8d2897f-4f31-4c6f-87ee-0279c8e9a3af {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:27.217983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04df27bb-b0b2-465d-a404-14e499caf732 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 2034 microversion: 2.25 time: 0.345926 Apr 02 20:58:27.221746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 871/1984] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:26 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 2034 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:27.231480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:27.232365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:27.258897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.259451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.260323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.261020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.553756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:27.567282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a94defac-8e6a-438b-acf9-40ebe07bb582 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.501439 Apr 02 20:58:27.600186 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1114/1985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:27 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:27.607484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:27.612376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:27.637977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.638444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.639271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.648187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.764270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:27.797411 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb6e6da6-1500-45a3-b759-f6958c6f3465 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.571892 Apr 02 20:58:27.798588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 872/1986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:27 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:27.806983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:27.809353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:27.819706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.821460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.822440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:27.823260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:27.856475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'flavor' on Instance uuid d8d2897f-4f31-4c6f-87ee-0279c8e9a3af {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:27.876123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Going to try to live migrate instance to nch1-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:58:28.034641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:28.047527 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72eae2b8-0bbf-4830-8d24-e481ae33fbca tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.443098 Apr 02 20:58:28.048428 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1115/1987] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:27 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:28.056910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:28.061280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:28.082746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.083308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:28.084179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.084643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:28.381337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:28.391763 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ff84f30-8163-43bf-a9f7-cfe5180f24c7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.340681 Apr 02 20:58:28.394481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1116/1988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:28 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:28.399293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:28.399905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:28.421708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.422194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:28.423018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.423455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:28.756711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:28.768707 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-957aa691-57b5-45a9-ac51-a87010ef0ab7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1487 microversion: 2.1 time: 0.371941 Apr 02 20:58:28.769474 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1117/1989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:28 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1487 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:28.775283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f5dbf071-d2be-4f6f-b835-3d96d203e541 req-3f2d44d9-f2ad-471e-a004-dd6afa94ea2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "name": "network-vif-plugged", "status": "completed", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:28.784063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f5dbf071-d2be-4f6f-b835-3d96d203e541 req-3f2d44d9-f2ad-471e-a004-dd6afa94ea2c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.784601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f5dbf071-d2be-4f6f-b835-3d96d203e541 req-3f2d44d9-f2ad-471e-a004-dd6afa94ea2c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:28.797979 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f5dbf071-d2be-4f6f-b835-3d96d203e541 req-3f2d44d9-f2ad-471e-a004-dd6afa94ea2c service nova] Creating event network-vif-plugged:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:58:28.803406 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f5dbf071-d2be-4f6f-b835-3d96d203e541 req-3f2d44d9-f2ad-471e-a004-dd6afa94ea2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032427 Apr 02 20:58:28.805672 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1118/1990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:28.813480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:28.816522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:28.825039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.825768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:28.827150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:28.827750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:29.134478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:29.147081 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a14e58e4-3309-4a48-b1fc-d17a7b7ca347 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1313 microversion: 2.1 time: 0.339996 Apr 02 20:58:29.150996 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1119/1991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:28 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:29.156330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-069bf0d1-b8bc-43df-ac34-a4e5138c474b req-7f0c7b6d-d340-4006-9d2d-a573270fafe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:29.167090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-069bf0d1-b8bc-43df-ac34-a4e5138c474b req-7f0c7b6d-d340-4006-9d2d-a573270fafe7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:29.167721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-069bf0d1-b8bc-43df-ac34-a4e5138c474b req-7f0c7b6d-d340-4006-9d2d-a573270fafe7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:29.183349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-069bf0d1-b8bc-43df-ac34-a4e5138c474b req-7f0c7b6d-d340-4006-9d2d-a573270fafe7 service nova] Creating event network-changed:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch2-master-1 Apr 02 20:58:29.195545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-069bf0d1-b8bc-43df-ac34-a4e5138c474b req-7f0c7b6d-d340-4006-9d2d-a573270fafe7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042851 Apr 02 20:58:29.200076 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1120/1992] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:29.215902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ce25b55-d834-4f58-9c7d-33eb7a7fe713 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:29.238755 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0ce25b55-d834-4f58-9c7d-33eb7a7fe713 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 3a4696bb-e813-4fcd-af65-bbc372cac8c5 has no mapping to a cell. Apr 02 20:58:29.239373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ce25b55-d834-4f58-9c7d-33eb7a7fe713 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 3a4696bb-e813-4fcd-af65-bbc372cac8c5 has no mapping to a cell. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:29.240618 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ce25b55-d834-4f58-9c7d-33eb7a7fe713 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/3a4696bb-e813-4fcd-af65-bbc372cac8c5/action" status: 404 len: 117 microversion: 2.1 time: 0.039311 Apr 02 20:58:29.244893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1121/1993] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:29 2022] POST /compute/v2.1/servers/3a4696bb-e813-4fcd-af65-bbc372cac8c5/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:29.250961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:29.252498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:29.260012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:29.260809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:29.261762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:29.262373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:29.588693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:29.597234 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b35e6b95-6d43-488f-ac26-409f6729b2a4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1323 microversion: 2.1 time: 0.350355 Apr 02 20:58:29.610255 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1122/1994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:29 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:29.616361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-813361b3-390d-473f-8d1c-d49df481b990 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:29.624437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813361b3-390d-473f-8d1c-d49df481b990 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:29.625317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-813361b3-390d-473f-8d1c-d49df481b990 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:29.749705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-813361b3-390d-473f-8d1c-d49df481b990 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Going to try to stop instance {{(pid=136518) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 20:58:29.828188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-813361b3-390d-473f-8d1c-d49df481b990 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda/action" status: 202 len: 0 microversion: 2.1 time: 0.215977 Apr 02 20:58:29.830865 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1123/1995] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:29 2022] POST /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:29.836631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:29.837345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:29.849595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:29.850112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:29.850926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:29.851419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.469040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:30.476952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9d6f612-d11b-4dff-b9ae-a801eb17b367 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.644872 Apr 02 20:58:30.477532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1124/1996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:29 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:30.483224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ef280b41-9ce4-4b73-961f-79a5f55e4deb req-8f1a9478-4273-4b27-8290-8ce11e6b0684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259abe5f-f848-4966-b186-a747835eab18", "tag": "f2ea41d2-5537-49e4-98d6-de0eedf3bff6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:30.492285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ef280b41-9ce4-4b73-961f-79a5f55e4deb req-8f1a9478-4273-4b27-8290-8ce11e6b0684 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.493008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ef280b41-9ce4-4b73-961f-79a5f55e4deb req-8f1a9478-4273-4b27-8290-8ce11e6b0684 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.507111 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ef280b41-9ce4-4b73-961f-79a5f55e4deb req-8f1a9478-4273-4b27-8290-8ce11e6b0684 service nova] Creating event network-changed:f2ea41d2-5537-49e4-98d6-de0eedf3bff6 for instance 259abe5f-f848-4966-b186-a747835eab18 on nch1-master-1 Apr 02 20:58:30.512248 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ef280b41-9ce4-4b73-961f-79a5f55e4deb req-8f1a9478-4273-4b27-8290-8ce11e6b0684 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 Apr 02 20:58:30.513006 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1125/1997] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:30.519062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:30.519921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:30.527940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.528395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.529197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.529638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.725586 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7b4e6b6-4e6f-47c1-a2ba-716b0ffb4910 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af/action" status: 202 len: 0 microversion: 2.25 time: 2.925350 Apr 02 20:58:30.726224 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 873/1998] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 20:58:27 2022] POST /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af/action => generated 0 bytes in 2927 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:58:30.731118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:30.731950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:30.739709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.740489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.741611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.742071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.807483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:30.822737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad7a348d-42da-4a34-b52e-b6f412fc4e55 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.308424 Apr 02 20:58:30.825277 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1126/1999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:30 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:30.834022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:30.834599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:30.848674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.849169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.849967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:30.851183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:30.991519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.000013 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c9adbeb-8ede-49a9-9268-e7ef010855a5 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.272505 Apr 02 20:58:31.009940 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 874/2000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:30 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:31.009940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:31.009940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.023762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.024226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.025196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.025662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.098448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.113700 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2bf1bd6a-7bba-4232-aaea-a7d5f7bf5fce tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.283953 Apr 02 20:58:31.114586 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1127/2001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:30 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:31.123984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:31.127058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.134882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.135626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.136636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.137932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.325910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.336853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-77223736-4167-4650-8869-957174d60ee9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1313 microversion: 2.1 time: 0.333116 Apr 02 20:58:31.338064 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 875/2002] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:31 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:31.344366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:31.345303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.359556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.360939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.362476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.365735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.470169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.479820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7cdeabb-e602-4fb1-824f-5b277aee6a9b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1519 microversion: 2.1 time: 0.363952 Apr 02 20:58:31.485057 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1128/2003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:31 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:31.492241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b33c414b-b90c-4ed7-9f29-584339d660f6 req-8c7d1857-fa67-49cf-8364-0d0620154937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "name": "network-vif-plugged", "status": "completed", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}, {"server_uuid": "fd7e09f0-6c85-492e-8a65-b8eccd7e2776", "name": "network-vif-plugged", "status": "completed", "tag": "82489312-cd93-45ff-8630-0fecf70d05db"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:31.529369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b33c414b-b90c-4ed7-9f29-584339d660f6 req-8c7d1857-fa67-49cf-8364-0d0620154937 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.530264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b33c414b-b90c-4ed7-9f29-584339d660f6 req-8c7d1857-fa67-49cf-8364-0d0620154937 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.553803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b33c414b-b90c-4ed7-9f29-584339d660f6 req-8c7d1857-fa67-49cf-8364-0d0620154937 service nova] Creating event network-vif-plugged:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 20:58:31.554310 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b33c414b-b90c-4ed7-9f29-584339d660f6 req-8c7d1857-fa67-49cf-8364-0d0620154937 service nova] Creating event network-vif-plugged:82489312-cd93-45ff-8630-0fecf70d05db for instance fd7e09f0-6c85-492e-8a65-b8eccd7e2776 on nch1-master-1 Apr 02 20:58:31.562631 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b33c414b-b90c-4ed7-9f29-584339d660f6 req-8c7d1857-fa67-49cf-8364-0d0620154937 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076021 Apr 02 20:58:31.563668 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1129/2004] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:31.571322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:31.572057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.579588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.580820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.581768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.582412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.700138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.708745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.710343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.711647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-070c243f-4ec6-4ffe-b19f-cc803d8f3f21 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.372359 Apr 02 20:58:31.722465 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 876/2005] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:31 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:31.722465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:31.722465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.727930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.728596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.729213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.729937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:31.828965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.846179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f05847aa-f8d0-455b-803f-7b89e0699872 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.280338 Apr 02 20:58:31.846851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1130/2006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:31 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:31.857929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-972bd60c-a587-423c-a770-ee16223954e2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'create', calling method: .version_select at 0x7f54d4569940>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:31.951322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:31.960718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-125e6008-33a6-4d95-9d36-905ff436aff8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.243007 Apr 02 20:58:31.961690 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 877/2007] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:31 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:31.967522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9382a38f-7145-441a-a625-1a86be639842 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:31.968311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9382a38f-7145-441a-a625-1a86be639842 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 6471f103-3ffd-420d-870f-34471368d97b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.975901 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-9382a38f-7145-441a-a625-1a86be639842 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 6471f103-3ffd-420d-870f-34471368d97b could not be found. Apr 02 20:58:31.976568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9382a38f-7145-441a-a625-1a86be639842 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 6471f103-3ffd-420d-870f-34471368d97b could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:31.979766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9382a38f-7145-441a-a625-1a86be639842 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/6471f103-3ffd-420d-870f-34471368d97b/action" status: 404 len: 111 microversion: 2.1 time: 0.016518 Apr 02 20:58:31.984085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 878/2008] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:31 2022] POST /compute/v2.1/servers/6471f103-3ffd-420d-870f-34471368d97b/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:31.989636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:31.990248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:31.998275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:31.999037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.000154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.000663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.162618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:32.171355 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93a6d2eb-c615-4faf-a30e-40c56aa86604 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.185884 Apr 02 20:58:32.172069 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 879/2009] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:31 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:32.177314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:32.178204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:32.187736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.188287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.189182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.190286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.432825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:32.443400 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-566e7d73-498b-40ba-99a4-f11b00b0f845 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1314 microversion: 2.1 time: 0.270004 Apr 02 20:58:32.454256 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 880/2010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:32 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:32.460630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:32.461771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:32.472588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.473307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.475113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.476220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.757735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:32.765638 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b21ad374-7a14-4b07-8902-27ed5d10987b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.309868 Apr 02 20:58:32.766227 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 881/2011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:32 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:32.772379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:32.773130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:32.779421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.780033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:32.780970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:32.781730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.030726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.039645 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acc291e8-e2e3-4b63-9411-d07812488f25 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.272245 Apr 02 20:58:33.050475 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-972bd60c-a587-423c-a770-ee16223954e2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.202633 Apr 02 20:58:33.051253 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 882/2012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:32 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:33.052206 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1131/2013] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 20:58:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:33.056118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:33.056845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9c1bb550-e5aa-4f7b-98b9-7d218077c7d8 req-52842a09-739b-43bd-ab66-97b049754079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d2897f-4f31-4c6f-87ee-0279c8e9a3af", "name": "network-vif-unplugged", "status": "completed", "tag": "7f987878-99ad-40c2-b531-b8c74a1c3c64"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:33.056979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:33.062978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.063704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.065036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.065488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.066401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9c1bb550-e5aa-4f7b-98b9-7d218077c7d8 req-52842a09-739b-43bd-ab66-97b049754079 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.066401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9c1bb550-e5aa-4f7b-98b9-7d218077c7d8 req-52842a09-739b-43bd-ab66-97b049754079 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.080523 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9c1bb550-e5aa-4f7b-98b9-7d218077c7d8 req-52842a09-739b-43bd-ab66-97b049754079 service nova] Creating event network-vif-unplugged:7f987878-99ad-40c2-b531-b8c74a1c3c64 for instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af on nch2-master-1 Apr 02 20:58:33.086160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9c1bb550-e5aa-4f7b-98b9-7d218077c7d8 req-52842a09-739b-43bd-ab66-97b049754079 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032798 Apr 02 20:58:33.087067 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1132/2014] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:33.094923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:33.095988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:33.104793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.105760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.106777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.107446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.226705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.239730 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47e7f52c-33ed-47b9-ba55-518ef4f139e6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1313 microversion: 2.1 time: 0.186918 Apr 02 20:58:33.250601 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 883/2015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:33 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:33.250601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:33.250601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:33.271772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.272563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.273523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.274149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.292250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.304354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.310592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.311904 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-37081615-d289-4d0f-be91-403814a81c7d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.222862 Apr 02 20:58:33.312696 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1133/2016] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:33 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:33.325358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:33.326509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:33.340486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.341217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.342240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.342919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.371098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lazy-loading 'flavor' on Instance uuid d88c5184-0805-4677-a11d-4077b9465e11 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:33.469883 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-deae8438-66f2-4f92-b6d5-15c1af2fa645 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 202 len: 0 microversion: 2.1 time: 0.156095 Apr 02 20:58:33.470806 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1134/2017] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:33 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:33.481329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.490622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-636440460", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "58fa3672-fa03-4f54-a24a-d36533b2e021"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:33.492091 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-935e1fc0-e9c6-483c-92ee-9a00842be82b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.249214 Apr 02 20:58:33.492871 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 884/2018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:33 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:33.502414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:33.502414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:33.508146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.508824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.509874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.510662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.564046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] validate_networks() for [('58fa3672-fa03-4f54-a24a-d36533b2e021', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:58:33.668220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.676430 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-221b8b03-3c90-4ae2-ab81-c6cb71ad0015 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1462 microversion: 2.1 time: 0.181911 Apr 02 20:58:33.676995 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 885/2019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:33 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1462 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:33.682506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:33.683112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:33.691946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.692396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.693203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.693706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.833531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:33.841421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a07d3bc9-b622-44c0-849a-0e21dd1ef7d0 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1511 microversion: 2.1 time: 0.163424 Apr 02 20:58:33.848535 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 886/2020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:33 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:33.848535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a405edd8-9284-4983-910e-d864dc4596e6 req-5ecd6c48-a545-4a4d-8710-0e6c35527932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "name": "network-vif-plugged", "status": "completed", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:33.858515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a405edd8-9284-4983-910e-d864dc4596e6 req-5ecd6c48-a545-4a4d-8710-0e6c35527932 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.858972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a405edd8-9284-4983-910e-d864dc4596e6 req-5ecd6c48-a545-4a4d-8710-0e6c35527932 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.870848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a405edd8-9284-4983-910e-d864dc4596e6 req-5ecd6c48-a545-4a4d-8710-0e6c35527932 service nova] Creating event network-vif-plugged:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch2-master-1 Apr 02 20:58:33.875866 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a405edd8-9284-4983-910e-d864dc4596e6 req-5ecd6c48-a545-4a4d-8710-0e6c35527932 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032002 Apr 02 20:58:33.876764 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 887/2021] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:33.982738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:33.983417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:33.984047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:33.984704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:33.985286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:33.998387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:33.998940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:33.999881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.000333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.055710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Getting quotas for project d0e22715a8e849e0871b68d772ed29fd. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:34.067600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.075816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Getting quotas for user 821ac6c697bc4706ad36b8be4e9276a5 and project d0e22715a8e849e0871b68d772ed29fd. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:34.076253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'deleted': False, 'project_id': '8ea0483355034dd9a9fadf514384a916'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:34.084441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.085899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.088586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.089714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.111005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:34.114039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:34.180099 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a45d045-8288-47ec-bfa4-4310323c7e45 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707510 Apr 02 20:58:34.185956 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1135/2022] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:58:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:58:34.193376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.194225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:34.202878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.203874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.215045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.215996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.224870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9755d8e4-29a3-4ccf-8333-c0990e772a84 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.340853 Apr 02 20:58:34.235361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 888/2023] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 20:58:33 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:58:34.246471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae6dc4b9-bab5-4ad3-9ca5-79a876965d65 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.247389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae6dc4b9-bab5-4ad3-9ca5-79a876965d65 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:34.322933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ae6dc4b9-bab5-4ad3-9ca5-79a876965d65 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:34.333851 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae6dc4b9-bab5-4ad3-9ca5-79a876965d65 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1223 microversion: 2.1 time: 0.094637 Apr 02 20:58:34.335336 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 889/2024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:34 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:34.340085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.346533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'deleted': False} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:34.357627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.358155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.359141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.359753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.493300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:34.505032 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2a81899-e1b0-4bd0-9baf-715d85080598 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.317623 Apr 02 20:58:34.505882 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1136/2025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:34 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:34.510916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Listed batch of 13 results from cell out of 999 limit. Returned 13 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:58:34.512258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.513151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:34.522398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.523850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.525304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.525876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.611296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.611857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.722125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:34.731379 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-55929dfb-db6a-4eb5-a8af-4049385975f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1313 microversion: 2.1 time: 0.224152 Apr 02 20:58:34.732438 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1137/2026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:34 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:34.738376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.739243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:34.746614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.747072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.747849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.748290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.921457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:34.938895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:34.944738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:34.949606 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a93e244-488d-45b2-afbb-b73558d633c3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.215466 Apr 02 20:58:34.957157 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1138/2027] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:34 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:34.965089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:34.967021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:34.981655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.982463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:34.983509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:34.984224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.056908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84c94a3a-86fb-40db-a007-626c9b0f33dd tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22245 microversion: 2.1 time: 0.720327 Apr 02 20:58:35.057538 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 890/2028] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Apr 2 20:58:34 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22245 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:58:35.062378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.063557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.070555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.071019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.071794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.072427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.166934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:35.175808 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-861ce7cc-c1d6-4317-88d2-8eafadaad206 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.216807 Apr 02 20:58:35.176625 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1139/2029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:34 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:35.181108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.184845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'deleted': False, 'project_id': '8ea0483355034dd9a9fadf514384a916'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:35.191809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.192552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.193291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.193740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.224936 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c467683-2fa5-45dc-8b88-9f02e90fb2cb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?tenant_id=d84de315abb1452fa5187770db66041e" status: 200 len: 15 microversion: 2.1 time: 0.047018 Apr 02 20:58:35.225510 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1140/2030] 10.222.0.18 () {58 vars in 1230 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/detail?tenant_id=d84de315abb1452fa5187770db66041e => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:58:35.236620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-45ad1223-9477-4694-9f4a-5f3135974d4e req-ed4f4160-8614-4d98-9f65-ea6236dc3c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d2897f-4f31-4c6f-87ee-0279c8e9a3af", "tag": "7f987878-99ad-40c2-b531-b8c74a1c3c64"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:35.245331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-45ad1223-9477-4694-9f4a-5f3135974d4e req-ed4f4160-8614-4d98-9f65-ea6236dc3c30 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.245786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-45ad1223-9477-4694-9f4a-5f3135974d4e req-ed4f4160-8614-4d98-9f65-ea6236dc3c30 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.260661 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-45ad1223-9477-4694-9f4a-5f3135974d4e req-ed4f4160-8614-4d98-9f65-ea6236dc3c30 service nova] Creating event network-changed:7f987878-99ad-40c2-b531-b8c74a1c3c64 for instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af on nch2-master-1 Apr 02 20:58:35.266626 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-45ad1223-9477-4694-9f4a-5f3135974d4e req-ed4f4160-8614-4d98-9f65-ea6236dc3c30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039928 Apr 02 20:58:35.267609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1141/2031] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:35.273819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.277126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:35.279542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'tenant_id': 'd84de315abb1452fa5187770db66041e', 'deleted': False} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:35.285622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.286084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.287212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.287554 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de9d8bf5-d08f-44f6-8fbf-3a921d99e203 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1494 microversion: 2.1 time: 0.228415 Apr 02 20:58:35.287848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.288980 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 891/2032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1494 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:35.305249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:35.305981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.315347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.316072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.317147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.318081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.324378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:58:35.351650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lazy-loading 'flavor' on Instance uuid d88c5184-0805-4677-a11d-4077b9465e11 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:35.368162 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'suspend' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state suspended Apr 02 20:58:35.369177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'suspend' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state suspended {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:35.370647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-234968f0-ac59-4436-8efb-61472a8469aa tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 148 microversion: 2.1 time: 0.069504 Apr 02 20:58:35.371364 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 892/2033] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:35 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 148 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:58:35.376859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.377762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.386055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.387080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.387298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.387751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.389597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.390758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.525915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:35.540712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a8e688bb-05dc-4470-a62c-dcc4fbc0f3f0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1275 microversion: 2.1 time: 0.167968 Apr 02 20:58:35.556230 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 893/2034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:35.562002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:35.562548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.569080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.569478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.570527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.570973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.626354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-65c57530-832d-4653-8077-c611dc955dfc tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d84de315abb1452fa5187770db66041e" status: 200 len: 4824 microversion: 2.1 time: 0.356857 Apr 02 20:58:35.627176 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1142/2035] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=d84de315abb1452fa5187770db66041e => generated 4824 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:35.632047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.632891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.648599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.649067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.649859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.651013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.692841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac911ffb-1b7a-4236-a74c-f176786247e7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 202 len: 0 microversion: 2.1 time: 0.134656 Apr 02 20:58:35.700243 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 894/2036] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:35 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:35.717083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.724336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'tenant_id': '8ea0483355034dd9a9fadf514384a916', 'deleted': False} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:35.730380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.730847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.731630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.732067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.764697 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72f2d5a7-9aad-4968-a5fc-20e7f52d487b tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8ea0483355034dd9a9fadf514384a916" status: 200 len: 15 microversion: 2.1 time: 0.062951 Apr 02 20:58:35.766099 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 895/2037] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8ea0483355034dd9a9fadf514384a916 => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:58:35.771497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.772447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.780121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.780947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.781927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.783905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.818026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:35.827057 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f548c2b8-2eb9-4450-b984-1a31e968a503 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.198461 Apr 02 20:58:35.827837 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1143/2038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:35.839867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:35.840519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:35.847090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.847550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:35.848332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:35.848858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.070047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.081891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df518499-020f-4cab-a2e6-37fed6872849 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1462 microversion: 2.1 time: 0.244396 Apr 02 20:58:36.094745 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1144/2039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1462 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:36.100858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2ee03e0-cd7c-4f3e-90bc-7c336fdfc747 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:36.110224 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2ee03e0-cd7c-4f3e-90bc-7c336fdfc747 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.013469 Apr 02 20:58:36.111523 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1145/2040] 10.222.0.18 () {58 vars in 1188 bytes} [Sat Apr 2 20:58:36 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:58:36.122553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.128687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:36.129645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:36.136549 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74da1743-ae2d-4e0c-8392-47ba4584b359 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1500 microversion: 2.1 time: 0.369173 Apr 02 20:58:36.137256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.137504 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 896/2041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:35 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1500 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:36.138289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.139345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.140037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.142233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:36.143414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:36.151913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.152671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.153657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.154269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.384812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.394657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.397322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.399238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09b99bec-1eab-458a-b1da-a9c1f9307025 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.286393 Apr 02 20:58:36.400336 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1146/2042] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:36 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:36.408146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:36.409413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:36.419094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.420209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.422254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.423014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.428904 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8793249f-f647-4e91-a78f-c95c0d1c58dd tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1613 microversion: 2.1 time: 0.288722 Apr 02 20:58:36.441350 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 897/2043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:36 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1613 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:36.447393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:36.448965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:36.456738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.458151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.460403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.460951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.534689 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a4d2add-75b7-4964-9ef5-50bdb10a7f65 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 0 microversion: 2.1 time: 0.132804 Apr 02 20:58:36.535348 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1147/2044] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:36 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:36.541175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:36.541743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:36.547379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.547838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.549173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.549612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.633417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '730601c0fd034bc481ccef6fc607dac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de86ae49fbdc45948aabfd4a403e326c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.634085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] flavor_id is None. Assuming migration. {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 02 20:58:36.634592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 20:58:36.674346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.690193 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04812358-b217-42bb-85f8-67291e4c2c2c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.246360 Apr 02 20:58:36.712784 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 898/2045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:36 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:36.726365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:36.734937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:36.737123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'd84de315abb1452fa5187770db66041e'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:36.747348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.752564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.753651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:36.754111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:36.997289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:58:37.090741 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d6134f22-33b2-4ab8-9feb-5d3f06a4bf9d tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7/action" status: 202 len: 0 microversion: 2.1 time: 0.553962 Apr 02 20:58:37.092348 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1148/2046] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:36 2022] POST /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:37.098765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:37.099454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.117438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.118136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.123547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.127754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.160079 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee4e6555-7c08-4b14-be38-b1e595d13861 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.445277 Apr 02 20:58:37.160708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 899/2047] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Apr 2 20:58:36 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:37.165608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:37.166408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.174227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.174946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.182946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.183657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.354277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:37.363995 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b376660d-fb53-4c5f-ba22-beebcad18b9c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.270282 Apr 02 20:58:37.364871 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1149/2048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:37 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:37.369952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:37.370742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.378421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.379062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.380021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.380651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.605919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:37.615628 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a4c62bc-2049-44fe-a389-28d17dc32f5c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.249122 Apr 02 20:58:37.617208 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1150/2049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:37 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:37.623354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:37.624863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.627541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:37.632400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.633108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.634406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.635021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.643524 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b562e4b-7fad-46b6-9c2b-aaa7ba735a2e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.481264 Apr 02 20:58:37.644405 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 900/2050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:37 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:37.667338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:37.668891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.678260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.678972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.679973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.680610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.795270 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4802984-f34f-496e-8e78-a2b49d7a64b1 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 0 microversion: 2.1 time: 0.136187 Apr 02 20:58:37.798661 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 901/2051] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:37 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:37.803876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:37.804483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.811265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.811717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.812719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.813005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.834914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:37.843891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4af2df76-cb17-443e-9aaf-1fd353c8c453 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.224730 Apr 02 20:58:37.848853 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1151/2052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:37 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:37.856036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:37.857620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:37.864370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.865145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:37.866001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:37.866849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.075947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:38.114322 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7c2135f0-af63-4808-9103-1c42d1795425 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.263542 Apr 02 20:58:38.125837 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1152/2053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:37 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:38.138818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:38.147914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:38.152957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.153861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:38.159394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:38.160675 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6550df5b-6d94-4d11-b704-da7dc02dce4a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.360953 Apr 02 20:58:38.161239 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 902/2054] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:37 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:38.181710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.182536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.187600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.191105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.196666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:38.198154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.215025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.216831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.220033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.221012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.518683 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f7885282-2dd4-43ca-af16-4a17279af43c tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1614 microversion: 2.1 time: 0.389838 Apr 02 20:58:38.519771 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1153/2055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:38 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1614 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:38.526700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-88fa0b8d-d8c6-47b6-b2a8-8e866e3d07ea req-715e804d-8cda-4dc4-aa94-81ee3bfc39e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bb27b3-1a40-487e-af80-567547b3347a", "tag": "4883e687-c354-4cf9-9d83-3e9daec8775f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:38.536091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:38.539296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-88fa0b8d-d8c6-47b6-b2a8-8e866e3d07ea req-715e804d-8cda-4dc4-aa94-81ee3bfc39e3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.540000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-88fa0b8d-d8c6-47b6-b2a8-8e866e3d07ea req-715e804d-8cda-4dc4-aa94-81ee3bfc39e3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.544084 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7716e267-e40e-4853-8fd0-7f881dd5621f tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.357917 Apr 02 20:58:38.544701 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 903/2056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:38 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:38.557521 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-88fa0b8d-d8c6-47b6-b2a8-8e866e3d07ea req-715e804d-8cda-4dc4-aa94-81ee3bfc39e3 service nova] Creating event network-changed:4883e687-c354-4cf9-9d83-3e9daec8775f for instance f1bb27b3-1a40-487e-af80-567547b3347a on nch1-master-1 Apr 02 20:58:38.558733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-555896b1-7439-4388-8a89-7b6582ef2db8 req-63e28a4f-d4a6-4526-9be7-61ef7b4e83d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259abe5f-f848-4966-b186-a747835eab18", "name": "network-vif-plugged", "status": "completed", "tag": "f2ea41d2-5537-49e4-98d6-de0eedf3bff6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:38.563027 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-88fa0b8d-d8c6-47b6-b2a8-8e866e3d07ea req-715e804d-8cda-4dc4-aa94-81ee3bfc39e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041520 Apr 02 20:58:38.564162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1154/2057] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:38.568080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-555896b1-7439-4388-8a89-7b6582ef2db8 req-63e28a4f-d4a6-4526-9be7-61ef7b4e83d0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.568682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-555896b1-7439-4388-8a89-7b6582ef2db8 req-63e28a4f-d4a6-4526-9be7-61ef7b4e83d0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.572094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:38.573153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.582422 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-555896b1-7439-4388-8a89-7b6582ef2db8 req-63e28a4f-d4a6-4526-9be7-61ef7b4e83d0 service nova] Creating event network-vif-plugged:f2ea41d2-5537-49e4-98d6-de0eedf3bff6 for instance 259abe5f-f848-4966-b186-a747835eab18 on nch1-master-1 Apr 02 20:58:38.588671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-555896b1-7439-4388-8a89-7b6582ef2db8 req-63e28a4f-d4a6-4526-9be7-61ef7b4e83d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Apr 02 20:58:38.594061 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 904/2058] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:38.594492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.597098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.598228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.598889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.602834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:38.605094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.618444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.619158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.620179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.620863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.883316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:38.893449 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d71cbf39-8b9b-498c-ac5d-d35a3729cab8 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.327116 Apr 02 20:58:38.894175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1155/2059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:38 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:38.899782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e964daf9-1824-4c37-93bc-972b6ed5bc0d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:38.901058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e964daf9-1824-4c37-93bc-972b6ed5bc0d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 8c2ef380-dc88-4efb-bf9a-3cff83367be9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.910480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e964daf9-1824-4c37-93bc-972b6ed5bc0d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 8c2ef380-dc88-4efb-bf9a-3cff83367be9 could not be found. Apr 02 20:58:38.910958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e964daf9-1824-4c37-93bc-972b6ed5bc0d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 8c2ef380-dc88-4efb-bf9a-3cff83367be9 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:38.911810 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e964daf9-1824-4c37-93bc-972b6ed5bc0d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/8c2ef380-dc88-4efb-bf9a-3cff83367be9/action" status: 404 len: 111 microversion: 2.1 time: 0.015949 Apr 02 20:58:38.912587 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1156/2060] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:38 2022] POST /compute/v2.1/servers/8c2ef380-dc88-4efb-bf9a-3cff83367be9/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:38.917360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:38.917977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.924853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.925665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.926095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.926624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.940478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2720790d-19a2-4199-8d3f-0b2d5fe39f5f tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1614 microversion: 2.1 time: 0.344576 Apr 02 20:58:38.941120 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 905/2061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:38 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1614 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:38.948297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:38.948814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:38.957369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.957946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:38.958747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:38.959193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.079342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.087957 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee8c032b-114e-46e5-b47b-1dc35788fffd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.174139 Apr 02 20:58:39.088776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1157/2062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:38 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:39.093531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.094337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.101307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.107536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.108058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.109007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.109435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.111519 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ced6cfc-8a02-4c95-b9de-11d9b2b707c4 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.169389 Apr 02 20:58:39.112118 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 906/2063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:38 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:39.116350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.121310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:39.125923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.126374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.127735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.128177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.220261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 20:58:39.248520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.256586 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df4ed385-545c-4e26-90f4-8aec4e4e82b2 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.166673 Apr 02 20:58:39.257159 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1158/2064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:39.261672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.262298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.270649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.271119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.271913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.272362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.280517 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2715f597-a4d1-4aee-bf83-9e081f21d072 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2308 microversion: 2.1 time: 0.167322 Apr 02 20:58:39.281302 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 907/2065] 10.222.0.18 () {58 vars in 1189 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:39.285712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.286308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.292005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.292477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.293254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.293694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.416352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.423620 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c793c79-c963-4d6b-b7b6-3c53709999d1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.165488 Apr 02 20:58:39.424560 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1159/2066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:39.429644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.430260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.436625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.437084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.437882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.438311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.447701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.457995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.459536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.460766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ba3eb1a-2c8f-4ff7-be56-9e9062857286 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.178693 Apr 02 20:58:39.461512 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 908/2067] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:39.468691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.470771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 20:58:39.475754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.476217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.477084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.477529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.497817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a744d472-917e-4bad-858a-0d502781fb23 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.035250 Apr 02 20:58:39.498417 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 909/2068] 10.222.0.18 () {58 vars in 1195 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 20:58:39.509133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:39.510103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.515978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.516439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.517862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.518252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.577008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.584982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35df00ec-5ed8-4ec7-bf47-1b07b42a7dfd tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.159238 Apr 02 20:58:39.585557 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1160/2069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:39.589269 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55a03101-8dfb-4b23-9332-2e34b403b4fb tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 0 microversion: 2.1 time: 0.083698 Apr 02 20:58:39.590083 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 910/2070] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:39 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:58:39.602855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:39.603167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:39.603716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.604993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.610111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.610550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.611664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.611968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.612294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.612408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.613237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.613757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.635218 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'unpause' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active Apr 02 20:58:39.635815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'unpause' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:39.636686 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73f4c012-ba10-4967-9e74-a5a5e9d53b85 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 145 microversion: 2.1 time: 0.038948 Apr 02 20:58:39.637235 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1161/2071] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:39 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 145 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:58:39.645215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.646320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.651622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.652076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.652884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.653322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.691158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:39.691581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:39.692060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:39.692490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:39.692901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:39.752195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.758660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.759120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.759909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.760359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.793417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d99d2177-0b0f-473b-be10-324e5da3f950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 1067 microversion: 2.1 time: 0.194471 Apr 02 20:58:39.794061 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 911/2072] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:39 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 1067 bytes in 197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 02 20:58:39.813004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.813626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.832291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:39.834055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.834523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.835316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.837277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.842194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-975130eb-3c84-4b2e-a02e-7ea462a0ef38 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.200522 Apr 02 20:58:39.855986 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1162/2073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:39.862687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:39.863568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:39.878389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.878914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:39.879767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:39.880216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.030700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.042019 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b751a7ea-487d-4136-8794-35318ed58c09 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.235287 Apr 02 20:58:40.042951 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 912/2074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:40.047818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:40.049328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.058470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.059140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.060142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.060825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.147664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.156001 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f712eb4d-f1a7-4555-81c8-2586b38723ce tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.298351 Apr 02 20:58:40.156722 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1163/2075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:39 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:40.162629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:40.163877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.171699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.172631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.174796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.175422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.411340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.424554 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-932ad370-3ee8-4a3f-a17c-28a543540267 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.266583 Apr 02 20:58:40.425566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1164/2076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:40 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:40.432479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:40.433452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.446448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.447493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.449220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.450044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.534254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.542190 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b4c913d-0930-42e4-9438-cdda35eabf0c tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.498245 Apr 02 20:58:40.542783 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 913/2077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:40 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:40.551878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8a664b6a-46aa-435f-a430-af87b2eda5cf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:40.551878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8a664b6a-46aa-435f-a430-af87b2eda5cf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 63f72f03-762b-4897-9276-f64a1dd2546b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.553817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8a664b6a-46aa-435f-a430-af87b2eda5cf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 63f72f03-762b-4897-9276-f64a1dd2546b could not be found. Apr 02 20:58:40.554450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8a664b6a-46aa-435f-a430-af87b2eda5cf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 63f72f03-762b-4897-9276-f64a1dd2546b could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:40.555298 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8a664b6a-46aa-435f-a430-af87b2eda5cf tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/63f72f03-762b-4897-9276-f64a1dd2546b/action" status: 404 len: 111 microversion: 2.1 time: 0.011584 Apr 02 20:58:40.555875 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 914/2078] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:40 2022] POST /compute/v2.1/servers/63f72f03-762b-4897-9276-f64a1dd2546b/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:40.560651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:40.561271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.568856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.569312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.570093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.570790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.708073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.715561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02bf9805-a4fa-4053-aff6-9bb1ed52697c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.158474 Apr 02 20:58:40.716134 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 915/2079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:40 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:40.720952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:40.721565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.727704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.728156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.728972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.729407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.868033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.876385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.878541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.879706 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-abd252ad-c653-498e-bd29-829d1746d17c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.162521 Apr 02 20:58:40.880270 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 916/2080] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:40 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:40.885404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:40.889177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:40.889796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:40.893991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1fd00027-10f4-42ba-966a-076b85138df1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.467179 Apr 02 20:58:40.894573 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1165/2081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:40 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:40.896395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.896889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:40.897673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:40.898137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.028992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.036625 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af044b22-6551-4865-aebd-99b483d87b2a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.151204 Apr 02 20:58:41.037191 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 917/2082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:40 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:41.054940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.055684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.065990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.066599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.069769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.070470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.071253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.071686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.088411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.089022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.090800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.091248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.225143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.233066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-691f8fd5-ea37-4851-ab4e-5d0c8282fe64 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.181925 Apr 02 20:58:41.233581 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1166/2083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:41.249823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:41.250432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.255793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.257392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.257844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.258628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.259072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.263326 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-928cc283-10e0-4e52-9afd-2124c9e35cad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.201705 Apr 02 20:58:41.264568 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 918/2084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:41.292561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Cannot 'unshelve' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active Apr 02 20:58:41.293181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 409 to user: Cannot 'unshelve' instance d88c5184-0805-4677-a11d-4077b9465e11 while it is in vm_state active {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:41.294003 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8bb705a-d524-4d0f-9ea2-c746356f5423 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action" status: 409 len: 146 microversion: 2.1 time: 0.048330 Apr 02 20:58:41.294564 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1167/2085] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:41 2022] POST /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11/action => generated 146 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 02 20:58:41.303346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.303962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.309997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.310453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.311217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.311658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.442097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.442713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.448580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.449162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.449627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.450442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.450845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.456048 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19506936-505e-459b-9d2f-c74ebd611473 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.156549 Apr 02 20:58:41.457145 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 919/2086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:41.473884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.474508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.481025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.481482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.482257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.482699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.589035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.597357 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c51809a3-8ea4-4000-993c-89a5256667d9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.159131 Apr 02 20:58:41.597929 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1168/2087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:41.602437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.603113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.608821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.609302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.610075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.610512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.615372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.623376 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3942423-c697-49e6-9761-f43b1f36b1d7 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.153742 Apr 02 20:58:41.623945 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 920/2088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:41.639553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5de020ca-60c7-47c5-b01d-e646d80884af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-584822903_updated"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:41.641035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5de020ca-60c7-47c5-b01d-e646d80884af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: f91f96a3-b352-43ec-a96a-4dc917a58fef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.646296 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5de020ca-60c7-47c5-b01d-e646d80884af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance f91f96a3-b352-43ec-a96a-4dc917a58fef could not be found. Apr 02 20:58:41.646882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5de020ca-60c7-47c5-b01d-e646d80884af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance f91f96a3-b352-43ec-a96a-4dc917a58fef could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:41.647744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5de020ca-60c7-47c5-b01d-e646d80884af tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "PUT /compute/v2.1/servers/f91f96a3-b352-43ec-a96a-4dc917a58fef" status: 404 len: 111 microversion: 2.1 time: 0.012013 Apr 02 20:58:41.648339 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 921/2089] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 20:58:41 2022] PUT /compute/v2.1/servers/f91f96a3-b352-43ec-a96a-4dc917a58fef => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 20:58:41.655933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.656807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.663921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.664382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.665180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.665625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.747253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.754814 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-014381ca-2bb4-4e87-869f-3f3e60108bcb tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.155929 Apr 02 20:58:41.755384 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1169/2090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:41.759779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.760385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.766830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.767827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.768625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.769064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.800710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.808196 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c0b4b70-c953-4997-87ec-36d95895d84e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.155784 Apr 02 20:58:41.808825 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 922/2091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:41.825683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.826293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.832744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.833200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.833967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.834411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.901595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.909734 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2248bba-c6ea-4189-8daf-936c88b74a4b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.153363 Apr 02 20:58:41.910428 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1170/2092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:41.914816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.915448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.921170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.921616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.922380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.922814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.967146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:41.974635 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5028942a-76c5-46d4-a048-efe5398ed667 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.152785 Apr 02 20:58:41.975203 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 923/2093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:41.986455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:41.986455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:41.986651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.987110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:41.987885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:41.988329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.055600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.063598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.065737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.066904 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-45548dde-2450-4ddc-a320-fb9fdec9debd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.155556 Apr 02 20:58:42.067472 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1171/2094] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:42.072337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8a334ad-1c89-40a9-817d-2a1162a7357e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:42.073706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8a334ad-1c89-40a9-817d-2a1162a7357e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:42.075162 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a8a334ad-1c89-40a9-817d-2a1162a7357e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "PUT /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 400 len: 619 microversion: 2.1 time: 0.006763 Apr 02 20:58:42.075840 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1172/2095] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Apr 2 20:58:42 2022] PUT /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 20:58:42.083654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.084275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.091252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.091711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.092535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.092987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.127536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.136198 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc2e070a-b0bb-4208-8f57-bf79fc5d083d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.159976 Apr 02 20:58:42.136815 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 924/2096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:41 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:42.234328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.243215 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d345e9f4-972a-49dd-99e0-7b106a2c7323 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.163087 Apr 02 20:58:42.243921 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1173/2097] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:42.260970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.261833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.270195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.270857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.271630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.272099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.280682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.281292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.287527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.287977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.288771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.289210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.411233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.418822 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c917e96b-bf2a-4864-9299-bc6efbd4d67a tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.161850 Apr 02 20:58:42.419406 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 925/2098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:42.424974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.432819 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bffe6ac5-bc2f-477e-aef4-af2f7ae4773e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.155838 Apr 02 20:58:42.433704 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1174/2099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:42.435482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee4599df-5b14-482b-840a-e7bb5bf7f96e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:42.436739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee4599df-5b14-482b-840a-e7bb5bf7f96e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:42.437570 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee4599df-5b14-482b-840a-e7bb5bf7f96e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "PUT /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 400 len: 108 microversion: 2.1 time: 0.006063 Apr 02 20:58:42.440557 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 926/2100] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 20:58:42 2022] PUT /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 20:58:42.447576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.448192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.454219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.455172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.456244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.457230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.588376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.596354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4dfd137b-e383-4b26-b806-0664c8cf0988 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1503 microversion: 2.1 time: 0.152175 Apr 02 20:58:42.596964 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1175/2101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:42.614015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.614495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.621261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.621849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.622466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.622906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.772056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.772735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.778211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.780384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.780883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.781853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.782309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.788255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b84bbd2-3e85-4d5e-bb5a-a8417da34e98 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.177881 Apr 02 20:58:42.788809 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 927/2102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:42.925896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:42.928215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:42.928877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:42.934246 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e78e9eb6-785a-45f3-a641-a829d20fc61f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.166776 Apr 02 20:58:42.935229 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1176/2103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:42.936171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.936665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:42.937465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:42.937910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.088753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:43.089370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:43.092218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.100820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.101280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.102071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.102513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.103186 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e72982c-3f17-4dc8-bb22-3060c56298c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.179995 Apr 02 20:58:43.103763 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 928/2104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:42 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:43.154074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:43.154843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:43.161596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.162142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.162978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.163596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.239241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.247930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.249511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.250679 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ca9b63f-df41-462b-a8fe-28a5d460ff9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.166054 Apr 02 20:58:43.251252 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1177/2105] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:43 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:43.295996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.304770 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9f25c4e-504b-486d-a2c3-46cedc8cf0e2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.153981 Apr 02 20:58:43.305331 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 929/2106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:43 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:43.450143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:43.450876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:43.457083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.457536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.458313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.458752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.602299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.609592 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-079f2769-8056-4b27-af8b-7e2969f72802 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.163658 Apr 02 20:58:43.610158 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1178/2107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:43 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:43.806491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:43.807767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:43.814360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.814968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.815894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.816428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.952795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:43.953455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:43.960176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.960722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.961529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:43.961980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:43.973390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:43.981475 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41a12a33-f97e-4848-9379-3978ed516583 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.179469 Apr 02 20:58:43.982151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 930/2108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:43 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:44.103979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.111962 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f29f5f83-c3ff-4da9-bd97-2b6a1b576b2d tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.163375 Apr 02 20:58:44.112819 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1179/2109] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:43 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:44.119155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.119896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.126750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.127213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.127992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.128477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.270211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.270823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.270958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.276869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.277326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.278136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.278258 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02f49403-8a48-4b54-95bc-1ffe2f6bce9c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.162920 Apr 02 20:58:44.278581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.278785 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 931/2110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:44 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:44.321288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.321901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.327721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.328177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.328975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.329415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.417146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.425893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.427688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.433618 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6649556e-bdb7-4248-a73e-750f0a12ec03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.168004 Apr 02 20:58:44.434466 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1180/2111] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:44 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:44.472434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.479946 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc353a74-df55-434c-a426-e267e5ca7054 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.162752 Apr 02 20:58:44.480540 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 932/2112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:44 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:44.627031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.627783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.634913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.635376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.636149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.636625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.780548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:44.788125 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6932eec1-a627-4198-b945-347ae4fd91aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.164923 Apr 02 20:58:44.788746 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1181/2113] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:44 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:44.875863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.876387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.882870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.883324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.884121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.884624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.897442 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. Apr 02 20:58:44.898031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:44.898850 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4064122-a745-43b7-98d8-475dbe569916 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 404 len: 111 microversion: 2.1 time: 0.027267 Apr 02 20:58:44.900347 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 933/2114] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:58:44 2022] DELETE /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:44.908094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.908740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: 921651cb-3b32-40b1-93bd-69c6229974fc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.914651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.915108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.915877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.916317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.929792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. Apr 02 20:58:44.930375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance 921651cb-3b32-40b1-93bd-69c6229974fc could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:44.931190 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-984a4740-7f57-4eb1-ab90-6934528343b1 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc" status: 404 len: 111 microversion: 2.1 time: 0.026998 Apr 02 20:58:44.931707 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1182/2115] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:44 2022] GET /compute/v2.1/servers/921651cb-3b32-40b1-93bd-69c6229974fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:44.939345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.939850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:44.946997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.947451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.948220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:44.948686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:44.971985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:58:44.999059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:44.999706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.006310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.006704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.007486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.007935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.053202 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e0c457f-e188-41fd-af5c-3aca6336ca2c tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 204 len: 0 microversion: 2.1 time: 0.117282 Apr 02 20:58:45.053793 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 934/2116] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:58:44 2022] DELETE /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:58:45.063463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:45.064162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.070150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.070868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.071633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.072187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.166277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.174092 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d021be1-9f8f-4c70-a53c-10d690ddd9da tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.178900 Apr 02 20:58:45.174746 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1183/2117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:44 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:45.184204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:45.184204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.186719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.187247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.188032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.188565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.214654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.223817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d35b382a-45c3-4998-96b2-10d5d8f91b12 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.164882 Apr 02 20:58:45.224707 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 935/2118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:45 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:45.295228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:45.295933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.303534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.304159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.304978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.305506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.343918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.354412 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fd4e764a-fb52-49b0-97b9-14e9139f619f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.177969 Apr 02 20:58:45.355366 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1184/2119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:45 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:45.447181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.451655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:45.452272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.454820 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20c9fb64-29e2-4fdc-a150-a022f23a86cb tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.163384 Apr 02 20:58:45.455687 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 936/2120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:45 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:45.458927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.459388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.460360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.460832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.496601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:45.497331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.503441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.503976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.504865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.505376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.593507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.601926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.603517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.604702 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5dd73b3-0732-4dfa-8dce-c42eb38a7cd0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.157277 Apr 02 20:58:45.605268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1185/2121] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:45 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:45.642053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.649945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e36574e-c844-4b79-a996-cb4ef60a448e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.157191 Apr 02 20:58:45.650513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 937/2122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:45 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:45.804931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:45.805538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:45.811392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.811853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.812649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:45.813091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:45.946717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:45.953971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7d73d5f-f9ec-40a4-8ef1-c56ca05797ad tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.152905 Apr 02 20:58:45.954537 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1186/2123] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:45 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:46.192959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.193578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.200645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.201101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.201871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.202311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.241924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.242536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.249023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.249471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.250249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.250684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.348061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.364109 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-90b639d5-055d-4aa2-9404-130becd7709b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.176161 Apr 02 20:58:46.365202 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 938/2124] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:46.372929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.373597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.382277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.382935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.383917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.384358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.403330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.410910 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c48f4f87-2a34-4876-9fe7-026b9aa5d11e tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.173313 Apr 02 20:58:46.411679 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1187/2125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:46.472132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.472950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.479043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.479483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.480259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.480729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.528124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.535997 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65cd1c1c-d20b-48e1-98df-238636709143 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.167236 Apr 02 20:58:46.536591 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 939/2126] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:46.615560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.622911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd8a6d7b-b37c-4fda-a7a2-946089f92891 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.154738 Apr 02 20:58:46.623106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.623480 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1188/2127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:46.623710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.629714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.630367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.631182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.631629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.666630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.667239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.673178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.673630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.674406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.674844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.770507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.778730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.780515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.781887 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-258ec109-e800-4e4e-bc22-d79588f24c39 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.162811 Apr 02 20:58:46.782617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 940/2128] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:46.820149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:46.827973 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73e9dc1b-31cc-4a38-a56f-ac2bde358798 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.165108 Apr 02 20:58:46.828566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1189/2129] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:46.971573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:46.972711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:46.978775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.979233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:46.980097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:46.980666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.267849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:47.278404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae7040b0-c74e-4c69-8622-20c567f8124c tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.311139 Apr 02 20:58:47.290014 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 941/2130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:46 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:47.383259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:47.383880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:47.391931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.392435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.393224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.394903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.429190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:47.430428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:47.442167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.444640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.445916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.447932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.726246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:47.735521 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43f03779-9263-480b-b1bf-d7ed9a9848f7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1471 microversion: 2.1 time: 0.357065 Apr 02 20:58:47.736518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1190/2131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:47 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:47.750320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:47.751273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:47.759219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.759757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.760633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.761139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.854029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee8c4a666eb94960b71b0353d32b5f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e28f04f7dd4777891efe100377f141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:47.861861 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6c1c7cc-5592-4e3e-925f-54a67fd7216d tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 200 len: 1509 microversion: 2.1 time: 0.437516 Apr 02 20:58:47.863811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 942/2132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:47 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:47.868785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:47.869607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:47.875633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.876086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:47.877299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:47.877923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.083434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.092240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f6da7a38-2c61-4754-a454-211344f1c2ad tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.353723 Apr 02 20:58:48.093764 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1191/2133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:47 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:48.108066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:48.110541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:48.119627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.120089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.120897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.121336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.269387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.275960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.279324 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07151ccb-3cf2-4d58-ad96-8a3f29593d32 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1362 microversion: 2.1 time: 0.414166 Apr 02 20:58:48.285057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.286859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.288128 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bab2929e-5cc0-463d-ba6e-0137ea1a3734 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1567 microversion: 2.25 time: 0.193321 Apr 02 20:58:48.289015 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 943/2134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:47 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:48.290961 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1192/2135] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:48 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:48.296446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a4120db9-8cf7-44af-9c14-e30926d11c13 req-a179c5b0-1edb-4f8c-a80a-096a34ea0adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88c5184-0805-4677-a11d-4077b9465e11", "name": "network-vif-deleted", "tag": "f4087e3e-4f59-4105-bdf5-e1707ada38cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:48.304795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:48.305728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:48.306267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a4120db9-8cf7-44af-9c14-e30926d11c13 req-a179c5b0-1edb-4f8c-a80a-096a34ea0adc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.306833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a4120db9-8cf7-44af-9c14-e30926d11c13 req-a179c5b0-1edb-4f8c-a80a-096a34ea0adc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.313067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.313928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.314966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.315604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.319775 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a4120db9-8cf7-44af-9c14-e30926d11c13 req-a179c5b0-1edb-4f8c-a80a-096a34ea0adc service nova] Creating event network-vif-deleted:f4087e3e-4f59-4105-bdf5-e1707ada38cb for instance d88c5184-0805-4677-a11d-4077b9465e11 on nch2-master-1 Apr 02 20:58:48.327309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a4120db9-8cf7-44af-9c14-e30926d11c13 req-a179c5b0-1edb-4f8c-a80a-096a34ea0adc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033853 Apr 02 20:58:48.327309 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1193/2136] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:48.333630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:48.334593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:48.342671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.343283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.344305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.344852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.511572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.522640 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-145040bf-178f-4ffb-ab6e-b86af87d8c4b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.193886 Apr 02 20:58:48.524985 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1194/2137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:48 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:48.584113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.591619 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8aa5261a-83fd-42f4-9306-f59552469e09 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.301245 Apr 02 20:58:48.592327 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 944/2138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:48 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:48.754539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:48.755159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:48.761169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.761634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.763516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.764473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.879615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:48.880369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] [instance: d88c5184-0805-4677-a11d-4077b9465e11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:48.886128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.886592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.887368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:48.887812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:48.901902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] HTTP exception thrown: Instance d88c5184-0805-4677-a11d-4077b9465e11 could not be found. Apr 02 20:58:48.902506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] Returning 404 to user: Instance d88c5184-0805-4677-a11d-4077b9465e11 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:58:48.903362 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44fad7c8-a1d0-4abe-b537-43523aa1a2f8 tempest-ServersNegativeTestJSON-1054341429 tempest-ServersNegativeTestJSON-1054341429-project] 10.222.0.18 "GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11" status: 404 len: 111 microversion: 2.1 time: 0.028221 Apr 02 20:58:48.903912 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 945/2139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:48 2022] GET /compute/v2.1/servers/d88c5184-0805-4677-a11d-4077b9465e11 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:58:48.918448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:48.925902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a7a808cf-00ba-4cf3-b968-f85b790791d0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.176540 Apr 02 20:58:48.926549 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1195/2140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:48 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:49.110775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.111394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.117813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.117953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.118702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.119147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.288875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.300745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.302304 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bea8902a-3801-486c-a782-20b43f090ab5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.192754 Apr 02 20:58:49.302603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.303283 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 946/2141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:49.308909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.309733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.311845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.312532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.313987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.315156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.318508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.318977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.319777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.320708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.486481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.496865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.499770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.501539 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb6567ad-d2e2-4933-9d62-f5564dd6d2b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1542 microversion: 2.25 time: 0.197085 Apr 02 20:58:49.506482 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 947/2142] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1542 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:49.523670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-387723d6-d717-435c-b0e6-8253c9e3ea22 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '.version_select at 0x7f54d42e5c10>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.526451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-387723d6-d717-435c-b0e6-8253c9e3ea22 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.527597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-387723d6-d717-435c-b0e6-8253c9e3ea22 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.540304 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-387723d6-d717-435c-b0e6-8253c9e3ea22 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2790 microversion: 2.25 time: 0.022921 Apr 02 20:58:49.541554 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 948/2143] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/os-migrations => generated 2790 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:49.546580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.547426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.555762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.559997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.561446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.562522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.589085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.597762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85cf1342-780d-4482-86ae-175c00461cf5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1548 microversion: 2.1 time: 0.303704 Apr 02 20:58:49.598353 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1196/2144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1548 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:49.603190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.604290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.616466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.617259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.618293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.619093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.748428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.757874 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-646a8f9d-a0e9-4599-afd3-7fad71e8c2f9 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.215052 Apr 02 20:58:49.758441 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 949/2145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:49.764030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.764904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.778009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.778756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.779714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.780907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.802033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid d8d2897f-4f31-4c6f-87ee-0279c8e9a3af {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:58:49.815958 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a0055a3-81d4-4101-a979-032469647925 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 2034 microversion: 2.25 time: 0.216226 Apr 02 20:58:49.816598 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1197/2146] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 2034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:49.825606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:49.826222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:49.833637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.837139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.838469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:49.839032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:49.934198 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d2bf365-e87d-495a-ab62-a226f101da09 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112588 Apr 02 20:58:49.941229 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1198/2147] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:49.945944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1483899633", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "eb9b7612-59b4-4022-aa4f-4de8d7979f06"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:49.996783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:49.996983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] validate_networks() for [('eb9b7612-59b4-4022-aa4f-4de8d7979f06', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:58:50.005279 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2587be4-79de-43bd-b334-9171ecceb539 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.245860 Apr 02 20:58:50.014711 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 950/2148] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:49 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:50.020964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:50.021635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:50.039166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.039600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.040390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.040860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.244205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:50.251925 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db37e03f-0956-4ee2-b52a-74151ae9081c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.235807 Apr 02 20:58:50.263110 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 951/2149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:50 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:50.322584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:50.324546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:50.332624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.333656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.334653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.335271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.541434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:50.552112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b006a0e-a1fe-4d9f-8dae-ebd35dc282fa tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.236634 Apr 02 20:58:50.552734 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 952/2150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:50 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:50.775978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:50.777195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:50.784335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.785337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.786120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.786745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.787948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:58:50.788637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:58:50.789204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:58:50.789871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:58:50.790857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:58:50.811866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.813226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.814319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:50.814772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:50.860218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:58:50.875757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for user 4eaee1ddad0041828fb2e65677e2da25 and project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:58:50.902203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:58:50.905062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:58:50.992891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.000769 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6bfcfc06-f2dd-4424-9ee1-94b995cf00b3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.060985 Apr 02 20:58:51.002466 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eacecb8c-3e5f-4d51-97af-e7596b555f70 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.230803 Apr 02 20:58:51.003795 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 953/2151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:50 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:51.010549 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1199/2152] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:58:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:58:51.015746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9bafa789-d199-4010-aa05-d56e59974ac0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:51.016389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9bafa789-d199-4010-aa05-d56e59974ac0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:51.028360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:51.029254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:51.055374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.056804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.059037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.060249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.125775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bafa789-d199-4010-aa05-d56e59974ac0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.137613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bafa789-d199-4010-aa05-d56e59974ac0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.144713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bafa789-d199-4010-aa05-d56e59974ac0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.150423 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9bafa789-d199-4010-aa05-d56e59974ac0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1262 microversion: 2.25 time: 0.136306 Apr 02 20:58:51.155322 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 954/2153] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:51 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1262 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:51.271612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:51.272543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:51.287829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.287829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.287829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.287829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.423059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.434635 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90a35542-5d0c-4023-9fde-ec72bfc5d0e3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.413846 Apr 02 20:58:51.435593 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1200/2154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:51 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:51.530698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.542252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8da62b64-6591-4e04-b1e5-cda13b0ae74e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.275442 Apr 02 20:58:51.543850 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 955/2155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:51 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:51.569861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:51.570848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:51.577769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.578228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.585653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.586383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.683924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a26057a3-86a4-45f9-8c18-5655a55f9b33 req-8cb3d4af-32d6-46f3-9907-4f80c7eb5599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259abe5f-f848-4966-b186-a747835eab18", "tag": "f2ea41d2-5537-49e4-98d6-de0eedf3bff6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:51.713121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a26057a3-86a4-45f9-8c18-5655a55f9b33 req-8cb3d4af-32d6-46f3-9907-4f80c7eb5599 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:51.713958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a26057a3-86a4-45f9-8c18-5655a55f9b33 req-8cb3d4af-32d6-46f3-9907-4f80c7eb5599 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:51.743510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a26057a3-86a4-45f9-8c18-5655a55f9b33 req-8cb3d4af-32d6-46f3-9907-4f80c7eb5599 service nova] Creating event network-changed:f2ea41d2-5537-49e4-98d6-de0eedf3bff6 for instance 259abe5f-f848-4966-b186-a747835eab18 on nch1-master-1 Apr 02 20:58:51.751427 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a26057a3-86a4-45f9-8c18-5655a55f9b33 req-8cb3d4af-32d6-46f3-9907-4f80c7eb5599 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073230 Apr 02 20:58:51.755182 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 956/2156] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:51.925835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:51.936668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec109740-2114-48fa-afb2-a22c752c358e tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.371140 Apr 02 20:58:51.937789 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1201/2157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:51 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:52.023732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:52.025452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:52.040031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.041083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.042869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.043731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.171973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:52.172876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:52.182829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.183211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.186009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.186463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.306235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:52.318953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:52.322841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:52.324296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0aaeaa8-38d1-4d58-a987-d01f13a58411 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1314 microversion: 2.25 time: 0.157115 Apr 02 20:58:52.334384 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1202/2158] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:52 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:52.371263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:52.381811 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a0e4087-caa0-4722-a51d-792fda039ad1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.365181 Apr 02 20:58:52.384030 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 957/2159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:52 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:52.463029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:52.463658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:52.475814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.476251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.477084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.479934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.566507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:52.567791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:52.579921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.582317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:52.586372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:52.587094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.077067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.087294 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.631542 Apr 02 20:58:53.088783 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1203/2160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:52 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:53.090606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:53.091540 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10e9bfa9-d0b2-4ebc-9edd-b24dc1e58480 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001193 Apr 02 20:58:53.091870 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1204/2161] 10.222.0.18 () {56 vars in 885 bytes} [Sat Apr 2 20:58:53 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 02 20:58:53.097826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:53.099314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:53.111477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:53.113454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.115902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:53.117120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.166701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.174421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a71dd82a-abcd-4814-9685-f4956bd74537 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.617521 Apr 02 20:58:53.184540 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 958/2162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:52 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:53.345530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:53.346184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:53.354178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:53.354871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.356040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:53.356729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.390849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.406477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5d17be4-9a9c-4670-a2e8-353443d158a2 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.312998 Apr 02 20:58:53.408135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1205/2163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:53 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:53.418670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:53.421240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:53.430469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:53.430940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.432014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:53.432737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:53.761414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.773773 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0aee2f22-3ca0-47ec-9def-873099b706f0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.362791 Apr 02 20:58:53.774634 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1206/2164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:53 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:53.790977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.804116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.805924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:53.807723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e0dbb7b-6b40-4a22-af31-49043972dc37 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1320 microversion: 2.25 time: 0.467906 Apr 02 20:58:53.808784 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 959/2165] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:53 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:54.108378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:54.109627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:54.119574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.120260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.121306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.121796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.192276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:54.193028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:54.203275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.208265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.220769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.229115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.339088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:54.347970 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4fb8253f-8ae3-4e77-8191-1a882ad230b6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.244355 Apr 02 20:58:54.348948 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1207/2166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:54 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:54.354513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9df2274e-6125-4ab4-bf2f-bcd8485eb84f req-cc4792e2-2675-4d55-aab2-60e497368878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bb27b3-1a40-487e-af80-567547b3347a", "name": "network-vif-plugged", "status": "completed", "tag": "4883e687-c354-4cf9-9d83-3e9daec8775f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:54.363786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9df2274e-6125-4ab4-bf2f-bcd8485eb84f req-cc4792e2-2675-4d55-aab2-60e497368878 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.364234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9df2274e-6125-4ab4-bf2f-bcd8485eb84f req-cc4792e2-2675-4d55-aab2-60e497368878 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.383239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9df2274e-6125-4ab4-bf2f-bcd8485eb84f req-cc4792e2-2675-4d55-aab2-60e497368878 service nova] Creating event network-vif-plugged:4883e687-c354-4cf9-9d83-3e9daec8775f for instance f1bb27b3-1a40-487e-af80-567547b3347a on nch1-master-1 Apr 02 20:58:54.391616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9df2274e-6125-4ab4-bf2f-bcd8485eb84f req-cc4792e2-2675-4d55-aab2-60e497368878 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040734 Apr 02 20:58:54.394367 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1208/2167] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:54.432334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:54.433353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:54.446500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.447368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.448810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.450214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.583139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:54.591987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-28ab4e42-9072-406c-b479-66d7f3e49408 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.403778 Apr 02 20:58:54.591987 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 960/2168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:54 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:54.627209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:54.634238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7e86a6b-fb8a-41d7-8d3b-18291a407880 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.210507 Apr 02 20:58:54.635002 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1209/2169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:54 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:54.796498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:54.797122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:54.805594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.806061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.806856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.807333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.826551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:54.827162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:54.835152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.837353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:54.838285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:54.839672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.013239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.023418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.025916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.027467 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23cf2ad3-615e-4387-a373-c1ef77d0f09a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1362 microversion: 2.25 time: 0.204522 Apr 02 20:58:55.028087 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1210/2170] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:54 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:55.032176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.044390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9459419a-8333-41bb-8e38-d1c4aca18e7a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.253725 Apr 02 20:58:55.046865 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 961/2171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:54 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:55.093923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-af59d08f-bf0b-4396-b951-c880914b2636 req-b921ee84-4b76-4707-96c7-84ada524ea37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6f315a-5c0b-48ec-9e78-16942df1a9f7", "tag": "12334738-596e-4bda-85ff-6807e7a908f4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:55.117436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-af59d08f-bf0b-4396-b951-c880914b2636 req-b921ee84-4b76-4707-96c7-84ada524ea37 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.118561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-af59d08f-bf0b-4396-b951-c880914b2636 req-b921ee84-4b76-4707-96c7-84ada524ea37 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.149572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-af59d08f-bf0b-4396-b951-c880914b2636 req-b921ee84-4b76-4707-96c7-84ada524ea37 service nova] Creating event network-changed:12334738-596e-4bda-85ff-6807e7a908f4 for instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 on nch2-master-1 Apr 02 20:58:55.166744 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-af59d08f-bf0b-4396-b951-c880914b2636 req-b921ee84-4b76-4707-96c7-84ada524ea37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085871 Apr 02 20:58:55.167356 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1211/2172] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:55.367066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.368218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:55.378673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.379487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.380809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.381688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.413539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-97efe09c-e413-4da2-958b-b6dc0ea5a6ed tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Calling method '.version_select at 0x7f54d42caca0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.497597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-97efe09c-e413-4da2-958b-b6dc0ea5a6ed tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.220706 Apr 02 20:58:55.498389 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 962/2173] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c/defaults => generated 371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:55.512021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-057a9f00-9d76-4705-a29a-fdb593e07a01 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Calling method '.version_select at 0x7f54d42e5040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.557345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.570131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6083ee0-48c4-49fd-bb4d-b43cbe7289ca tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.208103 Apr 02 20:58:55.572355 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1212/2174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:55.590761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-057a9f00-9d76-4705-a29a-fdb593e07a01 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c" status: 200 len: 371 microversion: 2.1 time: 0.085016 Apr 02 20:58:55.591344 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 963/2175] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:58:55.604093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba3b3eeb-4295-46f4-8930-3a86de7c1273 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Calling method '.version_select at 0x7f54da32e790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.607326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.607928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:55.615377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.615841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.616762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.617966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.670026 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba3b3eeb-4295-46f4-8930-3a86de7c1273 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.069784 Apr 02 20:58:55.670594 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1213/2176] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c/defaults => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:55.675353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.676177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:55.682493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.683195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.683971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:55.684414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:55.823350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.833402 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e4b30ad-1062-4666-9890-10915d697991 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1323 microversion: 2.1 time: 0.160883 Apr 02 20:58:55.834013 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1214/2177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:55.838942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32775189-07f3-4667-b2e1-52b081b2b29f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Calling method '.version_select at 0x7f54da20e5e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.850609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:55.860316 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12b5ecf4-a71d-4f20-b1da-4f62a31f85d5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.257003 Apr 02 20:58:55.864519 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 964/2178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:55.906579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32775189-07f3-4667-b2e1-52b081b2b29f tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c" status: 200 len: 371 microversion: 2.1 time: 0.071501 Apr 02 20:58:55.907169 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1215/2179] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:55.918265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9941a79-3b07-4858-b32d-0e66e6e32b38 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] Calling method '.version_select at 0x7f54d42e5c10>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:55.993761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9941a79-3b07-4858-b32d-0e66e6e32b38 tempest-QuotasTestJSON-1342943800 tempest-QuotasTestJSON-1342943800-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c?user_id=fd55b213e5f34c66bc9f05467f9f9ae1" status: 200 len: 371 microversion: 2.1 time: 0.079215 Apr 02 20:58:55.994348 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 965/2180] 10.222.0.18 () {58 vars in 1322 bytes} [Sat Apr 2 20:58:55 2022] GET /compute/v2.1/os-quota-sets/7f97674b4e954fd084f6a1286ca2960c?user_id=fd55b213e5f34c66bc9f05467f9f9ae1 => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:56.046940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:56.047552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:56.054050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.054503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.055510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.056129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.062102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:56.063175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:56.071848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.072316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.073329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.073921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.220975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:56.230482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:56.232327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:56.233709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-83afa399-0e18-45f6-bbe0-eb4403d4d13e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1362 microversion: 2.25 time: 0.191302 Apr 02 20:58:56.234288 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1216/2181] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:56 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:56.307279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:56.315596 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-419981e2-d541-4483-83ae-94780da36d55 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.257411 Apr 02 20:58:56.322372 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 966/2182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:56 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:56.588303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:56.588913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:56.596534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.597540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.598517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.599007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.790536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:56.802053 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d6799498-9c88-4c46-ab8c-8c9fec2567bd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.217640 Apr 02 20:58:56.802810 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1217/2183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:56 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:56.850772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:56.851422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:56.858191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.858668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.859436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.859874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.879852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:56.881377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:56.888064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.888776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:56.889616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:56.890145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.006116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:57.013663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f72dff5f-16fc-4f7a-932d-96e95d332fe7 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 200 len: 1519 microversion: 2.1 time: 0.167294 Apr 02 20:58:57.014345 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 967/2184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:56 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:57.032619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'action', calling method: .version_select at 0x7f54d73845e0>, body: {"addFloatingIp": {"address": "172.35.4.99"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:57.035122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:57.041413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:57.048393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5201178e-acfe-4116-9e90-ba105727a709 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.172574 Apr 02 20:58:57.049384 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1218/2185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:56 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:57.050854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.051307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.052264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.052909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.123028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Acquired lock "refresh_cache-931c470e-0eeb-4c37-8757-1d3aef81b2d1" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:58:57.254521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:57.254969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:57.276681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.277370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.278659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.279322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.520700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:57.530102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:57.532560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:57.534439 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3d2cce81-96d1-4b91-97c4-bb6fa635cd2c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1362 microversion: 2.25 time: 0.285372 Apr 02 20:58:57.548161 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1219/2186] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:57 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:58:57.568625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:57.569260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:57.579897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.580954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.582021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.582654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.776167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:57.784060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.232262 Apr 02 20:58:57.785381 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1220/2187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:57 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:57.786556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:57.787707 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001316 Apr 02 20:58:57.788549 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1221/2188] 10.222.0.18 () {56 vars in 885 bytes} [Sat Apr 2 20:58:57 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 02 20:58:57.795398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:57.796797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002111 Apr 02 20:58:57.805344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1222/2189] 10.222.0.18 () {54 vars in 1034 bytes} [Sat Apr 2 20:58:57 2022] GET /compute/v2/ => generated 379 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Apr 02 20:58:57.814403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:57.822076 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dde9e13-923d-49af-882a-612aa240c763 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003791 Apr 02 20:58:57.832400 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1223/2190] 10.222.0.18 () {54 vars in 1040 bytes} [Sat Apr 2 20:58:57 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:57.838524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:57.839156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:57.846770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.848997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:57.849811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:57.850319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.027859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:58.036264 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.212367 Apr 02 20:58:58.037059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1224/2191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:57 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:58.038174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:58.039220 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19271da1-59c6-46e5-ab64-eca97a5eec08 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001209 Apr 02 20:58:58.039706 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1225/2192] 10.222.0.18 () {56 vars in 885 bytes} [Sat Apr 2 20:58:58 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 02 20:58:58.067358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:58.068152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:58.075068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:58.075525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.076495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:58.076796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.248857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:58.256718 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1470d292-bce9-48bc-bf97-d66be4eea6b0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.194477 Apr 02 20:58:58.257878 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1226/2193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:58 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:58.552737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:58.553385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:58.559998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:58.560475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.561283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:58.561732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.705859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:58.717868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:58.719761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:58.723149 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-205eb3aa-3a1f-4380-adc4-2225113bb1b5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1362 microversion: 2.25 time: 0.175541 Apr 02 20:58:58.723909 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1227/2194] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:58:58 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:58:58.803896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:58.804448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:58.810999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:58.811452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.812311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:58.812812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:58.912631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Building network info cache for instance {{(pid=136517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 20:58:58.966493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:58.978018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92cbad3d-b032-4c7d-b791-8c4e13c163aa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1471 microversion: 2.1 time: 0.178847 Apr 02 20:58:58.987506 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1228/2195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:58 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:58:58.992911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3a82ff99-be66-429b-b2f3-f1b8fd9fd49f req-ad1db180-ed32-498c-b4fd-2e4ccaa4ff24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:58:59.003048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3a82ff99-be66-429b-b2f3-f1b8fd9fd49f req-ad1db180-ed32-498c-b4fd-2e4ccaa4ff24 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:59.003672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3a82ff99-be66-429b-b2f3-f1b8fd9fd49f req-ad1db180-ed32-498c-b4fd-2e4ccaa4ff24 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:59.019556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3a82ff99-be66-429b-b2f3-f1b8fd9fd49f req-ad1db180-ed32-498c-b4fd-2e4ccaa4ff24 service nova] Creating event network-changed:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:58:59.044841 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3a82ff99-be66-429b-b2f3-f1b8fd9fd49f req-ad1db180-ed32-498c-b4fd-2e4ccaa4ff24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055287 Apr 02 20:58:59.047309 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1229/2196] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:58:59.065268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:59.066789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:59.108413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:59.110178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:59.111722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:59.113911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:59.550422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:58:59.583896 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-723d4912-ea33-4a5c-82ce-da905798f917 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1497 microversion: 2.1 time: 0.529577 Apr 02 20:58:59.586431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1230/2197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:59 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1497 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:58:59.597770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:58:59.598386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:58:59.613927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:59.614390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:58:59.615182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:58:59.623102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.245902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Updating instance_info_cache with network_info: [{"id": "8ccfbe04-805d-49bd-88f1-b591034caed3", "address": "fa:16:3e:31:fc:4c", "network": {"id": "58fa3672-fa03-4f54-a24a-d36533b2e021", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424298643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0e22715a8e849e0871b68d772ed29fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ccfbe04-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 20:59:00.266689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Releasing lock "refresh_cache-931c470e-0eeb-4c37-8757-1d3aef81b2d1" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:59:00.271329 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-481da646-0d84-4a53-b540-771f7edcd3e0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action" status: 202 len: 0 microversion: 2.1 time: 3.242205 Apr 02 20:59:00.272232 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 968/2198] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:58:57 2022] POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action => generated 0 bytes in 3245 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 20:59:00.283982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-52e40615-ac3e-4ff9-82bb-ec06602dbe6d req-41061850-c28c-4296-bf03-2420c4e3e74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6f315a-5c0b-48ec-9e78-16942df1a9f7", "name": "network-vif-plugged", "status": "completed", "tag": "12334738-596e-4bda-85ff-6807e7a908f4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:00.305315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-52e40615-ac3e-4ff9-82bb-ec06602dbe6d req-41061850-c28c-4296-bf03-2420c4e3e74f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.306935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-52e40615-ac3e-4ff9-82bb-ec06602dbe6d req-41061850-c28c-4296-bf03-2420c4e3e74f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.331882 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-52e40615-ac3e-4ff9-82bb-ec06602dbe6d req-41061850-c28c-4296-bf03-2420c4e3e74f service nova] Creating event network-vif-plugged:12334738-596e-4bda-85ff-6807e7a908f4 for instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 on nch2-master-1 Apr 02 20:59:00.336957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-52e40615-ac3e-4ff9-82bb-ec06602dbe6d req-41061850-c28c-4296-bf03-2420c4e3e74f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061675 Apr 02 20:59:00.338024 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 969/2199] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:00.344449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:00.361601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:00.373889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.374879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.376405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.377430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.534007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:00.543518 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06061434-abad-4c9c-92c7-492203726607 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.955606 Apr 02 20:59:00.544269 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1231/2200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:58:59 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:00.549485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:00.551045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:00.558252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.558864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.559959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.562607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.747135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:00.755698 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bbb913a8-5344-49e1-af1a-da3ab55fdef6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.210263 Apr 02 20:59:00.756524 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1232/2201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:00 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:00.761460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'action', calling method: .version_select at 0x7f54d73855e0>, body: {"addFloatingIp": {"address": "172.35.4.99"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:00.762647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:00.764077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:00.769727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.770192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.771199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.771684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.776086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:00.777932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:00.779333 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-15ad8b84-f643-4f98-9f68-b6d7dcc2aff3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1362 microversion: 2.25 time: 0.439902 Apr 02 20:59:00.780133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 970/2202] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:00 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:00.800314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:00.803543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:00.812713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.813177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.817899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:00.818358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:00.874260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Acquired lock "refresh_cache-f1bb27b3-1a40-487e-af80-567547b3347a" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:59:00.981883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:00.991060 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-16e0b241-4911-44a1-8b9b-487c0f7f34a0 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 200 len: 1474 microversion: 2.1 time: 0.209671 Apr 02 20:59:00.992242 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 971/2203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:00 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 1474 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:01.013694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-188305604"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:01.016227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:01.023191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:01.023893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:01.024791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:01.025255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:01.342212 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61f0a2e6-70a8-4701-8cd5-bea308b6425d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda/action" status: 202 len: 0 microversion: 2.1 time: 0.332348 Apr 02 20:59:01.343793 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 972/2204] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:01 2022] POST /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 20:59:01.361708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ea512ad-9944-4cb5-a1d7-c742817f5ebb tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d41f2ee0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:01.460641 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ea512ad-9944-4cb5-a1d7-c742817f5ebb tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.109217 Apr 02 20:59:01.462419 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 973/2205] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:01 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:01.565226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:01.566677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:01.583168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:01.583769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:01.584641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:01.585093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:01.978364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:01.986435 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e73952e6-5b8a-4155-9168-c98e51c0e24a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.429099 Apr 02 20:59:01.987343 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 974/2206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:01 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:02.000242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:02.000893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:02.012349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.013088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:02.014720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.016282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:02.331986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:02.346001 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c5810c2-c9d2-4be8-9150-29d84ca62891 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.357311 Apr 02 20:59:02.347400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 975/2207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:01 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:02.361396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:02.365272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:02.374900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.375439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:02.376309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.376716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:02.704805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:02.718209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:02.719836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:02.724281 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3d9e5eaf-d4f0-4169-a596-a0763fce067d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1559 microversion: 2.25 time: 0.373179 Apr 02 20:59:02.724909 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 976/2208] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:02 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1559 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:02.730255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d1986443-15a7-45ed-add1-61e59dde9781 req-0fc7653c-a58e-4c6a-a3f5-8bd81eef80f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "name": "network-vif-unplugged", "status": "completed", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:02.739135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d1986443-15a7-45ed-add1-61e59dde9781 req-0fc7653c-a58e-4c6a-a3f5-8bd81eef80f6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.739885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d1986443-15a7-45ed-add1-61e59dde9781 req-0fc7653c-a58e-4c6a-a3f5-8bd81eef80f6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:02.756176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d1986443-15a7-45ed-add1-61e59dde9781 req-0fc7653c-a58e-4c6a-a3f5-8bd81eef80f6 service nova] Creating event network-vif-unplugged:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 20:59:02.763652 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d1986443-15a7-45ed-add1-61e59dde9781 req-0fc7653c-a58e-4c6a-a3f5-8bd81eef80f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036512 Apr 02 20:59:02.764813 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 977/2209] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:02.772222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13cc68f9-8516-457f-b6ce-324e339fb83d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4263040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:02.836032 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13cc68f9-8516-457f-b6ce-324e339fb83d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.069254 Apr 02 20:59:02.836937 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 978/2210] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:02 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:02.842387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:02.843860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:02.853116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.854192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:02.855287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:02.855858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:03.317059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:03.350168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ccde29e6-cffc-4147-9a30-d340486732ea tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 2052 microversion: 2.25 time: 0.511759 Apr 02 20:59:03.352183 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 979/2211] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:02 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 2052 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:03.368402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:03.369476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:03.381924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:03.382604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:03.383590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:03.384210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:03.616039 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.network.neutron [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] re-assign floating IP 172.35.4.99 from instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 Apr 02 20:59:03.672776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Building network info cache for instance {{(pid=136518) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 20:59:03.945796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:03.955346 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-63f464ed-9ea4-4329-ae76-041ba951beee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.601294 Apr 02 20:59:03.957397 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 980/2212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:03 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:03.962185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:03.962967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:03.970651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:03.971434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:03.973438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:03.974951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:04.386648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:04.394662 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02d62b23-a713-48e5-8fc6-43c2e92d05bb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.436033 Apr 02 20:59:04.403864 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 981/2213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:03 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:04.411331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5865b423-596c-462c-8683-f0035819890b tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:04.416173 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 20:59:04.416173 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 20:59:04.418060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5865b423-596c-462c-8683-f0035819890b tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:04.418966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5865b423-596c-462c-8683-f0035819890b tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:04.429238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5865b423-596c-462c-8683-f0035819890b tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:04.430039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5865b423-596c-462c-8683-f0035819890b tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:04.499217 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5865b423-596c-462c-8683-f0035819890b tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093281 Apr 02 20:59:04.504211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 982/2214] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Apr 2 20:59:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:04.513957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2a9d884e-d0ba-4eda-8790-657b5464fc8a req-4c360619-c979-4bc0-b274-6a1a6ba94882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:04.531742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2a9d884e-d0ba-4eda-8790-657b5464fc8a req-4c360619-c979-4bc0-b274-6a1a6ba94882 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:04.532173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2a9d884e-d0ba-4eda-8790-657b5464fc8a req-4c360619-c979-4bc0-b274-6a1a6ba94882 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:04.557394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Updating instance_info_cache with network_info: [{"id": "8ccfbe04-805d-49bd-88f1-b591034caed3", "address": "fa:16:3e:31:fc:4c", "network": {"id": "58fa3672-fa03-4f54-a24a-d36533b2e021", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424298643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0e22715a8e849e0871b68d772ed29fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ccfbe04-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 20:59:04.566030 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2a9d884e-d0ba-4eda-8790-657b5464fc8a req-4c360619-c979-4bc0-b274-6a1a6ba94882 service nova] Creating event network-changed:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:59:04.576499 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2a9d884e-d0ba-4eda-8790-657b5464fc8a req-4c360619-c979-4bc0-b274-6a1a6ba94882 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069832 Apr 02 20:59:04.577439 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 983/2215] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:04.594074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe9ff1b6-878f-4a2c-85a8-1b2c8d70c3f8 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4219f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:04.611377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Building network info cache for instance {{(pid=136518) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 20:59:04.664769 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe9ff1b6-878f-4a2c-85a8-1b2c8d70c3f8 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.085232 Apr 02 20:59:04.665830 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 984/2216] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:04 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:04.978273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:04.979045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:05.012351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:05.012883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:05.013819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:05.014290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:05.859864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Updating instance_info_cache with network_info: [{"id": "4883e687-c354-4cf9-9d83-3e9daec8775f", "address": "fa:16:3e:7c:20:ba", "network": {"id": "58fa3672-fa03-4f54-a24a-d36533b2e021", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424298643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0e22715a8e849e0871b68d772ed29fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4883e687-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 20:59:05.876786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Releasing lock "refresh_cache-f1bb27b3-1a40-487e-af80-567547b3347a" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:59:05.877790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-93ed4fa7-9ace-4070-a77f-c023c20b9756 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a/action" status: 202 len: 0 microversion: 2.1 time: 5.120110 Apr 02 20:59:05.879025 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1233/2217] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:00 2022] POST /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a/action => generated 0 bytes in 5122 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 20:59:05.888640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:05.889304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:05.908526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:05.909034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:05.909843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:05.910294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:06.254464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:06.267957 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eaa3e9bd-8e3f-49ed-8831-20b60d69eecb tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.387817 Apr 02 20:59:06.278312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1234/2218] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:05 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:06.283442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d7a409c-497f-4771-9199-b7acb1fd1c23 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54da32e4c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:06.420798 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d7a409c-497f-4771-9199-b7acb1fd1c23 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.141052 Apr 02 20:59:06.427364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1235/2219] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:06 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:06.433552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:06.438460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'action', calling method: .version_select at 0x7f54d7554040>, body: {"removeFloatingIp": {"address": "172.35.4.99"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:06.442425 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-345b5fb6-ae55-4af1-873e-34eb067275e0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 1.473053 Apr 02 20:59:06.443024 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 985/2220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:04 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:06.462946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1d6038-17a9-4e87-9091-bac12977e2a7", "device": "/dev/xvdb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:06.465789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:06.498519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:06.499260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:06.500251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:06.501004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:06.875724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:06.884742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:06.885791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:06.886816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:06.887439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:07.011685 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71cb7978-eeef-40e0-a326-4a5280d5d404 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "POST /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.561285 Apr 02 20:59:07.013128 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 986/2221] 10.222.0.18 () {62 vars in 1363 bytes} [Sat Apr 2 20:59:06 2022] POST /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:07.039327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-175bee65-38f6-4862-a248-17469b9012d2 req-cc44a588-0cf5-49ac-9d2c-56952b123efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bb27b3-1a40-487e-af80-567547b3347a", "tag": "4883e687-c354-4cf9-9d83-3e9daec8775f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:07.075734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-175bee65-38f6-4862-a248-17469b9012d2 req-cc44a588-0cf5-49ac-9d2c-56952b123efd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:07.076234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-175bee65-38f6-4862-a248-17469b9012d2 req-cc44a588-0cf5-49ac-9d2c-56952b123efd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:07.099665 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-175bee65-38f6-4862-a248-17469b9012d2 req-cc44a588-0cf5-49ac-9d2c-56952b123efd service nova] Creating event network-changed:4883e687-c354-4cf9-9d83-3e9daec8775f for instance f1bb27b3-1a40-487e-af80-567547b3347a on nch1-master-1 Apr 02 20:59:07.106496 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-175bee65-38f6-4862-a248-17469b9012d2 req-cc44a588-0cf5-49ac-9d2c-56952b123efd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090844 Apr 02 20:59:07.106496 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 987/2222] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:07.130720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-27c3b1eb-5cb5-4716-9225-9e62f20a42c6 req-49d30a1c-ffd3-4a48-879c-dfa412c90911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010647f-dc6e-4a5e-9767-100a054b5fda", "name": "network-vif-plugged", "status": "completed", "tag": "2c343cee-04a3-4dee-907f-0bea1da0e4d1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:07.158863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27c3b1eb-5cb5-4716-9225-9e62f20a42c6 req-49d30a1c-ffd3-4a48-879c-dfa412c90911 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:07.159904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27c3b1eb-5cb5-4716-9225-9e62f20a42c6 req-49d30a1c-ffd3-4a48-879c-dfa412c90911 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:07.184247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-27c3b1eb-5cb5-4716-9225-9e62f20a42c6 req-49d30a1c-ffd3-4a48-879c-dfa412c90911 service nova] Creating event network-vif-plugged:2c343cee-04a3-4dee-907f-0bea1da0e4d1 for instance a010647f-dc6e-4a5e-9767-100a054b5fda on nch2-master-1 Apr 02 20:59:07.199260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-27c3b1eb-5cb5-4716-9225-9e62f20a42c6 req-49d30a1c-ffd3-4a48-879c-dfa412c90911 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089490 Apr 02 20:59:07.200095 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 988/2223] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:07.289526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:07.290506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:07.307861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:07.317066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:07.318154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:07.320158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:07.929652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:07.942328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9696a120-c600-4090-abb0-1e78d52312ff tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.657217 Apr 02 20:59:07.955112 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 989/2224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:07 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:07.955689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78957853-0314-42dd-9407-654dfabe14f5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d421c3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:08.064168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78957853-0314-42dd-9407-654dfabe14f5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.115249 Apr 02 20:59:08.064885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 990/2225] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:07 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:08.069877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:08.077250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:08.090751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:08.091648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:08.095099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:08.095841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:08.177101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] HTTP exception thrown: Floating IP 172.35.4.99 is not associated with instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1. Apr 02 20:59:08.177722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Returning 409 to user: Floating IP 172.35.4.99 is not associated with instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:59:08.178793 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c89a62d-f3a2-41b4-9aea-0cc141783c08 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action" status: 409 len: 145 microversion: 2.1 time: 1.750238 Apr 02 20:59:08.179925 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1236/2226] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:06 2022] POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action => generated 145 bytes in 1752 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 20:59:08.192538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.99"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:08.394707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:08.401589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:08.402187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:08.403089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:08.403648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:08.485246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:08.498528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c66df45-ef24-4ee9-9ac8-ad3f4c5760a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.432196 Apr 02 20:59:08.499234 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 991/2227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:08 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:08.963648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Acquired lock "refresh_cache-f1bb27b3-1a40-487e-af80-567547b3347a" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:59:08.970701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:08.972856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:08.982589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:08.983395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:08.984537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:08.985239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:09.221244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:09.230584 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8cda640e-8117-4b15-8308-21daba35d313 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.271554 Apr 02 20:59:09.231577 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 992/2228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:08 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:09.238267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e329ac3-5b3a-4e8b-a71d-168334ea36d8 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d436c310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:09.302381 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e329ac3-5b3a-4e8b-a71d-168334ea36d8 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.069588 Apr 02 20:59:09.303703 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 993/2229] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:09 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:09.309921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-76655ff9-08ec-45f7-a3e7-0c8aac0de310 req-9dd3ce10-cfe6-4221-a5ea-523c00b49f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "name": "network-vif-plugged", "status": "completed", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:09.323803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-76655ff9-08ec-45f7-a3e7-0c8aac0de310 req-9dd3ce10-cfe6-4221-a5ea-523c00b49f0d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:09.325096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-76655ff9-08ec-45f7-a3e7-0c8aac0de310 req-9dd3ce10-cfe6-4221-a5ea-523c00b49f0d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:09.337980 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-76655ff9-08ec-45f7-a3e7-0c8aac0de310 req-9dd3ce10-cfe6-4221-a5ea-523c00b49f0d service nova] Creating event network-vif-plugged:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 20:59:09.379241 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-76655ff9-08ec-45f7-a3e7-0c8aac0de310 req-9dd3ce10-cfe6-4221-a5ea-523c00b49f0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068732 Apr 02 20:59:09.380154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 994/2230] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:09.518576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:09.519443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:09.532241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:09.532748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:09.533770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:09.534605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:09.950590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:09.960602 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1bf7381e-406b-4f03-8b7a-33034e15d2a7 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.448832 Apr 02 20:59:09.972661 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 995/2231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:09 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:10.250037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:10.251155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:10.270255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:10.272405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:10.276934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:10.277785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:10.638707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:10.650499 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a9fc353-9a3d-422d-9d84-ca371a04ead1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1477 microversion: 2.1 time: 0.405737 Apr 02 20:59:10.651942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 996/2232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:10 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:10.664711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae6b55ac-3aad-48e0-984d-0b90b9eef9e5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d422bee0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:10.735180 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae6b55ac-3aad-48e0-984d-0b90b9eef9e5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.080625 Apr 02 20:59:10.738031 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 997/2233] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:10 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:10.751360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:10.751994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:10.764098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:10.764864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:10.765896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:10.766517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:11.011252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:11.044255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-da59e1da-539c-4d6b-bef6-323006d76128 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 2130 microversion: 2.25 time: 0.301302 Apr 02 20:59:11.057504 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 998/2234] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:10 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 2130 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:11.063227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:11.064071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:11.071174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:11.071872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:11.073248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:11.073871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:11.450443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:11.461878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-177fd161-e149-483b-b5e7-4a41a7e627e1 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1476 microversion: 2.1 time: 0.402623 Apr 02 20:59:11.465490 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 999/2235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:11 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:11.470596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:11.471815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:11.499672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:11.505174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:11.506275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:11.506987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:11.569753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'flavor' on Instance uuid 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:11.605005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Going to try to live migrate instance to nch1-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 20:59:12.042132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Building network info cache for instance {{(pid=136518) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 20:59:14.046524 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b8bc333-a21f-4a06-860d-fd9d52a258dc tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/action" status: 202 len: 0 microversion: 2.25 time: 2.579447 Apr 02 20:59:14.047862 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1000/2236] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 20:59:11 2022] POST /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/action => generated 0 bytes in 2582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:59:14.058600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:14.059554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:14.093582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:14.094346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:14.096120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:14.098091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:14.531694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:14.542269 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aa9deb9f-68b6-400f-925e-9acc9a9afe00 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1463 microversion: 2.1 time: 0.488658 Apr 02 20:59:14.550263 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1001/2237] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:14 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1463 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:14.559670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7cb3d5fa-1ca2-424a-913d-784c187ca691 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d41b53a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:14.641582 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7cb3d5fa-1ca2-424a-913d-784c187ca691 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.089582 Apr 02 20:59:14.642541 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1002/2238] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:14 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:14.651774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-4eef70c5-1867-40a3-b8ab-5778e6a6d435 req-275b12ea-8559-4b51-b5c5-780fd9ef3d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bb27b3-1a40-487e-af80-567547b3347a", "tag": "4883e687-c354-4cf9-9d83-3e9daec8775f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:14.675618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4eef70c5-1867-40a3-b8ab-5778e6a6d435 req-275b12ea-8559-4b51-b5c5-780fd9ef3d02 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:14.685469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4eef70c5-1867-40a3-b8ab-5778e6a6d435 req-275b12ea-8559-4b51-b5c5-780fd9ef3d02 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:14.729911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4eef70c5-1867-40a3-b8ab-5778e6a6d435 req-275b12ea-8559-4b51-b5c5-780fd9ef3d02 service nova] Creating event network-changed:4883e687-c354-4cf9-9d83-3e9daec8775f for instance f1bb27b3-1a40-487e-af80-567547b3347a on nch1-master-1 Apr 02 20:59:14.741196 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-4eef70c5-1867-40a3-b8ab-5778e6a6d435 req-275b12ea-8559-4b51-b5c5-780fd9ef3d02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092091 Apr 02 20:59:14.743445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1003/2239] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:14.771306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:14.772107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:14.796564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:14.802378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:14.813942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:14.816703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:14.926942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Updating instance_info_cache with network_info: [{"id": "4883e687-c354-4cf9-9d83-3e9daec8775f", "address": "fa:16:3e:7c:20:ba", "network": {"id": "58fa3672-fa03-4f54-a24a-d36533b2e021", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424298643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0e22715a8e849e0871b68d772ed29fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4883e687-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 20:59:14.954089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Releasing lock "refresh_cache-f1bb27b3-1a40-487e-af80-567547b3347a" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:59:14.957215 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a1401a5-a35f-460a-b915-fbc70d49d3c0 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a/action" status: 202 len: 0 microversion: 2.1 time: 6.768041 Apr 02 20:59:14.961029 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1237/2240] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:08 2022] POST /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a/action => generated 0 bytes in 6774 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 20:59:14.989039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:14.994659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:15.029641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:15.033726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:15.035759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:15.036626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:15.420232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:15.432205 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-238fbbbc-e0ee-43cc-b1b8-30e258d43804 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1475 microversion: 2.1 time: 0.673720 Apr 02 20:59:15.448008 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1004/2241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:14 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1475 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:15.461000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:15.463222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:15.475488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:15.475951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:15.476781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:15.477226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:15.642986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:15.658470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:15.661254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:15.662836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78fd958d-77d4-4d70-a921-e1e7bbd7c172 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.700175 Apr 02 20:59:15.675912 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1238/2242] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:14 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:15.733189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:15.757054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:15.782425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:15.783599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:15.800146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:15.804678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:15.868327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:59:16.079033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d41e323-fd4d-44db-8138-86cc970b3839 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 204 len: 0 microversion: 2.1 time: 0.401070 Apr 02 20:59:16.079781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1239/2243] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:59:15 2022] DELETE /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:59:16.086419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90b23167-b84f-4a86-8cce-03fc76dd8dd9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54da20eaf0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:16.163017 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90b23167-b84f-4a86-8cce-03fc76dd8dd9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.076350 Apr 02 20:59:16.175507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:16.185925 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1240/2244] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:16 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:16.191565 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf8ba26c-c8c3-4a39-8e0c-38c62f1014f2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1463 microversion: 2.1 time: 0.739962 Apr 02 20:59:16.193626 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1005/2245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:15 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1463 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:16.226492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.99"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:16.227988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:16.254131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:16.257303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:16.258343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:16.258960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:16.336944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Acquired lock "refresh_cache-931c470e-0eeb-4c37-8757-1d3aef81b2d1" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:59:16.362724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-74c5d65f-09b6-4a4d-bb38-5021ddae7d96 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'create', calling method: .version_select at 0x7f54d45a4700>, body: {"keypair": {"name": "tempest-keypair-82577945"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:16.410302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-74c5d65f-09b6-4a4d-bb38-5021ddae7d96 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:59:16.422520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-74c5d65f-09b6-4a4d-bb38-5021ddae7d96 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for user eaa8ffe0235f4759bdb071a51ad51410 and project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:59:16.998814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-74c5d65f-09b6-4a4d-bb38-5021ddae7d96 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:59:17.007415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-74c5d65f-09b6-4a4d-bb38-5021ddae7d96 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for user eaa8ffe0235f4759bdb071a51ad51410 and project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:59:17.026560 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-74c5d65f-09b6-4a4d-bb38-5021ddae7d96 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.835393 Apr 02 20:59:17.027796 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1241/2246] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 20:59:16 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 841 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 20:59:17.058952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:17.062202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:17.091342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:17.094431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:17.096181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:17.097788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:17.338390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:59:17.345687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:59:17.347896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:59:17.349401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:59:17.351254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:59:17.538188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:17.557787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:17.562882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:17.565215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:17.565788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:17.677929 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e3dc8789-cfcc-4a09-a4a6-aa81c9e48fc3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 1067 microversion: 2.1 time: 0.648501 Apr 02 20:59:17.678608 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1242/2247] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:17 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 1067 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 02 20:59:17.717403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:17.726348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:17.751949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:17.752414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:17.759999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:17.760659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:18.309696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:18.330155 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16c7a4d2-0904-4dca-9f7d-699b36d1044b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1473 microversion: 2.1 time: 0.639516 Apr 02 20:59:18.336170 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1243/2248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:17 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1473 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:18.350287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:18.362939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:18.376633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:18.377205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:18.378850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:18.379299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:18.735207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:18.754733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:18.758271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:18.763619 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-15c9811d-7fdd-4968-a5df-273a654ed338 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.426320 Apr 02 20:59:18.767286 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1244/2249] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:18 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:18.779240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "name": "network-vif-unplugged", "status": "completed", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}, {"name": "network-changed", "server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:18.809216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:18.811252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:18.843415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] Creating event network-vif-unplugged:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch1-master-1 Apr 02 20:59:18.844700 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] Creating event network-changed:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch1-master-1 Apr 02 20:59:18.861758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] Instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:59:18.895523 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-69dbcfab-d573-49d5-9148-61acc44dbcca req-a7595faa-74ef-4d9c-87b2-7e7c5f51cc45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.126544 Apr 02 20:59:18.896303 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1245/2250] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:18.907746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cc9892be-da64-476a-83bd-3ee6d3db84f3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4569ee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:19.041465 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cc9892be-da64-476a-83bd-3ee6d3db84f3 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.143927 Apr 02 20:59:19.046268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1246/2251] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:18 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:19.061001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:19.061759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:19.099204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:19.099650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:19.114597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:19.115067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:20.272308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:20.287888 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea8c6891-6f0a-4c5b-b9fe-b27e6d93f3db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 1.239547 Apr 02 20:59:20.290278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1247/2252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:19 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:20.298573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:20.312615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:20.350610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:20.351286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:20.356181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:20.361176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:20.950169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:20.981518 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2dbf1d7c-8b73-4efd-bfe8-3256ec0d6307 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1473 microversion: 2.1 time: 0.689694 Apr 02 20:59:20.982106 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1248/2253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:20 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1473 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:21.010663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:21.020222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:21.044096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:21.044599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:21.045415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:21.045870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:21.345563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Building network info cache for instance {{(pid=136517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 20:59:21.572283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:21.587091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:21.596274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:21.600091 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31f1c1c5-35bf-4edf-8328-6e723686b6c7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.615654 Apr 02 20:59:21.618877 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1249/2254] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:20 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:21.631164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4fa18737-7366-4d37-a23a-985c3109f453 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4553430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:21.777992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4fa18737-7366-4d37-a23a-985c3109f453 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.157465 Apr 02 20:59:21.778590 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1250/2255] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:21 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:21.822380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7c2d3666-f14a-449d-82dc-845ca5ae551a req-049fd662-436d-474a-b7c8-2da812a8aef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bb27b3-1a40-487e-af80-567547b3347a", "name": "network-vif-deleted", "tag": "4883e687-c354-4cf9-9d83-3e9daec8775f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:21.868448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7c2d3666-f14a-449d-82dc-845ca5ae551a req-049fd662-436d-474a-b7c8-2da812a8aef2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:21.872772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7c2d3666-f14a-449d-82dc-845ca5ae551a req-049fd662-436d-474a-b7c8-2da812a8aef2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:21.929710 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7c2d3666-f14a-449d-82dc-845ca5ae551a req-049fd662-436d-474a-b7c8-2da812a8aef2 service nova] Creating event network-vif-deleted:4883e687-c354-4cf9-9d83-3e9daec8775f for instance f1bb27b3-1a40-487e-af80-567547b3347a on nch1-master-1 Apr 02 20:59:21.954618 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7c2d3666-f14a-449d-82dc-845ca5ae551a req-049fd662-436d-474a-b7c8-2da812a8aef2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174555 Apr 02 20:59:21.955731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1251/2256] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:21.962023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:21.963047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:21.989532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:21.995183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:21.996740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:21.997797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:22.398723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:22.418608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea52a43a-ea9e-49a8-8800-9d8d370aeba0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.451376 Apr 02 20:59:22.419751 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1252/2257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:21 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:22.424952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:22.425891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:22.442541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:22.443399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:22.444502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:22.445437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:22.878522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:22.886332 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ffb8d8c-c46b-49f7-921e-7b1daad9645e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1470 microversion: 2.1 time: 0.465119 Apr 02 20:59:22.889104 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1253/2258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:22 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:22.906202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-17efca35-f03e-4180-ba84-fb19045fc682 req-52ce7b80-94c1-4298-886c-2f75bf23dcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6f315a-5c0b-48ec-9e78-16942df1a9f7", "name": "network-vif-unplugged", "status": "completed", "tag": "12334738-596e-4bda-85ff-6807e7a908f4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:22.927083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-17efca35-f03e-4180-ba84-fb19045fc682 req-52ce7b80-94c1-4298-886c-2f75bf23dcac service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:22.929414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-17efca35-f03e-4180-ba84-fb19045fc682 req-52ce7b80-94c1-4298-886c-2f75bf23dcac service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:22.958101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-17efca35-f03e-4180-ba84-fb19045fc682 req-52ce7b80-94c1-4298-886c-2f75bf23dcac service nova] Creating event network-vif-unplugged:12334738-596e-4bda-85ff-6807e7a908f4 for instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 on nch2-master-1 Apr 02 20:59:22.967557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-17efca35-f03e-4180-ba84-fb19045fc682 req-52ce7b80-94c1-4298-886c-2f75bf23dcac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072369 Apr 02 20:59:22.970558 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1254/2259] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:22.981759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:22.987397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:23.000322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.000825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.003393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.003829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.054631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Updating instance_info_cache with network_info: [{"id": "8ccfbe04-805d-49bd-88f1-b591034caed3", "address": "fa:16:3e:31:fc:4c", "network": {"id": "58fa3672-fa03-4f54-a24a-d36533b2e021", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424298643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0e22715a8e849e0871b68d772ed29fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ccfbe04-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 20:59:23.074459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Releasing lock "refresh_cache-931c470e-0eeb-4c37-8757-1d3aef81b2d1" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:59:23.075601 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c31e7751-301f-4584-87e4-2ad81953f3cd tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action" status: 202 len: 0 microversion: 2.1 time: 6.878106 Apr 02 20:59:23.076697 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1006/2260] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:16 2022] POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action => generated 0 bytes in 6882 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 20:59:23.081832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c89842a-e188-47b1-abc6-a5ae4f14f52f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4215940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:23.164710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c89842a-e188-47b1-abc6-a5ae4f14f52f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.086692 Apr 02 20:59:23.165313 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1007/2261] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:23 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:23.183108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:23.183660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:23.209803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.210332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.211145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.211590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.290259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:23.306131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:23.312177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:23.334668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-805db813-1d96-41ec-80e0-b9fdc34f2fc3 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.351129 Apr 02 20:59:23.344029 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1255/2262] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:22 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:23.351382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-344d18e4-5ad0-4df7-896d-234142cc97e9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '.version_select at 0x7f54da32ec10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:23.478185 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e633caa2-faaa-4d5f-bbb7-8f938e2e07e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "POST /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7/action" status: 202 len: 0 microversion: 2.1 time: 0.311410 Apr 02 20:59:23.479444 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1008/2263] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:23 2022] POST /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:59:23.492844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:23.495253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:23.507446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.509752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.512682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.513664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.797697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:23.812330 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efe510e5-5d34-4770-99ed-e5f3345c3020 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.330115 Apr 02 20:59:23.815723 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1009/2264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:23 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:23.837497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:23.838477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:23.853615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.855174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:23.857325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:23.857896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:24.208690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-344d18e4-5ad0-4df7-896d-234142cc97e9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/c680001a-5420-4180-b8a7-5aa059fa3d4c" status: 200 len: 184 microversion: 2.1 time: 0.860990 Apr 02 20:59:24.209809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1256/2265] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 20:59:23 2022] GET /compute/v2.1/os-floating-ips/c680001a-5420-4180-b8a7-5aa059fa3d4c => generated 184 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:24.215893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1210504018", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d11c371b-654f-45ff-8edf-711168f9f05b"}], "security_groups": [{"name": "tempest-securitygroup--1507119590"}], "key_name": "tempest-keypair-82577945", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:24.224492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:24.245383 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0723d6b5-36ae-4dc2-8479-7dd95788fe5f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1469 microversion: 2.1 time: 0.426892 Apr 02 20:59:24.261492 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1010/2266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:23 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:24.272556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-51b5fcfd-c4ef-41b3-955a-8df392835e3c req-4d75a7e1-2c43-4b22-9a53-9c4236aeaef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:24.291539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-51b5fcfd-c4ef-41b3-955a-8df392835e3c req-4d75a7e1-2c43-4b22-9a53-9c4236aeaef9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:24.292702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-51b5fcfd-c4ef-41b3-955a-8df392835e3c req-4d75a7e1-2c43-4b22-9a53-9c4236aeaef9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:24.318555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-51b5fcfd-c4ef-41b3-955a-8df392835e3c req-4d75a7e1-2c43-4b22-9a53-9c4236aeaef9 service nova] Creating event network-changed:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:59:24.328149 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-51b5fcfd-c4ef-41b3-955a-8df392835e3c req-4d75a7e1-2c43-4b22-9a53-9c4236aeaef9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064739 Apr 02 20:59:24.329853 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1011/2267] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:24.338740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44b93f04-41f5-46fa-ba41-f4d71b13c813 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d41dc700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:24.488317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44b93f04-41f5-46fa-ba41-f4d71b13c813 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.155101 Apr 02 20:59:24.501720 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1012/2268] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:24 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:24.532602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Action: 'action', calling method: .version_select at 0x7f54d76105e0>, body: {"removeFloatingIp": {"address": "172.35.4.99"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:24.831986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] validate_networks() for [('d11c371b-654f-45ff-8edf-711168f9f05b', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:59:25.186258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:25.194475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:25.195975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:25.199958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:25.200828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:25.604180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Acquired lock "refresh_cache-931c470e-0eeb-4c37-8757-1d3aef81b2d1" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 20:59:25.973144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:59:25.974224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:59:25.974964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:59:25.975620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:59:25.976290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:59:25.998034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.008012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.009164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.010818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.048907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:59:26.054661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for user eaa8ffe0235f4759bdb071a51ad51410 and project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:59:26.070493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:59:26.074900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:59:26.149244 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5a59216-5827-4be3-84e1-5ee9ed404eb5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.937979 Apr 02 20:59:26.152998 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1257/2269] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 20:59:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 20:59:26.164805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:26.174788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:26.181956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.189779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.190963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.191737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.497837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:26.507411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:26.515104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:26.516379 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-82a3f4f6-b2cb-4431-ac19-132250ba645a tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.362143 Apr 02 20:59:26.516975 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1258/2270] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:26 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:26.548328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:26.550985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:26.560144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.560726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.561521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.561966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.868858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:26.881321 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80a09ca1-4fc1-40fe-aac8-a5250ca71604 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.341376 Apr 02 20:59:26.882235 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1259/2271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:26 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:26.887910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d3830d6b-9e28-4bbf-9e68-4d278a3dd44d req-1410e400-0bcb-4396-a2e6-69853f65675f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a6f315a-5c0b-48ec-9e78-16942df1a9f7", "tag": "12334738-596e-4bda-85ff-6807e7a908f4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:26.905425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d3830d6b-9e28-4bbf-9e68-4d278a3dd44d req-1410e400-0bcb-4396-a2e6-69853f65675f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.909911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d3830d6b-9e28-4bbf-9e68-4d278a3dd44d req-1410e400-0bcb-4396-a2e6-69853f65675f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.937182 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d3830d6b-9e28-4bbf-9e68-4d278a3dd44d req-1410e400-0bcb-4396-a2e6-69853f65675f service nova] Creating event network-changed:12334738-596e-4bda-85ff-6807e7a908f4 for instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 on nch2-master-1 Apr 02 20:59:26.953240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d3830d6b-9e28-4bbf-9e68-4d278a3dd44d req-1410e400-0bcb-4396-a2e6-69853f65675f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069510 Apr 02 20:59:26.954256 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1260/2272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:26.963568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:26.967134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:26.974690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.975964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:26.977110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:26.977773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:27.288722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:27.301006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a46a4311-ba0e-4841-aacb-b9579f80f964 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1469 microversion: 2.1 time: 0.343544 Apr 02 20:59:27.306161 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1261/2273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:26 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:27.312177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e25232a-80c4-4f3a-abc5-de8318f4d777 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45deb80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:27.397345 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e25232a-80c4-4f3a-abc5-de8318f4d777 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.089887 Apr 02 20:59:27.405787 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1262/2274] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:27 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:27.415306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:27.417540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:27.429317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:27.430134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:27.431197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:27.432033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:27.562875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:27.575604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:27.594439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:27.603200 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1570aa78-a49f-4b62-ab16-3971c035bdce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1276 microversion: 2.20 time: 0.190756 Apr 02 20:59:27.604356 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1263/2275] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:27 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:27.623576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-bae9d4c9-de15-4759-933a-2d3319ff2c16 req-d55f3cd5-1918-4b95-abcf-5a9a5f2262d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "name": "network-vif-plugged", "status": "completed", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:27.638230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bae9d4c9-de15-4759-933a-2d3319ff2c16 req-d55f3cd5-1918-4b95-abcf-5a9a5f2262d5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:27.639397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bae9d4c9-de15-4759-933a-2d3319ff2c16 req-d55f3cd5-1918-4b95-abcf-5a9a5f2262d5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:27.663464 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-bae9d4c9-de15-4759-933a-2d3319ff2c16 req-d55f3cd5-1918-4b95-abcf-5a9a5f2262d5 service nova] Creating event network-vif-plugged:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch1-master-1 Apr 02 20:59:27.698938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-bae9d4c9-de15-4759-933a-2d3319ff2c16 req-d55f3cd5-1918-4b95-abcf-5a9a5f2262d5 service nova] Instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:59:27.738131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-bae9d4c9-de15-4759-933a-2d3319ff2c16 req-d55f3cd5-1918-4b95-abcf-5a9a5f2262d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130288 Apr 02 20:59:27.739609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1264/2276] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:27.753600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:27.754476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:27.765638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:27.766155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:27.766955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:27.768602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:27.882786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Building network info cache for instance {{(pid=136517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 20:59:28.184120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:28.201601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:28.204934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:28.207289 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dca163d2-a23e-4995-8b3c-331c3ad282e5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.465926 Apr 02 20:59:28.208666 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1265/2277] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:27 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:28.214539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c9d45659-1a13-4825-b545-83b01862bf23 req-4902e4ce-0ec6-43c7-bc3d-85da413294f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:28.231109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c9d45659-1a13-4825-b545-83b01862bf23 req-4902e4ce-0ec6-43c7-bc3d-85da413294f5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:28.232572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c9d45659-1a13-4825-b545-83b01862bf23 req-4902e4ce-0ec6-43c7-bc3d-85da413294f5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:28.252398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c9d45659-1a13-4825-b545-83b01862bf23 req-4902e4ce-0ec6-43c7-bc3d-85da413294f5 service nova] Creating event network-changed:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:59:28.261742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c9d45659-1a13-4825-b545-83b01862bf23 req-4902e4ce-0ec6-43c7-bc3d-85da413294f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050248 Apr 02 20:59:28.263566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1266/2278] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:28.275032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:28.282098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:28.307209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:28.311720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:28.312947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:28.315129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:28.664973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:28.673945 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7db4c32-3228-4600-b48a-b91ed7763b22 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.408444 Apr 02 20:59:28.691019 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1267/2279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:28 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:28.712818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:28.713461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:28.728806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:28.729272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:28.731242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:28.731733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:29.327527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:29.340787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d22ba85d-83b3-4585-829a-97df20e8efde tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1469 microversion: 2.1 time: 0.645535 Apr 02 20:59:29.343971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1268/2280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:28 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1469 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:29.354349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81d01054-a451-4ffb-9d98-c49e0cf02d8e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45de0d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:29.486162 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81d01054-a451-4ffb-9d98-c49e0cf02d8e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1411 microversion: 2.1 time: 0.140621 Apr 02 20:59:29.492626 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1269/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:29 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:29.505734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:29.506381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:29.529068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:29.530406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:29.532829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:29.533293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:29.780715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:29.790204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:29.791728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:29.803928 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e4d0dec-f1a4-4b4e-99f3-eccff01eaa08 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1338 microversion: 2.20 time: 0.299153 Apr 02 20:59:29.805029 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1270/2282] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:29 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1338 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:29.827008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:29.828241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:29.842884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:29.844962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:29.845879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:29.848582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:30.637867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:30.654682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:30.661877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:30.663575 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5b2ea0b-8ffd-4286-b6ba-bddc8cb95754 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.845020 Apr 02 20:59:30.664980 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1271/2283] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:29 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:30.681780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:30.682675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:30.694333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:30.694852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:30.708164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:30.708684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:30.880685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:30.894738 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ff38ef0-88a5-4594-bbb8-8a76fa90e1c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.228334 Apr 02 20:59:30.895436 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1272/2284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:30 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:30.901327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:30.902245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:30.909606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:30.910605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:30.911998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:30.912905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.118219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:31.128026 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51beec14-3587-4d26-ab38-de83491c01dd tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1469 microversion: 2.1 time: 0.231055 Apr 02 20:59:31.139532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1273/2285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:30 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:31.146652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d6b78ce-9e9f-40f2-8dd0-694afa0bd003 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45de670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:31.153784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Updating instance_info_cache with network_info: [{"id": "8ccfbe04-805d-49bd-88f1-b591034caed3", "address": "fa:16:3e:31:fc:4c", "network": {"id": "58fa3672-fa03-4f54-a24a-d36533b2e021", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-424298643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d0e22715a8e849e0871b68d772ed29fd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ccfbe04-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 20:59:31.162756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Releasing lock "refresh_cache-931c470e-0eeb-4c37-8757-1d3aef81b2d1" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 20:59:31.163630 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6b9404a-2cac-44f2-a0e4-28db4b1782e5 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action" status: 202 len: 0 microversion: 2.1 time: 6.651291 Apr 02 20:59:31.164418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1013/2286] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:24 2022] POST /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1/action => generated 0 bytes in 6662 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 20:59:31.179284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c97a7771-52a3-413f-8b5e-5f39a43b73e3 req-ccf7c0b2-1d62-45d2-bea5-e7ddc062da58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "name": "network-vif-unplugged", "status": "completed", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:31.195661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c97a7771-52a3-413f-8b5e-5f39a43b73e3 req-ccf7c0b2-1d62-45d2-bea5-e7ddc062da58 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.195979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c97a7771-52a3-413f-8b5e-5f39a43b73e3 req-ccf7c0b2-1d62-45d2-bea5-e7ddc062da58 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.215432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d6b78ce-9e9f-40f2-8dd0-694afa0bd003 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1420 microversion: 2.1 time: 0.074093 Apr 02 20:59:31.216615 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1274/2287] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:31 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:31.222469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:31.225176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:31.231254 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c97a7771-52a3-413f-8b5e-5f39a43b73e3 req-ccf7c0b2-1d62-45d2-bea5-e7ddc062da58 service nova] Creating event network-vif-unplugged:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch2-master-1 Apr 02 20:59:31.232988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.233715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.235473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.236181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.240794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-c97a7771-52a3-413f-8b5e-5f39a43b73e3 req-ccf7c0b2-1d62-45d2-bea5-e7ddc062da58 service nova] Instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:59:31.254631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c97a7771-52a3-413f-8b5e-5f39a43b73e3 req-ccf7c0b2-1d62-45d2-bea5-e7ddc062da58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089077 Apr 02 20:59:31.255917 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1014/2288] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:31.265460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:31.266146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:31.273065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.273526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.274318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.274763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.294125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] HTTP exception thrown: Instance f1bb27b3-1a40-487e-af80-567547b3347a could not be found. Apr 02 20:59:31.294981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Returning 404 to user: Instance f1bb27b3-1a40-487e-af80-567547b3347a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:59:31.296052 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-929cd429-ddd6-41fb-b797-134089aba79b tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 404 len: 111 microversion: 2.1 time: 0.038986 Apr 02 20:59:31.297472 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1015/2289] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:59:31 2022] DELETE /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:59:31.305473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cce35db6-9c19-4f8d-8664-6ee42bda6a15 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d41b5dc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:31.344897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:31.353442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:31.354975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:31.356102 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c9b16ca6-3baa-49dd-999f-04765949fe59 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1338 microversion: 2.20 time: 0.138313 Apr 02 20:59:31.359182 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1275/2290] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:31 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1338 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:31.365473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:31.370715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: f1bb27b3-1a40-487e-af80-567547b3347a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:31.387147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.388531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.389525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:31.390188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:31.396932 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cce35db6-9c19-4f8d-8664-6ee42bda6a15 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 200 len: 1420 microversion: 2.1 time: 0.097369 Apr 02 20:59:31.397872 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1016/2291] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:31 2022] GET /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:31.406262 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] HTTP exception thrown: Instance f1bb27b3-1a40-487e-af80-567547b3347a could not be found. Apr 02 20:59:31.406957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Returning 404 to user: Instance f1bb27b3-1a40-487e-af80-567547b3347a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:59:31.407893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c98a229-630c-4d43-ac79-3aca2cebdf29 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a" status: 404 len: 111 microversion: 2.1 time: 0.046647 Apr 02 20:59:31.408897 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1276/2292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:31 2022] GET /compute/v2.1/servers/f1bb27b3-1a40-487e-af80-567547b3347a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:59:31.411699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3a47d3c-b6ce-488c-b6ca-a1a300a074fe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d42db790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:31.416607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d0cab05-69cc-4936-8509-391be34f56c4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '.version_select at 0x7f54da376ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:32.692629 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3a47d3c-b6ce-488c-b6ca-a1a300a074fe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 204 len: 0 microversion: 2.1 time: 1.285269 Apr 02 20:59:32.694462 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1017/2293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:31 2022] DELETE /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 0 bytes in 1288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:59:32.703558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:32.704764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:32.717164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:32.717729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:32.719278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:32.719924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.031247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d0cab05-69cc-4936-8509-391be34f56c4 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/c680001a-5420-4180-b8a7-5aa059fa3d4c" status: 202 len: 0 microversion: 2.1 time: 1.618182 Apr 02 20:59:33.031854 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1277/2294] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 20:59:31 2022] DELETE /compute/v2.1/os-floating-ips/c680001a-5420-4180-b8a7-5aa059fa3d4c => generated 0 bytes in 1620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:59:33.037325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:33.038192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:33.052117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.055346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.059592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.060255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.189419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.224525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.229197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.234209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-720a9fc8-c84d-4aaa-aa43-9c513b759bef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.537841 Apr 02 20:59:33.235765 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1018/2295] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:32 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:33.247317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:33.249815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:33.266490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.267061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.269238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.269917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.367476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.376745 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1238c6f8-ed95-4d55-a5fb-523a6ee1899b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.343790 Apr 02 20:59:33.378241 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1278/2296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:33 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:33.384556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:33.386092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:33.394325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.395057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.396799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.397449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.669919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.681085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.682472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.683643 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4cc0ce4c-2a71-4352-86dc-2e530371b95c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1406 microversion: 2.20 time: 0.303771 Apr 02 20:59:33.684580 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1279/2297] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:33 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:33.689616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:33.690320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:33.702507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.703645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.707553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.708946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.712390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:33.722287 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0636328-dfdd-4a1d-adff-26de4f9bbbc9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1469 microversion: 2.1 time: 0.482020 Apr 02 20:59:33.723267 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1019/2298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:33 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1469 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:33.730391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:33.732084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:33.744149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.745112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.746331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.747043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.749927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:59:33.779159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:59:33.890077 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad388318-053f-4c71-8158-48da40ca56f9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "DELETE /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 204 len: 0 microversion: 2.1 time: 0.165058 Apr 02 20:59:33.891751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1020/2299] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:59:33 2022] DELETE /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:59:33.901261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a65aff3d-ddda-44d9-8ad6-006497927d34 req-ad0b96b1-e518-4bdb-acd9-c09c28fe94b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:33.911588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a65aff3d-ddda-44d9-8ad6-006497927d34 req-ad0b96b1-e518-4bdb-acd9-c09c28fe94b0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.912432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a65aff3d-ddda-44d9-8ad6-006497927d34 req-ad0b96b1-e518-4bdb-acd9-c09c28fe94b0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.927858 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a65aff3d-ddda-44d9-8ad6-006497927d34 req-ad0b96b1-e518-4bdb-acd9-c09c28fe94b0 service nova] Creating event network-changed:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch2-master-1 Apr 02 20:59:33.934484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-a65aff3d-ddda-44d9-8ad6-006497927d34 req-ad0b96b1-e518-4bdb-acd9-c09c28fe94b0 service nova] Instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 20:59:33.947634 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a65aff3d-ddda-44d9-8ad6-006497927d34 req-ad0b96b1-e518-4bdb-acd9-c09c28fe94b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053891 Apr 02 20:59:33.949007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1021/2300] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:33.955442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ced2fc21-d61d-460e-9516-e041e6f44347 req-548dd4d1-6e85-4166-9591-00f632c55acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010647f-dc6e-4a5e-9767-100a054b5fda", "name": "network-vif-unplugged", "status": "completed", "tag": "2c343cee-04a3-4dee-907f-0bea1da0e4d1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:33.967141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ced2fc21-d61d-460e-9516-e041e6f44347 req-548dd4d1-6e85-4166-9591-00f632c55acf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:33.967141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ced2fc21-d61d-460e-9516-e041e6f44347 req-548dd4d1-6e85-4166-9591-00f632c55acf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:33.972329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b637f13-45e8-4351-9a2e-3fd40f3bc191 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 204 len: 0 microversion: 2.1 time: 0.286154 Apr 02 20:59:33.976752 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1280/2301] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:59:33 2022] DELETE /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:59:34.000495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:34.008860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:34.014184 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ced2fc21-d61d-460e-9516-e041e6f44347 req-548dd4d1-6e85-4166-9591-00f632c55acf service nova] Creating event network-vif-unplugged:2c343cee-04a3-4dee-907f-0bea1da0e4d1 for instance a010647f-dc6e-4a5e-9767-100a054b5fda on nch2-master-1 Apr 02 20:59:34.030200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:34.037291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:34.037892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ced2fc21-d61d-460e-9516-e041e6f44347 req-548dd4d1-6e85-4166-9591-00f632c55acf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082122 Apr 02 20:59:34.038754 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1022/2302] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:34.039432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:34.040299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:34.141664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1389664742", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "f2d4ece6-a97d-4f79-921c-5a419ec5ae76"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:34.212396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] validate_networks() for [('f2d4ece6-a97d-4f79-921c-5a419ec5ae76', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:59:34.495287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:34.505103 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10d185c2-23ed-4c7d-a6d8-295862d6c9a9 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1525 microversion: 2.1 time: 0.526979 Apr 02 20:59:34.506118 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1281/2303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:33 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1525 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:34.512196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:34.513153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:34.519911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:34.520669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:34.521455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:34.522110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:34.797087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:34.815001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:34.816600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:34.817804 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-786a3fba-f527-4615-9f45-c80532382d43 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1647 microversion: 2.25 time: 0.310290 Apr 02 20:59:34.828482 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1282/2304] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:34 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1647 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:34.828482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:34.828482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:34.830919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:34.832130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:34.833466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:34.833938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.150193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:35.166474 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b63ca56-b773-4483-ac87-65cd5a138036 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.346670 Apr 02 20:59:35.167077 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1283/2305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:34 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:35.171767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:35.172388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:35.187512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.188199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.189228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.189887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.302488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:59:35.304017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:59:35.304696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:59:35.305626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:59:35.306212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:59:35.325242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.326218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.327030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.327638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.348320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:35.359457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:35.362455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:35.363844 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8c416fe-c28e-4794-bd74-aa13f7bf32e8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1406 microversion: 2.20 time: 0.195804 Apr 02 20:59:35.368003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:59:35.373526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for user 2e7bca7cae174c2c9b83217ea73a973e and project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:59:35.385351 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1284/2306] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:35 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:35.388054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:59:35.390644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:59:35.397410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:35.398298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:35.404606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.405100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.405892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.406334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.486852 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78425b57-253a-4ca5-9cab-6efeabf4ce14 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349364 Apr 02 20:59:35.487615 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1023/2307] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 20:59:35.498877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a497047c-004c-4f59-a838-4950eed1bad1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:35.499814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a497047c-004c-4f59-a838-4950eed1bad1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:35.592212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a497047c-004c-4f59-a838-4950eed1bad1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:35.601133 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a497047c-004c-4f59-a838-4950eed1bad1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1208 microversion: 2.1 time: 0.106654 Apr 02 20:59:35.603260 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1024/2308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:35 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1208 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:35.617915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:35.619691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:35.638146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.638623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.641055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:35.641543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:35.681267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:35.691733 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-93fc28be-dd9e-469b-9b18-416c22610b52 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1462 microversion: 2.1 time: 0.304884 Apr 02 20:59:35.700501 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1285/2309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:35 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1462 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:36.103720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:36.104353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:36.117610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.118040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.120619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.125923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.368615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:36.381552 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d8467c92-442d-4130-a0ef-6de46af4a20f tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1525 microversion: 2.1 time: 0.773082 Apr 02 20:59:36.383003 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1025/2310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:35 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1525 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:36.405781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:36.406889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:36.416683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.418134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.422347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.423367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.629369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:36.640978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:36.643287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:36.645108 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0faa62d-2caf-4f6a-aaad-3c639fd9d83d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1637 microversion: 2.25 time: 0.261103 Apr 02 20:59:36.648215 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1026/2311] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:36 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1637 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:36.654285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-de6cfc16-a493-4947-aed4-15affec859b9 req-7d179657-f563-4cec-b3a8-8661e59aa23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:36.669337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de6cfc16-a493-4947-aed4-15affec859b9 req-7d179657-f563-4cec-b3a8-8661e59aa23e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.670243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de6cfc16-a493-4947-aed4-15affec859b9 req-7d179657-f563-4cec-b3a8-8661e59aa23e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.688641 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-de6cfc16-a493-4947-aed4-15affec859b9 req-7d179657-f563-4cec-b3a8-8661e59aa23e service nova] Creating event network-changed:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch2-master-1 Apr 02 20:59:36.696168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-de6cfc16-a493-4947-aed4-15affec859b9 req-7d179657-f563-4cec-b3a8-8661e59aa23e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045575 Apr 02 20:59:36.696957 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1027/2312] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:36.706484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:36.707200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:36.715185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.715803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.716653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:36.717106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:36.999415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:37.009335 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e88d4676-548e-4ee1-9a96-1de20a1b4665 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.308209 Apr 02 20:59:37.010152 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1028/2313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:36 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:37.027892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.028608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.028753 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48021fa8-664f-4b08-85f1-e52f1539b60b tempest-MigrationsAdminTest-1575768771 tempest-MigrationsAdminTest-1575768771-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1613 microversion: 2.1 time: 1.321098 Apr 02 20:59:37.031647 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1286/2314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:35 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1613 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:37.052276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.052276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.052276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.052276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.061443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.067668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.089406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.093138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.093956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.094409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.201191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:37.216110 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8427d9b1-fafd-4692-b8ed-27510ea5d284 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1260 microversion: 2.1 time: 0.178413 Apr 02 20:59:37.216734 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1287/2315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:37.229265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-995a1838-26e1-4160-bab7-5c72f18e5c44 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '.version_select at 0x7f54d45cf040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.233623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-995a1838-26e1-4160-bab7-5c72f18e5c44 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.234348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-995a1838-26e1-4160-bab7-5c72f18e5c44 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.246562 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-995a1838-26e1-4160-bab7-5c72f18e5c44 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2966 microversion: 2.25 time: 0.021929 Apr 02 20:59:37.247369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1288/2316] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/os-migrations => generated 2966 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:37.254389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.255209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.263720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.264511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.266814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.267450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.304049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:59:37.429813 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e3d7b7c-5953-496e-90c5-6e08c3eb25a0 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 204 len: 0 microversion: 2.1 time: 0.179312 Apr 02 20:59:37.432062 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1289/2317] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:59:37 2022] DELETE /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 20:59:37.441095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.444392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.452006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.453215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.454413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.455224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.511569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:37.522182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:37.526212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:37.531427 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7dc5be05-0c7f-4358-9f7c-ea81de7ceefb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1406 microversion: 2.20 time: 0.511630 Apr 02 20:59:37.545616 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1029/2318] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1406 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:37.551174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-27bbdb02-b3f4-4a92-9629-ba1f5817f4b0 req-d9292ef9-e2be-4deb-a156-465a8c00b951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a010647f-dc6e-4a5e-9767-100a054b5fda", "name": "network-vif-deleted", "tag": "2c343cee-04a3-4dee-907f-0bea1da0e4d1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:37.572557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27bbdb02-b3f4-4a92-9629-ba1f5817f4b0 req-d9292ef9-e2be-4deb-a156-465a8c00b951 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.577457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27bbdb02-b3f4-4a92-9629-ba1f5817f4b0 req-d9292ef9-e2be-4deb-a156-465a8c00b951 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.590831 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-27bbdb02-b3f4-4a92-9629-ba1f5817f4b0 req-d9292ef9-e2be-4deb-a156-465a8c00b951 service nova] Creating event network-vif-deleted:2c343cee-04a3-4dee-907f-0bea1da0e4d1 for instance a010647f-dc6e-4a5e-9767-100a054b5fda on nch2-master-1 Apr 02 20:59:37.599056 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-27bbdb02-b3f4-4a92-9629-ba1f5817f4b0 req-d9292ef9-e2be-4deb-a156-465a8c00b951 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051825 Apr 02 20:59:37.600030 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1030/2319] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:37.606357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.607589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.617699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.619289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.620573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.621259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.660250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:37.678554 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8f7ba05-b2ec-4513-819e-caac52644f23 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 2130 microversion: 2.25 time: 0.244251 Apr 02 20:59:37.690487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1290/2320] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 2130 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:37.691439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.691753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.703069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.704229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.705121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.705754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.831498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821ac6c697bc4706ad36b8be4e9276a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e22715a8e849e0871b68d772ed29fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:37.847774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f33abedc-fdb9-46a0-b718-63f13e87c763 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 200 len: 1308 microversion: 2.1 time: 0.245802 Apr 02 20:59:37.855943 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1031/2321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:37.868972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:37.869901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:37.897345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.898122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.899141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:37.899797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:37.969877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:38.000448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2ccbc85-09da-4402-96c3-b3cd24c4e72c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1468 microversion: 2.1 time: 0.319690 Apr 02 20:59:38.014967 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1291/2322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1468 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:38.020430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-70b789f5-5f7d-4862-a140-507e258c3916 req-cb2e9e3b-e298-4346-9a39-7b965bff3ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "name": "network-vif-plugged", "status": "completed", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:38.039492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-70b789f5-5f7d-4862-a140-507e258c3916 req-cb2e9e3b-e298-4346-9a39-7b965bff3ea1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.040114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-70b789f5-5f7d-4862-a140-507e258c3916 req-cb2e9e3b-e298-4346-9a39-7b965bff3ea1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.077039 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-70b789f5-5f7d-4862-a140-507e258c3916 req-cb2e9e3b-e298-4346-9a39-7b965bff3ea1 service nova] Creating event network-vif-plugged:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch2-master-1 Apr 02 20:59:38.084181 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-70b789f5-5f7d-4862-a140-507e258c3916 req-cb2e9e3b-e298-4346-9a39-7b965bff3ea1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067794 Apr 02 20:59:38.090052 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1292/2323] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:38.096693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:38.097520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:38.112432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.113135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.113867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.114431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.357295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:38.366097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:38.374771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1713a5c9-1119-4ba7-8e36-605ddb4ea932 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 2130 microversion: 2.25 time: 0.517272 Apr 02 20:59:38.375606 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1032/2324] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:37 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 2130 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:38.379388 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0a64e77-892f-442c-b0a3-02f7c433e121 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.287679 Apr 02 20:59:38.381374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:38.382187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:38.388899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.389573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.390581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.391208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.393376 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1293/2325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:38 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:38.454063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:38.454870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:38.465593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.466357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.467463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.468090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.473506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:38.484388 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6fbaf6a2-8bd0-41c6-abd9-76f6ee3f3f81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1266 microversion: 2.1 time: 0.106417 Apr 02 20:59:38.486609 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1033/2326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:38 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:38.553404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:38.554133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:38.563113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.568935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.570426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.571140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.653440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lazy-loading 'services' on Instance uuid 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:38.798696 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6db4bd6-e289-4752-9c95-844c88561fe4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments/ce1d6038-17a9-4e87-9091-bac12977e2a7" status: 202 len: 0 microversion: 2.25 time: 0.348510 Apr 02 20:59:38.800804 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1294/2327] 10.222.0.18 () {60 vars in 1456 bytes} [Sat Apr 2 20:59:38 2022] DELETE /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments/ce1d6038-17a9-4e87-9091-bac12977e2a7 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:59:38.809311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:38.810421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:38.818123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.818591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.819396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.819977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.835643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:38.845794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:38.847889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:38.849998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4127667e-6256-44a8-8591-fc760fb70c84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1406 microversion: 2.20 time: 0.301185 Apr 02 20:59:38.862975 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1034/2328] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:38 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 20:59:38.876511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:38.878029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] [instance: 931c470e-0eeb-4c37-8757-1d3aef81b2d1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:38.886178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.887971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.889169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:38.890474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:38.903236 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ca74d0e-61d3-4f78-9251-704a208c6a66 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098211 Apr 02 20:59:38.907239 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1295/2329] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:38 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:38.912631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] HTTP exception thrown: Instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 could not be found. Apr 02 20:59:38.913456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] Returning 404 to user: Instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:59:38.914527 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6dba3024-d6b4-4570-adf3-4b2fc9363f85 tempest-FloatingIPsAssociationTestJSON-91990292 tempest-FloatingIPsAssociationTestJSON-91990292-project] 10.222.0.18 "GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1" status: 404 len: 111 microversion: 2.1 time: 0.043930 Apr 02 20:59:38.919359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1035/2330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:38 2022] GET /compute/v2.1/servers/931c470e-0eeb-4c37-8757-1d3aef81b2d1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:59:39.018557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:39.019180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:39.025291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.025753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.026549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.026990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.328572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:39.338690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d371fbd1-aef0-48b9-89ad-928aba9cd0b5 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1468 microversion: 2.1 time: 0.324093 Apr 02 20:59:39.339267 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1296/2331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:39 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:39.397923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:39.398631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:39.416059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.416845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.417732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.418813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.502958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:39.505060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:39.512564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.514298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.515941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.516928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.786299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:39.804605 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8de42fd-0d4f-4302-8c3a-9197470134b7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1308 microversion: 2.1 time: 0.306468 Apr 02 20:59:39.813168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1297/2332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:39 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:39.826672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e459d06e-4dff-4f3a-991a-9af0af4620a9 req-c67c5c19-f0cb-46f2-a6d7-dd543148c8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c470e-0eeb-4c37-8757-1d3aef81b2d1", "name": "network-vif-deleted", "tag": "8ccfbe04-805d-49bd-88f1-b591034caed3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:39.842047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e459d06e-4dff-4f3a-991a-9af0af4620a9 req-c67c5c19-f0cb-46f2-a6d7-dd543148c8b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.842540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e459d06e-4dff-4f3a-991a-9af0af4620a9 req-c67c5c19-f0cb-46f2-a6d7-dd543148c8b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.860041 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e459d06e-4dff-4f3a-991a-9af0af4620a9 req-c67c5c19-f0cb-46f2-a6d7-dd543148c8b2 service nova] Creating event network-vif-deleted:8ccfbe04-805d-49bd-88f1-b591034caed3 for instance 931c470e-0eeb-4c37-8757-1d3aef81b2d1 on nch1-master-1 Apr 02 20:59:39.868044 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e459d06e-4dff-4f3a-991a-9af0af4620a9 req-c67c5c19-f0cb-46f2-a6d7-dd543148c8b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053537 Apr 02 20:59:39.869083 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1298/2333] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:39.876722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:39.877678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:39.879923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:39.885730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.886262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.887066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.887439 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0aa4d53b-f910-4cc6-890f-37bcf5b14685 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.494842 Apr 02 20:59:39.887569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.888018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1036/2334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:39 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:39.915980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:39.917427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:39.931119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.931673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.932426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:39.932955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:39.995100 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f453d550-5fe6-4377-8e5d-2d4b8ab9bd01 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083289 Apr 02 20:59:39.996077 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1037/2335] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:39 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:40.076422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-de72047f-5d41-40dc-b5cc-eedfe24ed203 req-3e76910d-e975-467f-8fe0-80a27e3250a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9a2c47-d2db-479e-a7fa-b165e67469f7", "name": "network-vif-deleted", "tag": "be52826c-0cd7-47ea-b3f1-9be1a12af651"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:40.099299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de72047f-5d41-40dc-b5cc-eedfe24ed203 req-3e76910d-e975-467f-8fe0-80a27e3250a9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.101298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de72047f-5d41-40dc-b5cc-eedfe24ed203 req-3e76910d-e975-467f-8fe0-80a27e3250a9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.144168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-de72047f-5d41-40dc-b5cc-eedfe24ed203 req-3e76910d-e975-467f-8fe0-80a27e3250a9 service nova] Creating event network-vif-deleted:be52826c-0cd7-47ea-b3f1-9be1a12af651 for instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 on nch2-master-1 Apr 02 20:59:40.159300 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-de72047f-5d41-40dc-b5cc-eedfe24ed203 req-3e76910d-e975-467f-8fe0-80a27e3250a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086514 Apr 02 20:59:40.160432 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1038/2336] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:40.172971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-38fc1ee9-4bfd-4ed8-a9cb-bd6aec60f421 req-c8a954d4-de6d-4e1c-874f-90584164cbd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "name": "network-vif-plugged", "status": "completed", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:40.187374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-38fc1ee9-4bfd-4ed8-a9cb-bd6aec60f421 req-c8a954d4-de6d-4e1c-874f-90584164cbd4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.188207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-38fc1ee9-4bfd-4ed8-a9cb-bd6aec60f421 req-c8a954d4-de6d-4e1c-874f-90584164cbd4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.203390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-38fc1ee9-4bfd-4ed8-a9cb-bd6aec60f421 req-c8a954d4-de6d-4e1c-874f-90584164cbd4 service nova] Creating event network-vif-plugged:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch2-master-1 Apr 02 20:59:40.213325 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-38fc1ee9-4bfd-4ed8-a9cb-bd6aec60f421 req-c8a954d4-de6d-4e1c-874f-90584164cbd4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050115 Apr 02 20:59:40.216820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1039/2337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:40.318737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:40.335007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:40.336759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:40.338264 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ccf2194-8f0c-42c2-924d-81e8900716f9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1406 microversion: 2.20 time: 0.467964 Apr 02 20:59:40.339047 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1299/2338] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:39 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:40.359298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:40.360564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:40.367776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.368553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.369772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.370398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.458244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.458818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.459355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lazy-loading 'fault' on Instance uuid 8f9a2c47-d2db-479e-a7fa-b165e67469f7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:40.562628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:40.583563 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c38a2314-d367-437a-94d5-402c47841f39 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 200 len: 1303 microversion: 2.1 time: 0.227027 Apr 02 20:59:40.591755 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1040/2339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:40 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:40.830286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:40.830916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:40.836916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.837608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.838398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.838845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.905701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:40.910546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:40.921402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.922223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:40.925779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:40.926240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.155205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:41.166020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49eaaa66-a19a-425d-a162-08027aed69e6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1308 microversion: 2.1 time: 0.339766 Apr 02 20:59:41.176430 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1300/2340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:40 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:41.185668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:41.187244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:41.193703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.194457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.195780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.196685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.238270 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cee2a640-2280-49c9-b268-668c9ec58e7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059863 Apr 02 20:59:41.239864 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1301/2341] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:41 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:41.243207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:41.251032 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b6d7612-c53e-449b-bd98-9e26f63ea332 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.349586 Apr 02 20:59:41.251606 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1041/2342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:40 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:41.356646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:41.357895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:41.369620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.371213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.372567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.373553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.602079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:41.603055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 8f9a2c47-d2db-479e-a7fa-b165e67469f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:41.612589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.613475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.614479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.615277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.634562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] HTTP exception thrown: Instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 could not be found. Apr 02 20:59:41.635949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Returning 404 to user: Instance 8f9a2c47-d2db-479e-a7fa-b165e67469f7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 20:59:41.637139 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0ff5fc4-a607-415d-99d2-7b5ff5ae37f6 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7" status: 404 len: 111 microversion: 2.1 time: 0.039705 Apr 02 20:59:41.637696 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1042/2343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:41 2022] GET /compute/v2.1/servers/8f9a2c47-d2db-479e-a7fa-b165e67469f7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 20:59:41.647288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:41.648096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:41.652207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:41.656633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.657343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.658466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.659303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.662125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:41.664647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:41.666178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-57575b72-ed50-4414-aaed-bb58eb1e67b8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1406 microversion: 2.20 time: 0.313354 Apr 02 20:59:41.666985 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1302/2344] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:41 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:41.693021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 20:59:41.809044 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1702cb8-7b73-4761-bb06-1075e3b9e2f9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "DELETE /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 204 len: 0 microversion: 2.1 time: 0.158225 Apr 02 20:59:41.810339 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1043/2345] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 20:59:41 2022] DELETE /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 20:59:41.818662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:41.819535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:41.827163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.827904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:41.828980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:41.830786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.123088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:42.135417 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-745b3625-e7da-4bc8-acb6-d7f5481a9f59 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.320857 Apr 02 20:59:42.146293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1303/2346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:41 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:42.185999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:42.187659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:42.191466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c01f8c94-61b4-4e81-8a2b-a223ede4eb3a req-2a059dea-eb6d-47dc-bf82-97fd55792409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b05964-ec44-4336-bb67-fabe511c77aa", "tag": "a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:42.196749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.197611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.198933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.199459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.214193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c01f8c94-61b4-4e81-8a2b-a223ede4eb3a req-2a059dea-eb6d-47dc-bf82-97fd55792409 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.214796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c01f8c94-61b4-4e81-8a2b-a223ede4eb3a req-2a059dea-eb6d-47dc-bf82-97fd55792409 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.227536 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c01f8c94-61b4-4e81-8a2b-a223ede4eb3a req-2a059dea-eb6d-47dc-bf82-97fd55792409 service nova] Creating event network-changed:a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5 for instance 00b05964-ec44-4336-bb67-fabe511c77aa on nch2-master-1 Apr 02 20:59:42.233423 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c01f8c94-61b4-4e81-8a2b-a223ede4eb3a req-2a059dea-eb6d-47dc-bf82-97fd55792409 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046695 Apr 02 20:59:42.237471 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1304/2347] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 20:59:42.256081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:42.257405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:42.265087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.266762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.268570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.269251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.306680 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5cdc2005-0a36-4161-a30e-0e6dd8826994 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059334 Apr 02 20:59:42.307369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1305/2348] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:42 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:42.320687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:42.320930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:42.329315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.329785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.331250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.331928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.472766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:42.481410 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-90d47d6e-9b59-4473-a2ed-c517c0c3af57 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1308 microversion: 2.1 time: 0.301784 Apr 02 20:59:42.491941 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1044/2349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:42 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:42.686857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:42.687491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:42.696048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.696780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.697755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:42.698654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:42.720919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:42.729214 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-89fae930-7d06-46c1-a04f-550b9017931d tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.415469 Apr 02 20:59:42.732798 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1306/2350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:42 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:43.156000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:43.157009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:43.165937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.166745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.168057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.172553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.365661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:43.375701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:43.380043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:43.381329 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f5b90bf-1dd6-4491-82f8-f45254a3abcd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1599 microversion: 2.20 time: 0.699946 Apr 02 20:59:43.382424 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1045/2351] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 20:59:42 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1599 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 20:59:43.388084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:43.389385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:43.398937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.399676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.400762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.401419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.434831 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9895690-9ff4-4b35-aec6-fdf1baf5275d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051353 Apr 02 20:59:43.436284 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1046/2352] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:43 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:43.460255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:43.461119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:43.467853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.468313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.469716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.470057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.563385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:43.580911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b7c93bc-5eb4-4b0a-bec6-735b4a47c374 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.430592 Apr 02 20:59:43.582107 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1307/2353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:43 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:43.587984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:43.589026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:43.596648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.597350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.598347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.599215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.658395 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6b25e9c4-ca0d-4d46-8140-2bc34c50d6fb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.220707 Apr 02 20:59:43.659001 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1047/2354] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Apr 2 20:59:43 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:43.749983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:43.750652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:43.757518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.758221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:43.759198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:43.759859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:44.062132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:44.074051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d859a641-3c34-4291-9500-bd0d34da0840 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.328674 Apr 02 20:59:44.074831 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1048/2355] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:43 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:44.278567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:44.285935 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a392808d-c484-4d75-b098-2c9487717252 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1308 microversion: 2.1 time: 0.702376 Apr 02 20:59:44.292832 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1308/2356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:43 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:44.447216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:44.449482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:44.460107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:44.461576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:44.462906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:44.465127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:44.508925 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-484f0b7f-ee09-4c73-b2f6-8e0e1bac604c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066651 Apr 02 20:59:44.513564 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1049/2357] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:44 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:44.599008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:44.599975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:44.606404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:44.607184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:44.607971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:44.608544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:44.748680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:44.757000 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-65688f76-e04c-4a53-9701-9aaa2528b0d8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.162639 Apr 02 20:59:44.757733 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1309/2358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:44 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:45.041847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fa72a238-72db-48e2-99be-79bddf140f12 req-67af0658-f807-441a-aa98-60c6d6c9f0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:45.052545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fa72a238-72db-48e2-99be-79bddf140f12 req-67af0658-f807-441a-aa98-60c6d6c9f0bb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.053001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fa72a238-72db-48e2-99be-79bddf140f12 req-67af0658-f807-441a-aa98-60c6d6c9f0bb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.065649 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fa72a238-72db-48e2-99be-79bddf140f12 req-67af0658-f807-441a-aa98-60c6d6c9f0bb service nova] Creating event network-changed:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch2-master-1 Apr 02 20:59:45.072157 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fa72a238-72db-48e2-99be-79bddf140f12 req-67af0658-f807-441a-aa98-60c6d6c9f0bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042005 Apr 02 20:59:45.073325 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1050/2359] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:45.093665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:45.095442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:45.110567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.111031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.113582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.115675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.306613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:45.309033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:45.317297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.318057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.319641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.320899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.399687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:45.410156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a75dfaff-5fe7-48fa-a801-d3fc52dde4c1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.322580 Apr 02 20:59:45.412551 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1310/2360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:45 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:45.520714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:45.521712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:45.527851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.528244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.535595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.539399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.594358 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab261da6-6150-4a81-9eb7-da0e92531dfb tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078292 Apr 02 20:59:45.595199 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1311/2361] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:45 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:59:45.604822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:45.612243 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b96f5e8f-86be-41f0-b806-52f3a242232d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1308 microversion: 2.1 time: 0.312768 Apr 02 20:59:45.616403 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1051/2362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:45 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:45.708214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-32490b0b-b9fd-41be-9518-c785c90de6b6 req-7a8af874-597d-43c2-a6dd-070550698ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b05964-ec44-4336-bb67-fabe511c77aa", "name": "network-vif-plugged", "status": "completed", "tag": "a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:45.724185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-32490b0b-b9fd-41be-9518-c785c90de6b6 req-7a8af874-597d-43c2-a6dd-070550698ae5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.725426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-32490b0b-b9fd-41be-9518-c785c90de6b6 req-7a8af874-597d-43c2-a6dd-070550698ae5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.757851 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-32490b0b-b9fd-41be-9518-c785c90de6b6 req-7a8af874-597d-43c2-a6dd-070550698ae5 service nova] Creating event network-vif-plugged:a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5 for instance 00b05964-ec44-4336-bb67-fabe511c77aa on nch2-master-1 Apr 02 20:59:45.774730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:45.775351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:45.786658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.788980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:45.789798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:45.790150 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-32490b0b-b9fd-41be-9518-c785c90de6b6 req-7a8af874-597d-43c2-a6dd-070550698ae5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085207 Apr 02 20:59:45.791165 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1312/2363] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:45.791668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.124223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:46.136993 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-911eae43-5c92-4c7b-beb3-2793933c7950 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.366018 Apr 02 20:59:46.148931 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1052/2364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:45 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:46.431169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:46.433045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:46.461500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:46.462054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.462892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:46.468135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.606836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:46.607846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:46.615649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:46.616568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.618987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:46.619441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.679132 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be749b88-5945-45e6-b86b-0e396c2a5216 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076479 Apr 02 20:59:46.679718 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1053/2365] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:46 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:59:46.684776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:46.685380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:46.691888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:46.692761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.694197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:46.694814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:46.726824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:46.739661 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19e63a1b-4253-4356-86b5-44076b997736 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.313038 Apr 02 20:59:46.741057 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1313/2366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:46 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:46.929714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:46.939773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ddafee48-4cb0-4ae3-bf31-53a0bc39a075 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1308 microversion: 2.1 time: 0.258752 Apr 02 20:59:46.944587 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1054/2367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:46 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1308 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:47.157219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:47.157819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:47.168491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.169133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.169953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.170445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.457877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:47.469654 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5330757-175c-4efd-b78d-8e1fac03d84c tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.316935 Apr 02 20:59:47.474632 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1314/2368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:47 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:47.691411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:47.693167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:47.706375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.706843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.709708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.710203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.743312 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c97a7a0-f2d4-4814-b0ca-ca3ad0ac35e7 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056489 Apr 02 20:59:47.744195 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1055/2369] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:47 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:47.760156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:47.761257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:47.770471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.771797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.773344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.774094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.963438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:47.963955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:47.971582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.972380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:47.973446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:47.974064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.003207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:48.013735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33bbd48e-5529-440c-b986-4feaf80d2995 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.258900 Apr 02 20:59:48.014757 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1315/2370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:47 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:48.284673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:48.295965 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6d9d3f7-267d-466e-adfb-9c2448fe5976 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1489 microversion: 2.1 time: 0.338401 Apr 02 20:59:48.297727 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1056/2371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:47 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1489 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:48.327574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:48.328127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:48.340136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.340687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.341502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.341937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.375501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lazy-loading 'flavor' on Instance uuid 00b05964-ec44-4336-bb67-fabe511c77aa {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 20:59:48.494117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:48.498585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:48.506914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.507511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.508204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.508806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d9c890ef-f3c6-4cf6-b75d-09e01d7946cc tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa/action" status: 202 len: 0 microversion: 2.1 time: 0.192593 Apr 02 20:59:48.509939 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1316/2372] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:48 2022] POST /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 20:59:48.510214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.526771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:48.527536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:48.537476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.537977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.538773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.539217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.706449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:48.715336 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b311d271-4a1f-400e-9128-5ec0e955df9b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1497 microversion: 2.1 time: 0.201021 Apr 02 20:59:48.715927 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1317/2373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:48 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:48.755233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:48.756683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:48.763140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.763913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.764828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:48.765463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:48.803484 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f413513d-f91e-4b62-b52b-d73b04b3d8ed tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052190 Apr 02 20:59:48.807927 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1318/2374] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:48 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 20:59:49.031439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:49.032371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:49.044184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:49.045417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:49.047023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:49.047481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:49.087103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:49.097905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1be2978-59df-4290-b900-e7c13b47fe86 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.609186 Apr 02 20:59:49.100189 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1057/2375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:48 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:49.301074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:49.311568 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e81c92b5-9dab-4492-a6a6-84d52776bc7e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.283459 Apr 02 20:59:49.313061 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1319/2376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:49 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:49.737192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:49.737828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:49.751188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:49.751865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:49.753444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:49.754065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:49.817516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:49.818713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:49.843478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:49.844160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:49.845063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:49.846061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:49.923320 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d3db7877-7535-4a4d-b3fb-2e6c434ae746 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111646 Apr 02 20:59:49.930028 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1320/2377] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:49 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:50.102917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:50.112920 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40b0f449-804d-4001-8889-397c6485a7c1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 200 len: 1480 microversion: 2.1 time: 0.381559 Apr 02 20:59:50.122232 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1058/2378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:49 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 1480 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:50.131568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:50.133480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:50.135396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-644321340"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:50.139315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:50.143847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.146510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.149426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.150128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.153912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.154381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.155174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.155764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.377487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:50.388338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-20310238-d5f5-4792-ac47-b408d02b3099 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.274241 Apr 02 20:59:50.389427 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1321/2379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:50 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:50.395592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:50.396661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:50.404362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.405293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.406267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.406984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.622319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:50.631656 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9434445d-f143-45e2-9263-de14b5166cba tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.240695 Apr 02 20:59:50.634081 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1322/2380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:50 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:50.817377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd2e0f72-7792-4cca-8260-43326f970287 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa/action" status: 202 len: 0 microversion: 2.1 time: 0.687657 Apr 02 20:59:50.818474 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1059/2381] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 20:59:50 2022] POST /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 02 20:59:50.833509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92a45a5e-9528-4c8a-8cb8-2acc934da495 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d46bedc0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:50.915512 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92a45a5e-9528-4c8a-8cb8-2acc934da495 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.091234 Apr 02 20:59:50.916538 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1323/2382] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:50 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:50.936216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:50.937707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:50.945577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.946085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:50.946853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:50.947297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:51.010947 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-94401de9-0b6c-44bf-84c4-4f375c4dd084 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078992 Apr 02 20:59:51.012235 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1060/2383] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:50 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:51.406605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:51.407272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:51.420361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:51.420723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:51.425655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:51.427031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:51.650167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:51.651623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:51.670182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:51.670969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:51.674701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:51.675423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:51.768572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:51.777039 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-197c379f-e263-49ce-9874-507baedd34eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.374898 Apr 02 20:59:51.787686 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1324/2384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:51 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:51.900764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:51.913757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de8af063-56fe-4cc3-b3d0-2861ad8274b2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.267396 Apr 02 20:59:51.914527 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1061/2385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:51 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:51.932346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-15340eb8-d136-48cd-b2ba-38f328ef1799 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d46be700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:52.021297 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-15340eb8-d136-48cd-b2ba-38f328ef1799 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.095037 Apr 02 20:59:52.022637 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1325/2386] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:51 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:52.027858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:52.027858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:52.036347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.036850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.037855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.038181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.081603 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd12004b-18d1-4f22-9440-86123e7b947f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060879 Apr 02 20:59:52.082203 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1062/2387] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:52 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:52.170991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1355822182", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "beb911da-4877-4280-aef6-5e2262f47fca"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:52.232101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] validate_networks() for [('beb911da-4877-4280-aef6-5e2262f47fca', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 20:59:52.644595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 20:59:52.645020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 20:59:52.645862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 20:59:52.646281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 20:59:52.646699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 20:59:52.655881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.656330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.657224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.657623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.676068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Getting quotas for project 56ca6952e8fb440c9a06d487b045cbc0. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 20:59:52.681179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Getting quotas for user 599136c98fd4400898e3468875543781 and project 56ca6952e8fb440c9a06d487b045cbc0. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 20:59:52.693231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 20:59:52.695586 ncdv-master-1 devstack@n-api.service[136518]: WARNING nova.utils [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1355822182 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-135582218 Apr 02 20:59:52.696317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 20:59:52.749178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-571f94d6-9559-4491-a994-bdbececb301d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708906 Apr 02 20:59:52.750147 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1326/2388] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 20:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 20:59:52.760272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9ce774b-81fd-4366-b8a8-a3c62fdeb154 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:52.761094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9ce774b-81fd-4366-b8a8-a3c62fdeb154 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:52.796861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:52.797998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:52.808329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.809001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.809789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.810236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.854527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f9ce774b-81fd-4366-b8a8-a3c62fdeb154 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:52.863336 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9ce774b-81fd-4366-b8a8-a3c62fdeb154 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1232 microversion: 2.1 time: 0.105100 Apr 02 20:59:52.864095 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1063/2389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:52 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1232 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:52.933925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:52.934997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:52.945897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.947249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:52.950006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:52.952375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:53.002022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:53.010187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c037db79-c3a6-416b-b17c-94ed36e5e1ed tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.218984 Apr 02 20:59:53.011274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1327/2390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:52 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:53.038310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2124c5c5-6141-4b90-9e98-dd2f10b75a60 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45cf5e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:53.103797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2124c5c5-6141-4b90-9e98-dd2f10b75a60 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.071790 Apr 02 20:59:53.104519 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1328/2391] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:53 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:53.117223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:53.118338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:53.125147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:53.125738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:53.126810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:53.127580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:53.134357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:53.143764 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36e77159-eab6-4d8a-8619-972c63f578c3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.215765 Apr 02 20:59:53.144632 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1064/2392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:52 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:53.168477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-767ed33a-9fce-49f0-8eeb-c336d16aec10 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056034 Apr 02 20:59:53.169248 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1329/2393] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:53 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:53.881046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:53.882302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:53.889951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:53.890423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:53.891219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:53.891673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:53.982168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:53.995799 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09693bf2-29d3-4e0c-93d0-4dafc74d93bf tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1236 microversion: 2.1 time: 0.118846 Apr 02 20:59:54.001253 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1065/2394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:53 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1236 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:54.030370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:54.032666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:54.043464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:54.045456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:54.046618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:54.047343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:54.119283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9186fb30-2321-4494-a061-f76b5202f6f5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d504c1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:54.179968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9186fb30-2321-4494-a061-f76b5202f6f5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.065641 Apr 02 20:59:54.185968 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1066/2395] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:54 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:54.186684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:54.187345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:54.206145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:54.206851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:54.208744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:54.212042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:54.254993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:54.263903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70689a32-2ea6-4888-b69b-7db39b97d14d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.240268 Apr 02 20:59:54.264980 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1330/2396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:54 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:54.280591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:54.281915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:54.291183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:54.291951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:54.293306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:54.294261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:54.370838 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e29b796c-9f50-4968-a657-2b6f90b3da0b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104480 Apr 02 20:59:54.372144 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1331/2397] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:54 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:54.444126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:54.454458 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acb61163-d023-4ecf-8a23-692ada790077 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.271878 Apr 02 20:59:54.460224 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1067/2398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:54 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:55.015511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:55.016442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:55.024881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.025570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.026626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.027176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.114706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:55.124420 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f47dd5cd-7700-42f8-b531-89ed4de6919c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1284 microversion: 2.1 time: 0.113780 Apr 02 20:59:55.126175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1332/2399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:55 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:55.198826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17c1b105-beb0-46c9-8518-16262cabab16 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d5011f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:55.269227 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17c1b105-beb0-46c9-8518-16262cabab16 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.077915 Apr 02 20:59:55.270425 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1068/2400] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:55 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:55.287786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:55.288818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:55.295887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.296669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.299512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.300618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.383519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:55.384743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:55.400303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.406657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.409134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.409604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.481364 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19dc2068-3969-43cb-823e-e97f73943c9c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102242 Apr 02 20:59:55.483080 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1069/2401] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:55 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:55.492366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:55.495872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:55.507716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:55.509909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.511283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.513256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.514343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.530391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7f98955c-b810-47b4-8100-5aa03cfcaa8f tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.252825 Apr 02 20:59:55.547506 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1333/2402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:55 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:55.737236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:55.749275 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ee03149-5887-43f0-96eb-242d405c83db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.265086 Apr 02 20:59:55.750285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1070/2403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:55 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:55.955946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7e34e8f6-ff60-458d-b04d-defac90f586a req-0c756989-1f24-4d5d-a271-f672c9b790c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b05964-ec44-4336-bb67-fabe511c77aa", "name": "network-vif-plugged", "status": "completed", "tag": "a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 20:59:55.969936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7e34e8f6-ff60-458d-b04d-defac90f586a req-0c756989-1f24-4d5d-a271-f672c9b790c4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:55.971012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7e34e8f6-ff60-458d-b04d-defac90f586a req-0c756989-1f24-4d5d-a271-f672c9b790c4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:55.992064 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7e34e8f6-ff60-458d-b04d-defac90f586a req-0c756989-1f24-4d5d-a271-f672c9b790c4 service nova] Creating event network-vif-plugged:a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5 for instance 00b05964-ec44-4336-bb67-fabe511c77aa on nch2-master-1 Apr 02 20:59:55.997990 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7e34e8f6-ff60-458d-b04d-defac90f586a req-0c756989-1f24-4d5d-a271-f672c9b790c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045644 Apr 02 20:59:55.998971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1334/2404] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 20:59:56.142973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:56.143925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:56.151439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.152639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.153697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.154378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.228697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:56.244199 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40677d67-cea6-499c-ba84-6f0a0f9d00ec tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1284 microversion: 2.1 time: 0.105720 Apr 02 20:59:56.244856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1071/2405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:56 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:56.285825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c969edec-7271-4d2a-be91-08ee57a5666f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45de310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:56.345178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c969edec-7271-4d2a-be91-08ee57a5666f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.064379 Apr 02 20:59:56.347502 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1335/2406] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:56 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:56.494175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:56.495350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:56.512028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.512684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.513596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.514277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.554649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:56.557501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:56.582623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.584889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.589409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.590281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.622410 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c904b3a-f5a9-4313-be65-63604dea59dd tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132472 Apr 02 20:59:56.628356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1072/2407] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:56 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:56.773957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:56.774739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:56.782917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.785411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.788119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:56.793050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:56.875227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:56.883516 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1dec4711-acdc-4e98-98dc-30b2239bfd50 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.339627 Apr 02 20:59:56.885512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1336/2408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:56 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:56.997186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:57.005964 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9f7585c-02f0-4850-8558-8bf7ef3d9570 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.238633 Apr 02 20:59:57.006871 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1073/2409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:56 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:57.264778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:57.265406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:57.272434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:57.273061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:57.273861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:57.274307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:57.361862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7dd0e9b2-e02b-48ca-8ef3-4a988c1f1ead tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d43175e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:57.396717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:57.404284 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03aba7f2-dc98-41cf-8f90-aaf8f0fae0bc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1284 microversion: 2.1 time: 0.143664 Apr 02 20:59:57.405299 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1337/2410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:57 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:57.436912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7dd0e9b2-e02b-48ca-8ef3-4a988c1f1ead tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.079630 Apr 02 20:59:57.438712 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1074/2411] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:57 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:57.639007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:57.640284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:57.647976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:57.648737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:57.649715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:57.650493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:57.690620 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f0bfe69-02ce-40ba-9c17-bee44c169602 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055540 Apr 02 20:59:57.694774 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1338/2412] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:57 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:57.900907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:57.901550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:57.909556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:57.910021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:57.910818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:57.911269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.029251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:58.030476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:58.038600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:58.039598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.040542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:58.041263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.085019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:58.100616 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8634ea8f-ef6f-436f-911a-298b6bfb7b73 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.203697 Apr 02 20:59:58.101576 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1075/2413] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:57 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:58.205718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:58.213658 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eeaa2e93-6173-4a24-89c1-0c7a1cf65e01 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.194434 Apr 02 20:59:58.214663 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1339/2414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:58 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:58.424735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:58.425367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:58.432245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:58.432735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.433720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:58.436547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.453109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-559d8599-be37-4b5a-8123-7667cbd82b1f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4575310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:58.526153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-559d8599-be37-4b5a-8123-7667cbd82b1f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.077462 Apr 02 20:59:58.527471 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1340/2415] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:58 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:58.528865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:58.537876 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d88ba5ae-f4c5-4c30-997c-ddd2944bffee tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1284 microversion: 2.1 time: 0.120236 Apr 02 20:59:58.538604 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1076/2416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:58 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:58.702754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:58.703845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:58.714131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:58.714974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.716028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:58.716611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:58.750239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2379a7f1-728b-4b5e-91bb-eebfb2b52982 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051708 Apr 02 20:59:58.751462 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1341/2417] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:58 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 20:59:59.118795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:59.119423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:59.125551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.125923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.126737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.127919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.232933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:59.233974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:59.241219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.241680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.242638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.243088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.273230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:59.293168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4bb72215-8bf3-43ee-b54a-76d1920057ef tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.178957 Apr 02 20:59:59.316291 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1077/2418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:59 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:59.426213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:59.434936 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4889576-a301-4b80-9929-55ffa683f25f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.206090 Apr 02 20:59:59.435664 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1342/2419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:59 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 20:59:59.539895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62471aae-b00d-44ef-a949-989f57e8f7f2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d513da60>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:59.556606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:59.557845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:59.564673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.565344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.566307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.566920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.592424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62471aae-b00d-44ef-a949-989f57e8f7f2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.056631 Apr 02 20:59:59.599426 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1078/2420] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 20:59:59 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:59.638881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 20:59:59.648432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-712b4f22-c082-4513-a439-07e5b3b39830 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1284 microversion: 2.1 time: 0.095758 Apr 02 20:59:59.649392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1343/2421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 20:59:59 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 20:59:59.763425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 20:59:59.764445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 20:59:59.772005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.772920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.775141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 20:59:59.775591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 20:59:59.817915 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6b28305-f932-4ca5-8221-8c75b3d2bd33 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058488 Apr 02 20:59:59.818976 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1079/2422] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 20:59:59 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:00.312753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:00.313959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:00.322274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.322950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.323866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.324377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.454921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:00.456293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:00.465293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.466559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.467600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.468251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.477472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:00.488878 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-768f806c-b450-46f9-b37c-0004e956b240 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.177113 Apr 02 21:00:00.488878 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1344/2423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:00 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:00.625020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc504012-4b13-4e8d-b83a-7abc8eed7a6e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45f1040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:00.639946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:00.647743 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a64bda48-cfa4-44c9-8cc3-5ff6f038bb98 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.197321 Apr 02 21:00:00.648413 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1080/2424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:00 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:00.665320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:00.665948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:00.674983 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc504012-4b13-4e8d-b83a-7abc8eed7a6e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.054389 Apr 02 21:00:00.675487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.675742 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1345/2425] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:00 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:00.681565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.682631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.683283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.749752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:00.758456 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a6d9ee1-4c45-408a-913d-862eae79d232 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1284 microversion: 2.1 time: 0.096894 Apr 02 21:00:00.768737 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1081/2426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:00 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:00.830774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:00.832070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:00.839219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.840336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.841381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:00.842042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:00.878231 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6fba9a8d-3ae2-4087-ab55-f4c533883818 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051813 Apr 02 21:00:00.879180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1346/2427] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:00 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:01.507151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:01.507909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:01.527674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.528379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.529580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.530098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.667999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:01.669435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:01.681571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.682728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.683882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.684676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.745168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:01.766617 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c735c8d0-a454-4e5b-bb00-f42f282d292e tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.263217 Apr 02 21:00:01.767766 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1082/2428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:01 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:01.773008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a71636dc-e86f-4f50-9e7c-e41b8156d86f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d512f310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:01.835695 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a71636dc-e86f-4f50-9e7c-e41b8156d86f tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.066397 Apr 02 21:00:01.836560 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1083/2429] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:01 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:01.843338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:01.844245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:01.851533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.852014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.852820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.853263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.930224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:01.938497 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e501337-3d35-4952-85a6-5a98c20360b9 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1290 microversion: 2.1 time: 0.100504 Apr 02 21:00:01.939292 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1084/2430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:01 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:01.954412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:01.956130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:01.969868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.970394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.976846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:01.977421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:01.994799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:02.008753 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c83c9db-5063-4dfe-8a21-be0522ece728 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1472 microversion: 2.1 time: 0.345615 Apr 02 21:00:02.010128 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1347/2431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:01 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:02.025677 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74994bda-c25b-4919-9c47-871d951b5ad1 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.074988 Apr 02 21:00:02.028498 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1085/2432] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:01 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:02.790260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:02.792679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:02.800561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:02.801281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:02.802321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:02.803622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:02.850722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4e711e5-963f-4a13-8e54-a60f785040a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d41dc940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:02.902859 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4e711e5-963f-4a13-8e54-a60f785040a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.058016 Apr 02 21:00:02.903734 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1086/2433] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:02 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:02.958879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:02.959823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:02.975367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:02.975840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:02.979489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:02.979958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.107178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:03.118431 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfe53232-1628-414d-a14f-f674c50568eb tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1534 microversion: 2.1 time: 0.332774 Apr 02 21:00:03.124260 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1348/2434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:02 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1534 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:03.129632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:03.130257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:03.161336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:03.161796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.162599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:03.164765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.219603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:03.239168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5dc6a078-c707-4bdc-bf49-2387c09b829b tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.285155 Apr 02 21:00:03.243127 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1087/2435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:02 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:03.254160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:03.259025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:03.275457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:03.276245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.277255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:03.277935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.338730 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ae98e78-3939-4a3e-adcd-25c8d37a4c3b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094050 Apr 02 21:00:03.339735 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1088/2436] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:03 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:03.547965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:03.560578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1dbfe5bc-4592-4648-881c-6394b296d4b6 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.435088 Apr 02 21:00:03.578196 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1349/2437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:03 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:03.591528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d8dc7d37-2fda-44f9-9271-57ff7c7dcde5 req-43cc2042-a12a-4a65-9e68-a1525330eee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db9db7f5-298f-4032-90f6-c9766b263c24", "name": "network-vif-deleted", "tag": "621024d2-1ce8-42c3-9e0b-779d93467380"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:03.615637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d8dc7d37-2fda-44f9-9271-57ff7c7dcde5 req-43cc2042-a12a-4a65-9e68-a1525330eee3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:03.617969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d8dc7d37-2fda-44f9-9271-57ff7c7dcde5 req-43cc2042-a12a-4a65-9e68-a1525330eee3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.660704 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d8dc7d37-2fda-44f9-9271-57ff7c7dcde5 req-43cc2042-a12a-4a65-9e68-a1525330eee3 service nova] Creating event network-vif-deleted:621024d2-1ce8-42c3-9e0b-779d93467380 for instance db9db7f5-298f-4032-90f6-c9766b263c24 on nch1-master-1 Apr 02 21:00:03.665742 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d8dc7d37-2fda-44f9-9271-57ff7c7dcde5 req-43cc2042-a12a-4a65-9e68-a1525330eee3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078959 Apr 02 21:00:03.670644 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1089/2438] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:03.827926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-532c031e-33db-4bfc-8c66-9d121e92c6fd req-2f1f899f-92d1-40ab-854a-973989e49f23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987ad6d2-f2dd-4d82-901a-4b73f5721684", "tag": "0c806072-0f4f-4e01-816a-691781e5cbd9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:03.848808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-532c031e-33db-4bfc-8c66-9d121e92c6fd req-2f1f899f-92d1-40ab-854a-973989e49f23 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:03.849276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-532c031e-33db-4bfc-8c66-9d121e92c6fd req-2f1f899f-92d1-40ab-854a-973989e49f23 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:03.884089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-532c031e-33db-4bfc-8c66-9d121e92c6fd req-2f1f899f-92d1-40ab-854a-973989e49f23 service nova] Creating event network-changed:0c806072-0f4f-4e01-816a-691781e5cbd9 for instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 on nch1-master-1 Apr 02 21:00:03.909520 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-532c031e-33db-4bfc-8c66-9d121e92c6fd req-2f1f899f-92d1-40ab-854a-973989e49f23 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097732 Apr 02 21:00:03.910677 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1350/2439] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:03.919106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8fbee2a9-905c-434a-9a60-377799b57ec1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4d89310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:03.984553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8fbee2a9-905c-434a-9a60-377799b57ec1 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1437 microversion: 2.1 time: 0.070954 Apr 02 21:00:03.985456 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1090/2440] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:03 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1437 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:04.136591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:04.137438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:04.152624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.153903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.154895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.156046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.214796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.215593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.216497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lazy-loading 'fault' on Instance uuid db9db7f5-298f-4032-90f6-c9766b263c24 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:04.255771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:04.257122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:04.265614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.266073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.267359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.270579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.291790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:04.322861 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5251becf-8617-42f9-a5e5-d7fe2deec5ec tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 200 len: 1368 microversion: 2.1 time: 0.190453 Apr 02 21:00:04.328703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1351/2441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:04 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:04.351520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:04.352802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:04.360234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.360968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.362496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.363119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.419658 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f846ba01-f803-407c-85ae-c2096035af8f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072798 Apr 02 21:00:04.420909 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1352/2442] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:04 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:04.470306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:04.480607 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d058ccf-cfd6-45b7-b8d5-023e52290af5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.227000 Apr 02 21:00:04.484883 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1091/2443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:04 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:04.585951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:04.586579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:04.595195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.600337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.601273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:04.601736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:04.895746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:04.903973 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98bad60a-4b02-4809-b654-a5bd8176cee0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.321921 Apr 02 21:00:04.904605 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1353/2444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:04 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:04.998404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fdc3226d-6be3-476a-b176-eed9742aea81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d41dcb80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.044680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fdc3226d-6be3-476a-b176-eed9742aea81 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1446 microversion: 2.1 time: 0.050179 Apr 02 21:00:05.045258 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1092/2445] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:04 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1446 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:05.056800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afffe3df-d93e-47f5-8f85-2a5ae280061b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45de5e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.101703 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afffe3df-d93e-47f5-8f85-2a5ae280061b tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 200 len: 1446 microversion: 2.1 time: 0.048812 Apr 02 21:00:05.102278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1354/2446] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:05 2022] GET /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 1446 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:05.113555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1172722e-b4bd-4ae2-8404-f76a9e23ccd2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d512f700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.342156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.342753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: db9db7f5-298f-4032-90f6-c9766b263c24] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.349341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.349588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.350378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.350876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.365599 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] HTTP exception thrown: Instance db9db7f5-298f-4032-90f6-c9766b263c24 could not be found. Apr 02 21:00:05.366795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Returning 404 to user: Instance db9db7f5-298f-4032-90f6-c9766b263c24 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:05.367068 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6f0423d-3f15-4b7e-93a1-1941ab6e6901 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24" status: 404 len: 111 microversion: 2.1 time: 0.029068 Apr 02 21:00:05.367607 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1355/2447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:05 2022] GET /compute/v2.1/servers/db9db7f5-298f-4032-90f6-c9766b263c24 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:00:05.376464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.377512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.383737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.384197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.387699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.388222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.414382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:05.494929 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-db74b6f6-c8f8-46ea-9f63-5e4e83ab2bab tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 204 len: 0 microversion: 2.1 time: 0.121827 Apr 02 21:00:05.495518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1356/2448] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:05 2022] DELETE /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:05.501413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.503085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.509268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.509659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.510579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.511048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.542499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8974a89b-16b1-411a-b90c-64d03bad98fa tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.045650 Apr 02 21:00:05.545066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1357/2449] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:05 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:05.545201 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1172722e-b4bd-4ae2-8404-f76a9e23ccd2 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 204 len: 0 microversion: 2.1 time: 0.433742 Apr 02 21:00:05.545201 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1093/2450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:05 2022] DELETE /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:05.547904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.548814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.552427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.553084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.554674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.555127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.555891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.556328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.559728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.560198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.561026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.561478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.697022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:05.697214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:05.704507 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5bc26c2a-369d-4caa-9927-fedaf26ada3b tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1467 microversion: 2.1 time: 0.159172 Apr 02 21:00:05.704690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b3f7e38-e1e2-4c7a-86c4-b634433bb96e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.160540 Apr 02 21:00:05.705119 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1094/2451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:05 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1467 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:05.708665 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1358/2452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:05 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:05.709534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.710034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.715875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.716336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.717162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.717613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.741654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:05.815420 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5a97c18-eb27-4634-811c-ec8ce0f95efe tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 204 len: 0 microversion: 2.1 time: 0.108351 Apr 02 21:00:05.815945 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1095/2453] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:05 2022] DELETE /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:05.925252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:05.926372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:05.932678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1227538749", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "f2d4ece6-a97d-4f79-921c-5a419ec5ae76"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:05.938083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.938884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.941981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:05.943074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:05.993145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] validate_networks() for [('f2d4ece6-a97d-4f79-921c-5a419ec5ae76', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:00:06.100887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:06.108685 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d43d876-3846-4855-a263-06fdbbb2fdc0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.191495 Apr 02 21:00:06.109278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1359/2454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:05 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:06.391129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:00:06.391666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:00:06.392773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:00:06.393244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:00:06.393714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:00:06.402962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.403432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.404262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.404818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.418238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c1e96705-57dc-452e-9212-8847d18da90d req-e63cc68f-25a5-4bbc-aba0-0dce2ff84c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "name": "network-vif-unplugged", "status": "completed", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:06.424345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:06.427880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c1e96705-57dc-452e-9212-8847d18da90d req-e63cc68f-25a5-4bbc-aba0-0dce2ff84c27 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.428282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c1e96705-57dc-452e-9212-8847d18da90d req-e63cc68f-25a5-4bbc-aba0-0dce2ff84c27 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.431284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Getting quotas for user 2e7bca7cae174c2c9b83217ea73a973e and project 784e9ed7207a4d9e970e3d496574e6d1. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:06.441800 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c1e96705-57dc-452e-9212-8847d18da90d req-e63cc68f-25a5-4bbc-aba0-0dce2ff84c27 service nova] Creating event network-vif-unplugged:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 21:00:06.449122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c1e96705-57dc-452e-9212-8847d18da90d req-e63cc68f-25a5-4bbc-aba0-0dce2ff84c27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034512 Apr 02 21:00:06.450152 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1360/2455] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:06.452549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:00:06.455760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:00:06.505888 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e7cb07d-f03a-4641-aaa3-32f29907ba00 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578328 Apr 02 21:00:06.510372 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1096/2456] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:00:06.520492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99108f66-7277-4761-976b-b20cf674d775 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:06.522039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99108f66-7277-4761-976b-b20cf674d775 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:06.555038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:06.556037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:06.564262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.564968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.566277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.567137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.585544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-99108f66-7277-4761-976b-b20cf674d775 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:06.593313 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99108f66-7277-4761-976b-b20cf674d775 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1208 microversion: 2.1 time: 0.078580 Apr 02 21:00:06.593906 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1361/2457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:06 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1208 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:06.604848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a8902c6-a864-457f-b1d6-fc730397f399 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.054474 Apr 02 21:00:06.608607 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1097/2458] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:06 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:06.721268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:06.722129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:06.722328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:06.723035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:06.729260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.729806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.730320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.730759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.731148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.731331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.732438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:06.733557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:06.908183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:06.916789 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8ad9098-70ef-4465-bb83-74fe53ef647d tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.199045 Apr 02 21:00:06.917617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1098/2459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:06 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:06.931049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:06.941758 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ccc5827-208f-499d-a29f-adf62056bf42 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1467 microversion: 2.1 time: 0.224451 Apr 02 21:00:06.947393 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1362/2460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:06 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1467 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:07.130540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:07.131713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:07.140981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.142154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.143740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.144399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.389856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:07.399361 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-031a1d54-c2c7-4bca-9b2d-b56c67d28d1e tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.274188 Apr 02 21:00:07.409741 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1099/2461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:07 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:07.613264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:07.614479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:07.628611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.633103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.635563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.636242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.729082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5f5e3202-e2c1-470c-b3dd-07b401cd0e1b req-216db606-07ca-4842-b915-6ee8963833ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9660b921-cb0b-4244-9f7b-c0bfbd321bfe", "name": "network-vif-deleted", "tag": "c04f176b-9717-4cb2-9621-f8e89d6031ec"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:07.738366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5f5e3202-e2c1-470c-b3dd-07b401cd0e1b req-216db606-07ca-4842-b915-6ee8963833ee service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.739156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5f5e3202-e2c1-470c-b3dd-07b401cd0e1b req-216db606-07ca-4842-b915-6ee8963833ee service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.749127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:07.754999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5f5e3202-e2c1-470c-b3dd-07b401cd0e1b req-216db606-07ca-4842-b915-6ee8963833ee service nova] Creating event network-vif-deleted:c04f176b-9717-4cb2-9621-f8e89d6031ec for instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe on nch2-master-1 Apr 02 21:00:07.759035 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b3d2c89-d6c0-457c-a8a3-c3ffa8d2f44d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1260 microversion: 2.1 time: 0.150293 Apr 02 21:00:07.761863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5f5e3202-e2c1-470c-b3dd-07b401cd0e1b req-216db606-07ca-4842-b915-6ee8963833ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037115 Apr 02 21:00:07.769566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1363/2462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:07 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:07.775532 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1100/2463] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:07.939909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:07.940564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:07.947274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.947817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.948702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.949225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.959766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:07.960655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:07.968884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.969652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:07.970639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:07.971309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:08.012407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:08.012928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:08.013396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lazy-loading 'fault' on Instance uuid 9660b921-cb0b-4244-9f7b-c0bfbd321bfe {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:08.083339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:08.096176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-329b6fb5-978f-4078-a265-3a2799ee1add tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 200 len: 1302 microversion: 2.1 time: 0.140449 Apr 02 21:00:08.098808 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1101/2464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:07 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 1302 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:08.106407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:08.115212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c4dbfac-5efd-45d7-918c-04832751c485 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.179803 Apr 02 21:00:08.116136 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1364/2465] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:07 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:08.416712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:08.417322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:08.439651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:08.440496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:08.441525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:08.442160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:08.776792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:08.777518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:08.785874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:08.786417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:08.787291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:08.787800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:08.854178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:08.862407 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f8be52d-46e1-4e64-97c8-13e6a63ae47d tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1266 microversion: 2.1 time: 0.089648 Apr 02 21:00:08.863086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1365/2466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:08 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:09.067877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:09.075773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-355fff4e-2aaf-4785-8ce0-eeb3769fff39 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.663131 Apr 02 21:00:09.076349 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1102/2467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:08 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:09.117066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:09.119426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: 9660b921-cb0b-4244-9f7b-c0bfbd321bfe] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:09.130382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.131431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.133638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.135569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.137633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:09.138322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:09.147956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.148419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.149297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.149896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.159956 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] HTTP exception thrown: Instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe could not be found. Apr 02 21:00:09.160970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Returning 404 to user: Instance 9660b921-cb0b-4244-9f7b-c0bfbd321bfe could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:09.162302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ac5af12-25d1-4c55-b10c-7f4ad84a07c9 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe" status: 404 len: 111 microversion: 2.1 time: 0.051647 Apr 02 21:00:09.163012 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1366/2468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:09 2022] GET /compute/v2.1/servers/9660b921-cb0b-4244-9f7b-c0bfbd321bfe => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:09.177780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:09.179103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:09.194691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.195677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.197162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.197778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.234748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:09.340497 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d2f5253-9e7e-4c5e-879f-14c40bc3e6ce tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 204 len: 0 microversion: 2.1 time: 0.172750 Apr 02 21:00:09.341411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1367/2469] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:09 2022] DELETE /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:09.350002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:09.351020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:09.357674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.358133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.358914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.359349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.506487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:09.516278 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55ebaf67-c406-431d-af46-a352c213635f tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.384671 Apr 02 21:00:09.516919 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1103/2470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:09 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:09.522161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1037436728", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "eb9b7612-59b4-4022-aa4f-4de8d7979f06"}], "block_device_mapping_v2": [{"uuid": "f8809048-f892-4bbb-9a82-f30cbbc8cf67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:09.556880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:09.565887 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d1acbe1-20c5-43d7-ab74-4606eea4f63d tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1469 microversion: 2.1 time: 0.220240 Apr 02 21:00:09.566482 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1368/2471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:09 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:09.584951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] validate_networks() for [('eb9b7612-59b4-4022-aa4f-4de8d7979f06', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:00:09.777924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-fe969555-e610-4cfc-a5b8-dc4780f11533 req-fe31a3b5-ac32-41e4-ab99-149f5aa829ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b05964-ec44-4336-bb67-fabe511c77aa", "name": "network-vif-deleted", "tag": "a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:09.797627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fe969555-e610-4cfc-a5b8-dc4780f11533 req-fe31a3b5-ac32-41e4-ab99-149f5aa829ac service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.798193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fe969555-e610-4cfc-a5b8-dc4780f11533 req-fe31a3b5-ac32-41e4-ab99-149f5aa829ac service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.810722 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-fe969555-e610-4cfc-a5b8-dc4780f11533 req-fe31a3b5-ac32-41e4-ab99-149f5aa829ac service nova] Creating event network-vif-deleted:a0384ce7-cea2-41ee-84d8-7fa76c1ad9e5 for instance 00b05964-ec44-4336-bb67-fabe511c77aa on nch2-master-1 Apr 02 21:00:09.816652 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-fe969555-e610-4cfc-a5b8-dc4780f11533 req-fe31a3b5-ac32-41e4-ab99-149f5aa829ac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042298 Apr 02 21:00:09.817438 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1369/2472] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:09.880610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:09.881514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:09.887807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.888323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:09.889199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:09.889714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.026473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.034248 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-890ea84d-9ccc-4db4-90da-d77812749a58 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.158403 Apr 02 21:00:10.034926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1370/2473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:09 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:10.093605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:10.094353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:10.101148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.101603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.102370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.103351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.246759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.255714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09c51c87-4fb4-499b-9ea7-a23989a80b61 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.165385 Apr 02 21:00:10.264851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1371/2474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:10 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:10.271973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:00:10.272402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:00:10.272909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:00:10.273336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:00:10.273734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:00:10.282559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.283063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.283874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.284316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.303085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:10.308475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Getting quotas for user 4eaee1ddad0041828fb2e65677e2da25 and project a1a3f8d3d3e94b31ab9aa73d8905b12a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:10.382517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:00:10.384710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8809048-f892-4bbb-9a82-f30cbbc8cf67',volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:00:10.470898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:10.473157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:10.481887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.482634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.483622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.484232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.522011 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6da910f-d264-4951-a19f-4ea15674b7be tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/ips" status: 200 len: 146 microversion: 2.1 time: 0.056962 Apr 02 21:00:10.523232 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1372/2475] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:00:10 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:10.541491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:10.542301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:10.551553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.552141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.554092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.554636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.581095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c66c1c63-70c0-41cb-90a5-9805a657e91d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.062260 Apr 02 21:00:10.582671 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1104/2476] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 21:00:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 21:00:10.587849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:10.589448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:10.597466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.597921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.599203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.599909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.751349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.764917 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a845e70-55a5-4454-9c16-8286145202cc tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.235485 Apr 02 21:00:10.766272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1373/2477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:10 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:10.772402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6638e697-6a8b-47ea-8b59-5a65c6501aac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:10.773221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6638e697-6a8b-47ea-8b59-5a65c6501aac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:10.858328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6638e697-6a8b-47ea-8b59-5a65c6501aac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.875737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6638e697-6a8b-47ea-8b59-5a65c6501aac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.876313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.877395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6638e697-6a8b-47ea-8b59-5a65c6501aac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:10.878965 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6638e697-6a8b-47ea-8b59-5a65c6501aac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1104 microversion: 2.25 time: 0.111222 Apr 02 21:00:10.880509 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1374/2478] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:10 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1104 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:10.889701 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb9ba61b-5510-4014-905e-b9d3c7563020 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1469 microversion: 2.1 time: 0.305796 Apr 02 21:00:10.890532 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1105/2479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:10 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:10.895522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-429002fa-260e-400b-b65d-e44ba230b064 req-92abb416-ce7c-4c80-a06d-075c88ac0eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "name": "network-vif-plugged", "status": "completed", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:10.904844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-429002fa-260e-400b-b65d-e44ba230b064 req-92abb416-ce7c-4c80-a06d-075c88ac0eae service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:10.905320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-429002fa-260e-400b-b65d-e44ba230b064 req-92abb416-ce7c-4c80-a06d-075c88ac0eae service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:10.918278 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-429002fa-260e-400b-b65d-e44ba230b064 req-92abb416-ce7c-4c80-a06d-075c88ac0eae service nova] Creating event network-vif-plugged:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 21:00:10.923583 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-429002fa-260e-400b-b65d-e44ba230b064 req-92abb416-ce7c-4c80-a06d-075c88ac0eae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040678 Apr 02 21:00:10.924364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1375/2480] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:11.051175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:11.052200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:11.059091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.059915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.060986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.061833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.274621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:11.275134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:11.276052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:11.285718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00b6a835-d14b-4da3-afa2-6b446e560fec tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.238300 Apr 02 21:00:11.287773 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1106/2481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:11 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:11.290095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.291320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.292245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.292852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.532932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:11.551027 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f72be56-9fe2-4f46-8eba-34c6059a8f1f tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.279791 Apr 02 21:00:11.551027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1376/2482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:11 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:11.582470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-44a54a5f-3e94-4187-9e51-1bafd87c1247 req-a97ec0e1-9c01-4880-8ed7-6c48a4b1bb57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c28074b2-b820-4fa1-8693-1ff7cf91a474", "name": "network-vif-deleted", "tag": "26f419c3-bf0c-45a0-a419-019238f49182"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:11.591510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-44a54a5f-3e94-4187-9e51-1bafd87c1247 req-a97ec0e1-9c01-4880-8ed7-6c48a4b1bb57 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.591964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-44a54a5f-3e94-4187-9e51-1bafd87c1247 req-a97ec0e1-9c01-4880-8ed7-6c48a4b1bb57 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.603896 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-44a54a5f-3e94-4187-9e51-1bafd87c1247 req-a97ec0e1-9c01-4880-8ed7-6c48a4b1bb57 service nova] Creating event network-vif-deleted:26f419c3-bf0c-45a0-a419-019238f49182 for instance c28074b2-b820-4fa1-8693-1ff7cf91a474 on nch1-master-1 Apr 02 21:00:11.608829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-44a54a5f-3e94-4187-9e51-1bafd87c1247 req-a97ec0e1-9c01-4880-8ed7-6c48a4b1bb57 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030655 Apr 02 21:00:11.609476 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1107/2483] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:11.782408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:11.783144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:11.790587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.791009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.791871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.792970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.834642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f91e4de2-3680-4d09-82be-b88d9e591e33 req-40c7f12f-5db7-4687-8bfc-348380c1af88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3863c5cb-fbcc-48ce-b292-bf79b14d0dcc", "tag": "06523ba1-b96d-4767-aaa5-bbe2183d6a80"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:11.847369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f91e4de2-3680-4d09-82be-b88d9e591e33 req-40c7f12f-5db7-4687-8bfc-348380c1af88 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.848145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f91e4de2-3680-4d09-82be-b88d9e591e33 req-40c7f12f-5db7-4687-8bfc-348380c1af88 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.860796 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f91e4de2-3680-4d09-82be-b88d9e591e33 req-40c7f12f-5db7-4687-8bfc-348380c1af88 service nova] Creating event network-changed:06523ba1-b96d-4767-aaa5-bbe2183d6a80 for instance 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc on nch2-master-1 Apr 02 21:00:11.866503 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f91e4de2-3680-4d09-82be-b88d9e591e33 req-40c7f12f-5db7-4687-8bfc-348380c1af88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036137 Apr 02 21:00:11.867127 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1108/2484] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:11.906590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:11.908548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:11.917950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.918713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.920718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.921350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.962662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:11.970882 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f1e4d14-d692-42bc-962a-33fc4fd5da5c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.192226 Apr 02 21:00:11.971593 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1377/2485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:11 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:11.976723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:11.977469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:11.983973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.984590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:11.985499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:11.986591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:12.020022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:12.031070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:12.034557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:12.036251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7eb605f8-4416-459d-b6a6-b612b94ba814 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1251 microversion: 2.25 time: 0.139744 Apr 02 21:00:12.037919 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1109/2486] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:11 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1251 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:12.058870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:12.067839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8c2fdf2-8f33-4249-a14e-5a8102f06f74 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1427 microversion: 2.1 time: 0.094885 Apr 02 21:00:12.069109 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1378/2487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:11 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:12.303237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:12.303855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:12.312420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:12.313157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:12.314631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:12.315245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:12.576162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:12.577816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:12.587414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:12.589269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:12.591218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:12.594234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:12.722477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:12.737466 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e64ddba0-ec53-460c-9b8e-f847a9c95b12 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.437537 Apr 02 21:00:12.738156 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1110/2488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:12 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:12.808317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:12.823175 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee8f6c3d-d85e-4062-9d4d-a2c80af3647a tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.260708 Apr 02 21:00:12.824104 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1379/2489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:12 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:12.940841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-156bb254-28f0-4413-adc4-8515becef987 req-d732a56a-dc53-49d5-972a-25b01b0f1a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987ad6d2-f2dd-4d82-901a-4b73f5721684", "name": "network-vif-plugged", "status": "completed", "tag": "0c806072-0f4f-4e01-816a-691781e5cbd9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:12.949183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-156bb254-28f0-4413-adc4-8515becef987 req-d732a56a-dc53-49d5-972a-25b01b0f1a87 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:12.949636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-156bb254-28f0-4413-adc4-8515becef987 req-d732a56a-dc53-49d5-972a-25b01b0f1a87 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:12.978154 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-156bb254-28f0-4413-adc4-8515becef987 req-d732a56a-dc53-49d5-972a-25b01b0f1a87 service nova] Creating event network-vif-plugged:0c806072-0f4f-4e01-816a-691781e5cbd9 for instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 on nch1-master-1 Apr 02 21:00:12.984540 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-156bb254-28f0-4413-adc4-8515becef987 req-d732a56a-dc53-49d5-972a-25b01b0f1a87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048197 Apr 02 21:00:12.987166 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1111/2490] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:12.991880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:12.992829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:13.002377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.002946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.004142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.005384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.059083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:13.060074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:13.066589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.067276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.068291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.068935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.155122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:13.164127 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6de7517-8b62-4663-bb12-60648a07dfd7 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.180345 Apr 02 21:00:13.164756 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1380/2491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:12 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:13.169364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:13.170178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:13.176275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.176767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.177554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.177994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.238139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:13.245597 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f65e278f-367f-4e73-9d28-5a3869d14a30 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1427 microversion: 2.1 time: 0.079861 Apr 02 21:00:13.246183 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1381/2492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:13 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:13.318002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:13.326465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:13.328221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:13.329416 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23d7e230-3423-455d-9142-f4e52e2cd98d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.274771 Apr 02 21:00:13.330801 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1112/2493] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:13 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:13.755077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:13.756264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:13.771868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.772282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.773371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.774052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.840714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:13.841350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:13.850169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.851576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.852368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.852853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.940063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:13.949115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f8bd2dd-8ab8-4e5e-baad-f4b2b6e2c574 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.198023 Apr 02 21:00:13.950009 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1382/2494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:13 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:13.954780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-29db7ac7-ff68-4126-9bfd-37c4079f9b68 req-4fe9dc37-c362-450b-99bc-be062d40d528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760e84eb-7fa1-420b-9884-1f3c0e6f3d8c", "tag": "2f0b5d01-2163-42f7-ad38-54ff616d2346"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:13.963164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-29db7ac7-ff68-4126-9bfd-37c4079f9b68 req-4fe9dc37-c362-450b-99bc-be062d40d528 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:13.964026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-29db7ac7-ff68-4126-9bfd-37c4079f9b68 req-4fe9dc37-c362-450b-99bc-be062d40d528 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:13.976011 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-29db7ac7-ff68-4126-9bfd-37c4079f9b68 req-4fe9dc37-c362-450b-99bc-be062d40d528 service nova] Creating event network-changed:2f0b5d01-2163-42f7-ad38-54ff616d2346 for instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c on nch2-master-1 Apr 02 21:00:13.982452 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-29db7ac7-ff68-4126-9bfd-37c4079f9b68 req-4fe9dc37-c362-450b-99bc-be062d40d528 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030442 Apr 02 21:00:13.983390 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1383/2495] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:14.096331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:14.103942 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01d1f6d2-7073-43af-8707-5c338afb7baa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.267103 Apr 02 21:00:14.104538 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1113/2496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:13 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:14.185320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:14.185320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:14.189778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.190459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.191235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.191674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.262872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:14.263598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:14.270759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.271315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.272771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.273448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.335404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:14.343424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:14.344820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f0764632-19e0-47b3-b6b9-952c78c96bbd tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.167259 Apr 02 21:00:14.345971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1384/2497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:14 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:14.350568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:14.351412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:14.352291 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-020328e0-8136-4656-99be-e90c25ece5ee tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1427 microversion: 2.1 time: 0.093298 Apr 02 21:00:14.352998 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1114/2498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:14 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:14.357635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.358324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.359099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.359543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.501530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:14.509620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:14.511660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:14.512997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-047a157f-2e19-408a-a2bc-d0afdc24a998 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.165987 Apr 02 21:00:14.513616 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1385/2499] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:14 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:14.824532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edb42d4f-4c36-43fc-9b81-4680a8054cf5"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:14.825686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:14.831682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.832154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.832973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.833422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.965726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:14.966334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:14.972340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.972828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:14.973606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:14.974026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.111661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.119213 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5cbdccb-477b-4f57-a37c-4e49b94a26ef tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.157312 Apr 02 21:00:15.119899 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1386/2500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:14 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:15.124525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:15.125162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:15.131714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.132199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.133161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.133678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.315853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.327655 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0135b48e-b46d-41e3-9e48-3ba771ce9d3b tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.206706 Apr 02 21:00:15.328634 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1387/2501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:15 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:15.368502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:15.369586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:15.384748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.385696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.386424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.565451 Apr 02 21:00:15.387328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.387627 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1115/2502] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:00:14 2022] POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-volume_attachments => generated 194 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:15.388091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.394462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:15.395183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:15.403913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.404378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.405236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.405689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.457131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.458222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.458329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lazy-loading 'fault' on Instance uuid c28074b2-b820-4fa1-8693-1ff7cf91a474 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:15.501533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d982c5db7e47a6ae521f2137af3204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf81401733804432b781dd367ab7bd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.509274 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e6c7d3e-7efa-417d-bded-3ace510e68e8 tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 200 len: 1303 microversion: 2.1 time: 0.120160 Apr 02 21:00:15.509974 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1116/2503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:15 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:15.534280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:15.534924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:15.541941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.542404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.543385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:15.544066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:15.549835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.557714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13d66d63-a749-4def-8764-6ff88a811223 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.197856 Apr 02 21:00:15.558711 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1388/2504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:15 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:15.683299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.699052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.701856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:15.702003 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0729a9f5-5239-4809-ae4d-c2681d3e28b4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.174783 Apr 02 21:00:15.705774 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1117/2505] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:15 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:16.139437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:16.141314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:16.149925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.150944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.152031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.153022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.293094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:16.301082 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0d73fd3-d228-435e-8abc-fdb8e3ddde41 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.166255 Apr 02 21:00:16.301666 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1389/2506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:16 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:16.347433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:16.348169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:16.354954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.355406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.356175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.356728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.508716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:16.516979 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de3e490e-ade5-4f5e-b136-9b59ce2650a3 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1478 microversion: 2.1 time: 0.173407 Apr 02 21:00:16.517660 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1118/2507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:16 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1478 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:16.527189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:16.527479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] [instance: c28074b2-b820-4fa1-8693-1ff7cf91a474] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:16.534403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.534871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.535660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.536111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.551461 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] HTTP exception thrown: Instance c28074b2-b820-4fa1-8693-1ff7cf91a474 could not be found. Apr 02 21:00:16.552079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] Returning 404 to user: Instance c28074b2-b820-4fa1-8693-1ff7cf91a474 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:16.552977 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a7f5f797-7838-4ecb-83d4-ad2d7c62526a tempest-MigrationsAdminTest-442344706 tempest-MigrationsAdminTest-442344706-project] 10.222.0.18 "GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474" status: 404 len: 111 microversion: 2.1 time: 0.030613 Apr 02 21:00:16.553537 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1390/2508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:16 2022] GET /compute/v2.1/servers/c28074b2-b820-4fa1-8693-1ff7cf91a474 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:16.575200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:16.575818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:16.582665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.583425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.584312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.584835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.722488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:16.723917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:16.726835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:16.731379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.732263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.733704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:16.734327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:16.736525 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8802b02-b25b-44a5-a75e-2970d33365af tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1332 microversion: 2.1 time: 0.164459 Apr 02 21:00:16.737135 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1119/2509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:16 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:16.890293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:16.898988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:16.900506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:16.901618 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67a82611-a3ae-4f83-968d-39778ffc2190 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.184135 Apr 02 21:00:16.902811 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1391/2510] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:16 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:17.319131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:17.319827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:17.327405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.327861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.328688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.329136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.468584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:17.476321 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-164cda70-48a4-47a6-8300-7f4c0105346e tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.162222 Apr 02 21:00:17.477085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1120/2511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:17 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:17.537716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:17.540908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:17.555413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.556176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.556973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.557612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.714872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:17.723424 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2272506b-a53b-411d-bbcd-bbb92eb905b1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1463 microversion: 2.1 time: 0.192610 Apr 02 21:00:17.724036 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1392/2512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:17 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:17.764554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-901018a5-33c1-4ff8-b133-b98a485456f7 req-5ef88657-d935-4fef-85da-77b5acb177ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3863c5cb-fbcc-48ce-b292-bf79b14d0dcc", "name": "network-vif-plugged", "status": "completed", "tag": "06523ba1-b96d-4767-aaa5-bbe2183d6a80"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:17.771040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:17.772284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:17.780753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.781218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.782018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.782471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.785646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-901018a5-33c1-4ff8-b133-b98a485456f7 req-5ef88657-d935-4fef-85da-77b5acb177ab service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.786730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-901018a5-33c1-4ff8-b133-b98a485456f7 req-5ef88657-d935-4fef-85da-77b5acb177ab service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.804764 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-901018a5-33c1-4ff8-b133-b98a485456f7 req-5ef88657-d935-4fef-85da-77b5acb177ab service nova] Creating event network-vif-plugged:06523ba1-b96d-4767-aaa5-bbe2183d6a80 for instance 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc on nch2-master-1 Apr 02 21:00:17.810341 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-901018a5-33c1-4ff8-b133-b98a485456f7 req-5ef88657-d935-4fef-85da-77b5acb177ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052271 Apr 02 21:00:17.814905 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1393/2513] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:17.832403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:17.833509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:17.840263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.841022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.842025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.842682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.927459 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9fb1f286-ba73-4e59-a4ec-e4e3b6eb2d3a tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 0 microversion: 2.1 time: 0.111378 Apr 02 21:00:17.928876 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1394/2514] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:17 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:17.933882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:17.934518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:17.942044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.942741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:17.943964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:17.944733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.074786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:18.082981 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8678f839-08b4-4b0e-94dd-df925e862227 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1537 microversion: 2.1 time: 0.328715 Apr 02 21:00:18.085801 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1121/2515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:17 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:18.093629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:18.094520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:18.101373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.102058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.102847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.103286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.108405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:18.119697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:18.121379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:18.122531 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81e0d577-997e-44b8-9a7a-42b2c168e866 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.192691 Apr 02 21:00:18.123099 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1395/2516] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:17 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:18.139136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d344562-0092-47f1-8eb5-74cd1aea0a94 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'create', calling method: .version_select at 0x7f54d45bdee0>, body: {"pool": "69e968fd-ce84-40ce-a27b-620992c0d153"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:18.142605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.143086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.143590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lazy-loading 'fault' on Instance uuid 7b367d88-0807-449d-bd01-d227a66e6958 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:18.271135 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-29097a0c-6d9a-4662-b995-3850d8cae937 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1597 microversion: 2.1 time: 0.181181 Apr 02 21:00:18.272202 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1122/2517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:18 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1597 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:18.288889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:18.290286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:18.297256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.297718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.299264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.299885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.381286 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c287412-9e49-4cbf-8c88-d1338d7034b6 tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action" status: 202 len: 0 microversion: 2.1 time: 0.096313 Apr 02 21:00:18.382068 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1123/2518] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:18 2022] POST /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:18.390807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:18.391618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:18.399250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.399852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.400795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.401367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.552525 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d27f18d2-dffc-4fb7-9b1f-6c0de882ea6d tempest-ServersAdminTestJSON-597255803 tempest-ServersAdminTestJSON-597255803-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1614 microversion: 2.1 time: 0.165095 Apr 02 21:00:18.553856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1124/2519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:18 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1614 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:18.559310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:18.560242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:18.568426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.569246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.570463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.571155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.745327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:18.753791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9d58568-34e8-4ee2-8249-cd2c2b95f2d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1308 microversion: 2.1 time: 0.198599 Apr 02 21:00:18.754797 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1125/2520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:18 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1308 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:18.768213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:18.768891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:18.779930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.779930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.780568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.780734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.821461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:18.914209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-291ddfcd-20ed-4714-abab-bc1ff779bef2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 204 len: 0 microversion: 2.1 time: 0.149993 Apr 02 21:00:18.917723 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1126/2521] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:18 2022] DELETE /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:18.923356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-43ae578e-fb7e-400b-a78d-ac497a5936f7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:18.931518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43ae578e-fb7e-400b-a78d-ac497a5936f7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:18.932647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43ae578e-fb7e-400b-a78d-ac497a5936f7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:18.998763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-43ae578e-fb7e-400b-a78d-ac497a5936f7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Going to try to stop instance {{(pid=136517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:00:19.046332 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-43ae578e-fb7e-400b-a78d-ac497a5936f7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action" status: 202 len: 0 microversion: 2.1 time: 0.129096 Apr 02 21:00:19.047188 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1127/2522] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:18 2022] POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:19.053627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:19.054741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:19.062603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.065105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.065105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.065344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.239021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:19.247354 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c3f6886-9a27-4a99-97a0-3f41d03279db tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1468 microversion: 2.1 time: 0.198966 Apr 02 21:00:19.247951 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1128/2523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:19 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:19.259953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:19.260739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:19.266854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.267636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.269197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.269197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.416877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:19.425827 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-533d4b2b-07b1-4a2b-8e08-2ea929e3d149 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1723 microversion: 2.1 time: 0.176859 Apr 02 21:00:19.426404 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1129/2524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:19 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:19.431274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:19.432107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:19.438120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.438588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.439963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.440427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.588094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:19.597851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:19.604548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:19.607029 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac00542a-9912-4e1f-b202-5230a3b7f25c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.179428 Apr 02 21:00:19.607791 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1130/2525] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:19 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:19.744056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6d6a827-3ca8-428f-8d56-3e5632758fea tempest-NetworksTest-857266397 tempest-NetworksTest-857266397-project-admin] Calling method '.version_select at 0x7f54d4c66a60>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:19.809666 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d344562-0092-47f1-8eb5-74cd1aea0a94 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.683131 Apr 02 21:00:19.810712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1396/2526] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 21:00:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:19.816114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:19.817033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:19.823331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.823794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.824606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.825054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.955372 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6d6a827-3ca8-428f-8d56-3e5632758fea tempest-NetworksTest-857266397 tempest-NetworksTest-857266397-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 6066 microversion: 2.1 time: 0.345228 Apr 02 21:00:19.956619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1131/2527] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:00:19 2022] GET /compute/v2.1/os-networks => generated 6066 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:19.961724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.147"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:19.961913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:19.962889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:19.968979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.969464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.969830 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d881bc15-2b16-40da-9ce2-234c3f8f40a9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1489 microversion: 2.1 time: 0.157818 Apr 02 21:00:19.970857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:19.970988 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1397/2528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:19 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1489 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:19.971344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:19.975388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab70d31e-c659-419b-b4ba-d952ab1d82ee tempest-NetworksTest-857266397 tempest-NetworksTest-857266397-project-admin] Calling method '.version_select at 0x7f54d46f2430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:19.999299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Acquired lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 21:00:20.078052 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab70d31e-c659-419b-b4ba-d952ab1d82ee tempest-NetworksTest-857266397 tempest-NetworksTest-857266397-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks/69e968fd-ce84-40ce-a27b-620992c0d153" status: 200 len: 652 microversion: 2.1 time: 0.105971 Apr 02 21:00:20.083349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1398/2529] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:00:19 2022] GET /compute/v2.1/os-networks/69e968fd-ce84-40ce-a27b-620992c0d153 => generated 652 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:20.085201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1343130063"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:20.086296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:20.092257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:20.092750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:20.093758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:20.094398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:20.371787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7482fc1-183f-4654-aaa2-840dfba6ce21 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "POST /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.291914 Apr 02 21:00:20.372720 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1399/2530] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:20 2022] POST /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:00:20.378057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0eb556d8-7b31-4845-a019-f8e570cc137b tempest-NetworksTest-857266397 tempest-NetworksTest-857266397-project-admin] Calling method '.version_select at 0x7f54d46f2160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:20.506112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0eb556d8-7b31-4845-a019-f8e570cc137b tempest-NetworksTest-857266397 tempest-NetworksTest-857266397-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 6066 microversion: 2.1 time: 0.132334 Apr 02 21:00:20.506873 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1400/2531] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:00:20 2022] GET /compute/v2.1/os-networks => generated 6066 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:20.512633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:20.513249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:20.520674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:20.521137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:20.522161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:20.522608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:20.703349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:20.711792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-416e7b06-0a91-4dd1-96c7-1cfc9f46beea tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1468 microversion: 2.1 time: 0.203510 Apr 02 21:00:20.722492 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1401/2532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:20 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:20.730020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd51708a-b62f-45b6-8328-ea18140d0837 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45f1e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:20.785961 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd51708a-b62f-45b6-8328-ea18140d0837 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72" status: 200 len: 1412 microversion: 2.1 time: 0.062176 Apr 02 21:00:20.794296 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1402/2533] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:20 2022] GET /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72 => generated 1412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:20.800836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:20.801708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:20.810143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:20.810765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:20.811628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:20.812166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.085856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:21.094911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d2606ff-9ae4-4672-872a-ece21e9a2bb9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1723 microversion: 2.1 time: 0.299197 Apr 02 21:00:21.096239 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1403/2534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:20 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:21.101192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:21.102071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:21.110032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:21.110628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.112270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:21.112934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.378320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:21.387422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:21.389366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:21.390796 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-649d2fa5-0b69-498d-bb71-bedf78c7c361 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.293276 Apr 02 21:00:21.392438 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1404/2535] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:21 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:21.400154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7404d68f-f6e6-4054-88b0-c34de31fca59 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45bd160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:21.463327 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7404d68f-f6e6-4054-88b0-c34de31fca59 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72" status: 200 len: 1412 microversion: 2.1 time: 0.069468 Apr 02 21:00:21.464038 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1405/2536] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:21 2022] GET /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72 => generated 1412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:21.475847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c2f0cb4e-b3ad-4c27-bdb2-886fd147e029 req-8c0115b4-7e33-4d99-a52c-3f9e13619490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd7e09f0-6c85-492e-8a65-b8eccd7e2776", "name": "network-vif-deleted", "tag": "82489312-cd93-45ff-8630-0fecf70d05db"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:21.484757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c2f0cb4e-b3ad-4c27-bdb2-886fd147e029 req-8c0115b4-7e33-4d99-a52c-3f9e13619490 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:21.485591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c2f0cb4e-b3ad-4c27-bdb2-886fd147e029 req-8c0115b4-7e33-4d99-a52c-3f9e13619490 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.499204 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c2f0cb4e-b3ad-4c27-bdb2-886fd147e029 req-8c0115b4-7e33-4d99-a52c-3f9e13619490 service nova] Creating event network-vif-deleted:82489312-cd93-45ff-8630-0fecf70d05db for instance fd7e09f0-6c85-492e-8a65-b8eccd7e2776 on nch1-master-1 Apr 02 21:00:21.504587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c2f0cb4e-b3ad-4c27-bdb2-886fd147e029 req-8c0115b4-7e33-4d99-a52c-3f9e13619490 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Apr 02 21:00:21.505911 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1406/2537] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:21.515394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80428a62-31f6-4ed4-a600-e664d2f014fd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d45bd820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:21.692448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80428a62-31f6-4ed4-a600-e664d2f014fd tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72" status: 204 len: 0 microversion: 2.1 time: 0.181119 Apr 02 21:00:21.693376 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1407/2538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:21 2022] DELETE /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:21.706585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-715b1a42-1981-4144-bc2a-6f4906db3464 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d470f0d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:21.741200 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-715b1a42-1981-4144-bc2a-6f4906db3464 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Image not found. Apr 02 21:00:21.741851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-715b1a42-1981-4144-bc2a-6f4906db3464 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:21.742639 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-715b1a42-1981-4144-bc2a-6f4906db3464 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72" status: 404 len: 62 microversion: 2.1 time: 0.041403 Apr 02 21:00:21.749842 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1408/2539] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:21 2022] GET /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:21.760847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:21.762242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:21.779834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:21.784722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.785669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:21.785930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Building network info cache for instance {{(pid=136517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 21:00:21.786414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.864256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:21.865424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:21.865756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lazy-loading 'fault' on Instance uuid fd7e09f0-6c85-492e-8a65-b8eccd7e2776 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:21.921945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:21.941217 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3bd89204-83b7-4d51-ab18-5dbf47fd46e2 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 200 len: 1304 microversion: 2.1 time: 0.190380 Apr 02 21:00:21.966846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1409/2540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:21 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:21.984986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:21.985767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:22.014724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.018056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.021313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.021772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.246124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:22.254641 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19b91c35-040b-4ce2-8693-aca1d54d8807 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1507 microversion: 2.1 time: 0.285571 Apr 02 21:00:22.255434 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1410/2541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:21 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:22.270780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-275f4315-06bd-4588-97af-d2137944d557 req-67809e37-c4b1-4f65-8770-2e21f9ad0793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987ad6d2-f2dd-4d82-901a-4b73f5721684", "tag": "0c806072-0f4f-4e01-816a-691781e5cbd9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:22.280172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-275f4315-06bd-4588-97af-d2137944d557 req-67809e37-c4b1-4f65-8770-2e21f9ad0793 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.280578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-275f4315-06bd-4588-97af-d2137944d557 req-67809e37-c4b1-4f65-8770-2e21f9ad0793 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.294034 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-275f4315-06bd-4588-97af-d2137944d557 req-67809e37-c4b1-4f65-8770-2e21f9ad0793 service nova] Creating event network-changed:0c806072-0f4f-4e01-816a-691781e5cbd9 for instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 on nch1-master-1 Apr 02 21:00:22.301330 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-275f4315-06bd-4588-97af-d2137944d557 req-67809e37-c4b1-4f65-8770-2e21f9ad0793 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043386 Apr 02 21:00:22.301940 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1411/2542] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:22.310291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-846a9deb-d420-472b-aa9b-47e660c0b279 req-2c37c38c-b52c-4133-bb57-084476b00316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760e84eb-7fa1-420b-9884-1f3c0e6f3d8c", "name": "network-vif-plugged", "status": "completed", "tag": "2f0b5d01-2163-42f7-ad38-54ff616d2346"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:22.323576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-846a9deb-d420-472b-aa9b-47e660c0b279 req-2c37c38c-b52c-4133-bb57-084476b00316 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.325289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-846a9deb-d420-472b-aa9b-47e660c0b279 req-2c37c38c-b52c-4133-bb57-084476b00316 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.337835 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-846a9deb-d420-472b-aa9b-47e660c0b279 req-2c37c38c-b52c-4133-bb57-084476b00316 service nova] Creating event network-vif-plugged:2f0b5d01-2163-42f7-ad38-54ff616d2346 for instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c on nch2-master-1 Apr 02 21:00:22.343127 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-846a9deb-d420-472b-aa9b-47e660c0b279 req-2c37c38c-b52c-4133-bb57-084476b00316 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039698 Apr 02 21:00:22.344205 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1412/2543] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:22.350411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:22.353514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:22.360574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.362018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.364633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.365367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.646639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:22.654699 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e797abd-644f-42b1-90bf-ff82306cb3ed tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1723 microversion: 2.1 time: 0.309029 Apr 02 21:00:22.665620 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1413/2544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:22 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:22.671053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:22.671775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:22.679177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.679847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.680916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.681558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.708802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ab01d0e-f1cf-4dea-9923-f968ec8054c8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/ips" status: 200 len: 153 microversion: 2.20 time: 0.041645 Apr 02 21:00:22.710040 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1414/2545] 10.222.0.18 () {60 vars in 1288 bytes} [Sat Apr 2 21:00:22 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:22.722138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:22.722906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:22.739384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.745087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.747573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:22.748305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:22.755315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Updating instance_info_cache with network_info: [{"id": "0c806072-0f4f-4e01-816a-691781e5cbd9", "address": "fa:16:3e:0d:83:7b", "network": {"id": "beb911da-4877-4280-aef6-5e2262f47fca", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1235701871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "56ca6952e8fb440c9a06d487b045cbc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c806072-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 21:00:22.769307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Releasing lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 21:00:22.770465 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b28daf3c-3bb0-4061-9549-3a1b9ad006b3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action" status: 202 len: 0 microversion: 2.1 time: 2.812663 Apr 02 21:00:22.771089 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1132/2546] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:19 2022] POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action => generated 0 bytes in 2814 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 21:00:22.781907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2b138041-51be-4213-a48a-2f4a5a10daa3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'create', calling method: .version_select at 0x7f54d4d1d820>, body: {"pool": "69e968fd-ce84-40ce-a27b-620992c0d153"} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:23.071537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:23.096768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:23.099427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:23.100773 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-136df0b1-c5e8-409f-a27f-3fd14f091560 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.389401 Apr 02 21:00:23.102020 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1415/2547] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:22 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:23.108605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:23.110192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: fd7e09f0-6c85-492e-8a65-b8eccd7e2776] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:23.121061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.122096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.123932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.124676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.152954 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] HTTP exception thrown: Instance fd7e09f0-6c85-492e-8a65-b8eccd7e2776 could not be found. Apr 02 21:00:23.154169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Returning 404 to user: Instance fd7e09f0-6c85-492e-8a65-b8eccd7e2776 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:23.155195 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-186fe271-a25b-4e17-b530-f487a4b873e1 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776" status: 404 len: 111 microversion: 2.1 time: 0.051808 Apr 02 21:00:23.156846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1416/2548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:23 2022] GET /compute/v2.1/servers/fd7e09f0-6c85-492e-8a65-b8eccd7e2776 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:23.167907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:23.169714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:23.179224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.180173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.182624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.183160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.218658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:23.323149 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a6b20fd-9aa7-4584-be61-b209bb280950 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "DELETE /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 204 len: 0 microversion: 2.1 time: 0.160124 Apr 02 21:00:23.324189 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1417/2549] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:23 2022] DELETE /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:23.335587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:23.336332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:23.343745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.344211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.345135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.345576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.589708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:23.602922 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5f868d0-661d-4752-90f7-4332b0f7ba03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1507 microversion: 2.1 time: 0.276930 Apr 02 21:00:23.605451 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1418/2550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:23 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:23.614424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:23.615044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:23.623562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.624032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.624978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.627975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.802962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:23.815918 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d24cf33-5161-4766-bdc4-bd76d2d1e648 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1469 microversion: 2.1 time: 0.208692 Apr 02 21:00:23.818042 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1419/2551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:23 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:23.826706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:23.827405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:23.838092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.838707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:23.840321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:23.840926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.047211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:24.059239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-061b7813-aa97-4bb9-bc25-d1d9886bc8ad tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1723 microversion: 2.1 time: 0.239983 Apr 02 21:00:24.059924 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1420/2552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:23 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:24.121097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:24.122292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:24.140871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.141330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.142373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.142824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.361481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:24.374789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:24.378865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:24.380270 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a8985ce4-7156-4fd4-b29e-f91dd62e6857 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1281 microversion: 2.25 time: 0.264927 Apr 02 21:00:24.380817 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1421/2553] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:24 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1281 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:24.621013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:24.621754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:24.629329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.630145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.630871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.631972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.786657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:24.794801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de02067f-6105-4ff1-a823-16726c99cda7 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1489 microversion: 2.1 time: 0.178849 Apr 02 21:00:24.795694 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1422/2554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:24 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1489 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:24.810961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:24.811694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:24.818490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.819153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.820418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.820900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.846183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:24.880104 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2b138041-51be-4213-a48a-2f4a5a10daa3 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.103870 Apr 02 21:00:24.886494 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1133/2555] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 21:00:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:24.900918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:24.901565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:24.908120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.908629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.909421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.909868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.928693 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5760e0c-c853-444f-b829-f84e5652d579 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 204 len: 0 microversion: 2.1 time: 0.121193 Apr 02 21:00:24.929481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1423/2556] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:24 2022] DELETE /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:00:24.940846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.128"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:24.945577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:24.953014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.953483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.956953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:24.964068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:24.999637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Acquired lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 21:00:25.063324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:25.072132 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4dc520d1-ff39-4eb0-bee8-20de1f6af320 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 200 len: 1469 microversion: 2.1 time: 0.184318 Apr 02 21:00:25.072760 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1134/2557] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:24 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:25.077359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3c89dbb-c999-4d17-8525-5711e8b7a5eb tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4d8fe50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:25.099544 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e3c89dbb-c999-4d17-8525-5711e8b7a5eb tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Image not found. Apr 02 21:00:25.100156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3c89dbb-c999-4d17-8525-5711e8b7a5eb tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:25.101190 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e3c89dbb-c999-4d17-8525-5711e8b7a5eb tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72" status: 404 len: 62 microversion: 2.1 time: 0.027505 Apr 02 21:00:25.101823 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1135/2558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:25 2022] DELETE /compute/v2.1/images/25dc6ebe-da15-43bc-8cf2-6d82e78f7c72 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:25.266371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2d7362d-d9ea-4f34-b7cf-c89759d154a7 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '.version_select at 0x7f54d504c1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:25.337771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c2d7362d-d9ea-4f34-b7cf-c89759d154a7 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b" status: 200 len: 371 microversion: 2.1 time: 0.234867 Apr 02 21:00:25.338359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1136/2559] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:00:25 2022] GET /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:25.343374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:25.344583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:25.351759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.352140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.353807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.354433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.435387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.128 (4d007a40-e1fa-4fd2-912b-923753ebab22) with port 0c806072-0f4f-4e01-816a-691781e5cbd9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 69e968fd-ce84-40ce-a27b-620992c0d153.", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:00:25.436106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Releasing lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 21:00:25.436817 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.128 (4d007a40-e1fa-4fd2-912b-923753ebab22) with port 0c806072-0f4f-4e01-816a-691781e5cbd9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 69e968fd-ce84-40ce-a27b-620992c0d153. Apr 02 21:00:25.436817 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-2539d15e-dec0-4c1f-8da8-ca00d277feb5'] Apr 02 21:00:25.437425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Returning 400 to user: Cannot associate floating IP 172.35.4.128 (4d007a40-e1fa-4fd2-912b-923753ebab22) with port 0c806072-0f4f-4e01-816a-691781e5cbd9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 69e968fd-ce84-40ce-a27b-620992c0d153. Apr 02 21:00:25.437425 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-2539d15e-dec0-4c1f-8da8-ca00d277feb5'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:25.438314 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-965242f4-4e0e-48e3-ba2c-12fb3d79f464 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action" status: 400 len: 382 microversion: 2.1 time: 0.504594 Apr 02 21:00:25.439707 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1424/2560] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:24 2022] POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action => generated 382 bytes in 510 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:00:25.447186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:25.447937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:25.454590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.455050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.455897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.456346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.481199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:25.530253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Instance is already in deleting state, ignoring this request Apr 02 21:00:25.531082 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa0b6e1b-6f45-47e6-87ce-130d3cf3003c tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 204 len: 0 microversion: 2.1 time: 0.090153 Apr 02 21:00:25.531648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1425/2561] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:25 2022] DELETE /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:25.539396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b1f175fb-8f09-4ece-a63d-5e02a997ed9e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Action: 'update', calling method: .version_select at 0x7f54d4766e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:25.570753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:25.583205 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecf19bdc-dc53-4498-a620-a08631e4d6a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1723 microversion: 2.1 time: 0.243521 Apr 02 21:00:25.583898 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1137/2562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:25 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:25.589516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:25.590217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:25.597388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.597941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.599172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.599820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.624091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1f175fb-8f09-4ece-a63d-5e02a997ed9e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.624710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1f175fb-8f09-4ece-a63d-5e02a997ed9e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.625534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1f175fb-8f09-4ece-a63d-5e02a997ed9e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.625981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1f175fb-8f09-4ece-a63d-5e02a997ed9e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.682504 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b1f175fb-8f09-4ece-a63d-5e02a997ed9e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b" status: 200 len: 328 microversion: 2.1 time: 0.149704 Apr 02 21:00:25.688028 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1426/2563] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 21:00:25 2022] PUT /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b => generated 328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:25.699740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:25.700444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:25.708282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.711513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.712447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:25.712984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:25.742174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lazy-loading 'flavor' on Instance uuid a9e92f68-549b-4c9e-bbf9-803500a77d9c {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:25.854489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:25.863696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:25.865938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:25.867355 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f75a6cdb-954d-4caa-a1a0-4dc399aac87b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1477 microversion: 2.25 time: 0.282369 Apr 02 21:00:25.868132 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1138/2564] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:25 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:25.873218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f099b9a0-9141-482e-9529-b8eec5c60845 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '.version_select at 0x7f54d4d25670>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.055637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0c369e6e-365d-48f0-b1cd-99b5334f8c79 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/action" status: 202 len: 0 microversion: 2.20 time: 0.370729 Apr 02 21:00:26.059608 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1427/2565] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:00:25 2022] POST /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:26.065962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.067273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:26.073413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.073878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.074657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.075305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.234147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:26.242358 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1971a285-dda5-45af-937d-a69773b37935 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1495 microversion: 2.1 time: 0.181472 Apr 02 21:00:26.243166 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1428/2566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1495 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:26.247154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3007d6a-fcb8-48df-bc9f-954f7eb1483e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.258153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3007d6a-fcb8-48df-bc9f-954f7eb1483e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b" status: 202 len: 0 microversion: 2.1 time: 0.014137 Apr 02 21:00:26.259271 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1429/2567] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:00:26 2022] DELETE /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b => generated 0 bytes in 16 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:26.265103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-08695b74-b783-46a8-b549-0526003367ee req-81a77061-3f42-406b-85f5-bc9a8bf49a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be683205-2b54-4939-9129-7bb9eebeb181", "name": "network-vif-deleted", "tag": "2331c06a-ee7d-4041-8052-210fa1ebd75e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:26.275321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-08695b74-b783-46a8-b549-0526003367ee req-81a77061-3f42-406b-85f5-bc9a8bf49a4b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.275717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-08695b74-b783-46a8-b549-0526003367ee req-81a77061-3f42-406b-85f5-bc9a8bf49a4b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.291184 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-08695b74-b783-46a8-b549-0526003367ee req-81a77061-3f42-406b-85f5-bc9a8bf49a4b service nova] Creating event network-vif-deleted:2331c06a-ee7d-4041-8052-210fa1ebd75e for instance be683205-2b54-4939-9129-7bb9eebeb181 on nch2-master-1 Apr 02 21:00:26.299556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-08695b74-b783-46a8-b549-0526003367ee req-81a77061-3f42-406b-85f5-bc9a8bf49a4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038949 Apr 02 21:00:26.300400 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1430/2568] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:26.305552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e09815e2-084b-478d-abd2-70d57f9d94b7 req-2290ee78-a9cd-461d-ae1c-c54a3e156d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3863c5cb-fbcc-48ce-b292-bf79b14d0dcc", "name": "network-vif-plugged", "status": "completed", "tag": "06523ba1-b96d-4767-aaa5-bbe2183d6a80"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:26.316493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e09815e2-084b-478d-abd2-70d57f9d94b7 req-2290ee78-a9cd-461d-ae1c-c54a3e156d90 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.316493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e09815e2-084b-478d-abd2-70d57f9d94b7 req-2290ee78-a9cd-461d-ae1c-c54a3e156d90 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.332371 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e09815e2-084b-478d-abd2-70d57f9d94b7 req-2290ee78-a9cd-461d-ae1c-c54a3e156d90 service nova] Creating event network-vif-plugged:06523ba1-b96d-4767-aaa5-bbe2183d6a80 for instance 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc on nch2-master-1 Apr 02 21:00:26.337485 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e09815e2-084b-478d-abd2-70d57f9d94b7 req-2290ee78-a9cd-461d-ae1c-c54a3e156d90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035751 Apr 02 21:00:26.338281 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1431/2569] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:26.348890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.350200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:26.360815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.361642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.362525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.363541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.508255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:26.521980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc50dd61-7d3d-4297-9b0b-13732b8dcc4c tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1970 microversion: 2.25 time: 0.179825 Apr 02 21:00:26.522578 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1432/2570] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1970 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:26.527264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.527870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:26.534300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.534300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.535088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.535562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.685995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f099b9a0-9141-482e-9529-b8eec5c60845 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4d007a40-e1fa-4fd2-912b-923753ebab22" status: 202 len: 0 microversion: 2.1 time: 0.816397 Apr 02 21:00:26.686604 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1139/2571] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:00:25 2022] DELETE /compute/v2.1/os-floating-ips/4d007a40-e1fa-4fd2-912b-923753ebab22 => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:26.692093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.692749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: be683205-2b54-4939-9129-7bb9eebeb181] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:26.699271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.699746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.700573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.701031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.706729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:26.715422 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] HTTP exception thrown: Instance be683205-2b54-4939-9129-7bb9eebeb181 could not be found. Apr 02 21:00:26.716039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Returning 404 to user: Instance be683205-2b54-4939-9129-7bb9eebeb181 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:26.716930 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a18b0ec7-33c5-44ca-9ead-9c0a9a545be7 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181" status: 404 len: 111 microversion: 2.1 time: 0.029388 Apr 02 21:00:26.717500 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1140/2572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/servers/be683205-2b54-4939-9129-7bb9eebeb181 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:26.718493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:26.721017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:26.722455 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e8b302fd-f1ea-4f86-91d9-6170539082fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.198856 Apr 02 21:00:26.722650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6eb2eee-91b7-47fd-8046-1e8c7e939717 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '.version_select at 0x7f54d4c79310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.723644 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1433/2573] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:26.739349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.740039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:26.746616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.747109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.747861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.748312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.791565 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6eb2eee-91b7-47fd-8046-1e8c7e939717 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b" status: 200 len: 371 microversion: 2.1 time: 0.072756 Apr 02 21:00:26.792185 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1141/2574] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/os-quota-sets/ee4e66850cb74ee4b218624f3b4dba7b => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:26.802595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:26.803223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:26.809529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.810002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.810808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:26.811265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:26.893125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:26.911766 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d7f3784-7834-434f-bb67-0ab69d276385 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1970 microversion: 2.25 time: 0.176610 Apr 02 21:00:26.924525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1434/2575] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1970 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:26.924525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.147"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:27.050245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:27.056499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.056964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.057905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.058364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.058779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:27.067062 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f80b59a7-ac13-4c28-a001-51b281f6a0f2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1723 microversion: 2.1 time: 0.268749 Apr 02 21:00:27.077124 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1142/2576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:26 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:27.077124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:27.077124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:27.080670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.081252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.082163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.082760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.108834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:27.200253 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad296fec-3d1b-424e-b684-51ed74386510 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 204 len: 0 microversion: 2.1 time: 0.131090 Apr 02 21:00:27.203716 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1143/2577] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:27 2022] DELETE /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:27.207440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-310c6df2-d6f2-4443-a441-8f8fcc7d9611 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '.version_select at 0x7f54d53fa1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:27.288028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Acquired lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 21:00:27.426520 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-310c6df2-d6f2-4443-a441-8f8fcc7d9611 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.223927 Apr 02 21:00:27.427731 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1144/2578] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:00:27 2022] GET /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b/defaults => generated 371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:27.437038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a2b0f9f-0814-43c6-b5e3-902ea3b3bb19 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:27.439352 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:00:27.439352 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:00:27.442116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2b0f9f-0814-43c6-b5e3-902ea3b3bb19 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.442862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2b0f9f-0814-43c6-b5e3-902ea3b3bb19 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.443925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2b0f9f-0814-43c6-b5e3-902ea3b3bb19 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.444679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a2b0f9f-0814-43c6-b5e3-902ea3b3bb19 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.475048 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a2b0f9f-0814-43c6-b5e3-902ea3b3bb19 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.045701 Apr 02 21:00:27.478427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1145/2579] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Apr 2 21:00:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:00:27.489424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:27.490371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:27.496877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.497474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.498340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.498859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.695475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:27.703407 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ae64903-f7f2-4f0b-a2c0-b41301cd9d91 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1469 microversion: 2.1 time: 0.218515 Apr 02 21:00:27.704820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1146/2580] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:27 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:27.709563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:27.710195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:27.716830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.717372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.718241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.718761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.753910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.754373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.754829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lazy-loading 'fault' on Instance uuid 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:27.795509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e7bca7cae174c2c9b83217ea73a973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784e9ed7207a4d9e970e3d496574e6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:27.803402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b9a22d2-773d-4667-a414-c63f9049aedf tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 200 len: 1298 microversion: 2.1 time: 0.097645 Apr 02 21:00:27.803999 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1147/2581] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:27 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:27.808729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:27.809921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:27.816220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.816715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.817516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:27.817969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:27.842338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'flavor' on Instance uuid 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:27.853950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Going to try to live migrate instance to nch1-master-1 {{(pid=136517) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 21:00:28.338216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Building network info cache for instance {{(pid=136518) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 21:00:29.412618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Updating instance_info_cache with network_info: [{"id": "0c806072-0f4f-4e01-816a-691781e5cbd9", "address": "fa:16:3e:0d:83:7b", "network": {"id": "beb911da-4877-4280-aef6-5e2262f47fca", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1235701871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "56ca6952e8fb440c9a06d487b045cbc0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c806072-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 21:00:29.438107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Releasing lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 21:00:29.439267 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba5b9b3a-5f6d-4bc2-ad6e-d2de3bc25fab tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action" status: 202 len: 0 microversion: 2.1 time: 2.520804 Apr 02 21:00:29.443355 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1435/2582] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:26 2022] POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action => generated 0 bytes in 2527 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 21:00:29.445543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1cd9f80d-b79d-4a72-b3b3-2d5108af6bb2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Action: 'update', calling method: .version_select at 0x7f54d45cf790>, body: {"quota_set": {"ram": "5120"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:29.625409 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c/action" status: 202 len: 0 microversion: 2.25 time: 1.820221 Apr 02 21:00:29.626102 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1148/2583] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:00:27 2022] POST /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c/action => generated 0 bytes in 1822 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:29.631515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:29.632169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:29.659469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.660017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.660819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.663862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.721371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cd9f80d-b79d-4a72-b3b3-2d5108af6bb2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.722355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cd9f80d-b79d-4a72-b3b3-2d5108af6bb2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.723532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cd9f80d-b79d-4a72-b3b3-2d5108af6bb2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.724481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cd9f80d-b79d-4a72-b3b3-2d5108af6bb2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.804918 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1cd9f80d-b79d-4a72-b3b3-2d5108af6bb2 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d" status: 200 len: 328 microversion: 2.1 time: 0.362236 Apr 02 21:00:29.807059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1436/2584] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 21:00:29 2022] PUT /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d => generated 328 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:29.820561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:29.822988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:29.833786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.834519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.835488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.836189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.880854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:29.895247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:29.897325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:29.898814 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f7accd08-9277-4066-92bf-0c36358ab0cf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.271374 Apr 02 21:00:29.899890 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1149/2585] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:29 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:29.904812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-bcc05858-e16b-4eb2-9dd3-3ae8c733543e req-e18ad0d2-0996-458a-977d-4588286c714d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3863c5cb-fbcc-48ce-b292-bf79b14d0dcc", "name": "network-vif-deleted", "tag": "06523ba1-b96d-4767-aaa5-bbe2183d6a80"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:29.914531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bcc05858-e16b-4eb2-9dd3-3ae8c733543e req-e18ad0d2-0996-458a-977d-4588286c714d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.914910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bcc05858-e16b-4eb2-9dd3-3ae8c733543e req-e18ad0d2-0996-458a-977d-4588286c714d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.927590 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-bcc05858-e16b-4eb2-9dd3-3ae8c733543e req-e18ad0d2-0996-458a-977d-4588286c714d service nova] Creating event network-vif-deleted:06523ba1-b96d-4767-aaa5-bbe2183d6a80 for instance 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc on nch2-master-1 Apr 02 21:00:29.932923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-bcc05858-e16b-4eb2-9dd3-3ae8c733543e req-e18ad0d2-0996-458a-977d-4588286c714d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031470 Apr 02 21:00:29.933908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1150/2586] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:29.941116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a9465ae1-3320-4920-bc6f-796d757dacce req-3a3bf38f-a671-4ecd-a50c-a55d9bdfc68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987ad6d2-f2dd-4d82-901a-4b73f5721684", "tag": "0c806072-0f4f-4e01-816a-691781e5cbd9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:29.952218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a9465ae1-3320-4920-bc6f-796d757dacce req-3a3bf38f-a671-4ecd-a50c-a55d9bdfc68a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.953208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a9465ae1-3320-4920-bc6f-796d757dacce req-3a3bf38f-a671-4ecd-a50c-a55d9bdfc68a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.968561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a9465ae1-3320-4920-bc6f-796d757dacce req-3a3bf38f-a671-4ecd-a50c-a55d9bdfc68a service nova] Creating event network-changed:0c806072-0f4f-4e01-816a-691781e5cbd9 for instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 on nch1-master-1 Apr 02 21:00:29.974736 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a9465ae1-3320-4920-bc6f-796d757dacce req-3a3bf38f-a671-4ecd-a50c-a55d9bdfc68a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037774 Apr 02 21:00:29.976045 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1151/2587] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:29.983051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:29.984091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:29.991312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.991779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:29.992755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:29.993319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.034749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.035221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.035696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lazy-loading 'fault' on Instance uuid 7b367d88-0807-449d-bd01-d227a66e6958 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:30.057020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:30.066579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-694accf0-8cba-4ef3-93f8-a9b93a1bcaab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1700 microversion: 2.1 time: 0.258175 Apr 02 21:00:30.078512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1437/2588] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:29 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1700 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:30.084161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:30.085360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:30.091624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.092096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.096501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.096501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.108046 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc could not be found. Apr 02 21:00:30.108673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance 3863c5cb-fbcc-48ce-b292-bf79b14d0dcc could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:30.109654 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e334614-230b-4901-9b90-9913a9bb24d6 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc" status: 404 len: 111 microversion: 2.1 time: 0.030010 Apr 02 21:00:30.110419 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1438/2589] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:30 2022] GET /compute/v2.1/servers/3863c5cb-fbcc-48ce-b292-bf79b14d0dcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:30.116677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9953e57681446849124a494fa1cdf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd84de315abb1452fa5187770db66041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:30.118924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29bfeef0-c46f-4e6d-ac0e-41557586fc52 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '.version_select at 0x7f54d47584c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:30.130143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65a505df-e51e-42be-9537-8d5dbe3373fa tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 200 len: 1303 microversion: 2.1 time: 0.152040 Apr 02 21:00:30.130738 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1152/2590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:29 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:30.144950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:30.145584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:30.151825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.152295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.153120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.153572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.424682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:30.434395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:30.441614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:30.443113 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acd40951-4a87-409f-8ba2-32fa4410c61f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.311127 Apr 02 21:00:30.444108 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1153/2591] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:30 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:30.451857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d19d0b30-45d8-42d7-b76d-d173d44345a4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '.version_select at 0x7f54d4c01790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:30.543114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d19d0b30-45d8-42d7-b76d-d173d44345a4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.543582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d19d0b30-45d8-42d7-b76d-d173d44345a4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.545074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d19d0b30-45d8-42d7-b76d-d173d44345a4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.549246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d19d0b30-45d8-42d7-b76d-d173d44345a4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.572006 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d19d0b30-45d8-42d7-b76d-d173d44345a4 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d/detail" status: 200 len: 916 microversion: 2.1 time: 0.126538 Apr 02 21:00:30.573045 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1154/2592] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:00:30 2022] GET /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d/detail => generated 916 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:30.579541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3fc258dc-f213-4509-a0ce-dfb7120069f0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:30.586365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3fc258dc-f213-4509-a0ce-dfb7120069f0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.587218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3fc258dc-f213-4509-a0ce-dfb7120069f0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.614860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3fc258dc-f213-4509-a0ce-dfb7120069f0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Going to try to start instance {{(pid=136517) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:00:30.678951 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3fc258dc-f213-4509-a0ce-dfb7120069f0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action" status: 202 len: 0 microversion: 2.1 time: 0.103981 Apr 02 21:00:30.690228 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1155/2593] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:30 2022] POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:30.707651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a500e68-4b5f-46c2-8f2b-c935a3923361 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4c24040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:30.759758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5a500e68-4b5f-46c2-8f2b-c935a3923361 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Image not found. Apr 02 21:00:30.760403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a500e68-4b5f-46c2-8f2b-c935a3923361 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:30.761607 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5a500e68-4b5f-46c2-8f2b-c935a3923361 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c" status: 404 len: 62 microversion: 2.1 time: 0.070032 Apr 02 21:00:30.762203 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1156/2594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:30 2022] DELETE /compute/v2.1/images/e93392e9-5cf6-41a0-a1a6-6c41d968094c => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:30.767880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:30.768678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:30.776821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.777445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:30.778249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:30.778811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.006012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.015710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1472c816-8d05-4e82-8f28-eba9e9c81c29 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1709 microversion: 2.1 time: 0.252265 Apr 02 21:00:31.016652 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1157/2595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:30 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1709 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:31.021509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.022155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.028817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.029304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.030093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.030867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.063668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance 00b05964-ec44-4336-bb67-fabe511c77aa could not be found. Apr 02 21:00:31.064783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance 00b05964-ec44-4336-bb67-fabe511c77aa could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.066378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42b97d3a-c5f2-45a9-890a-128b80546e03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 404 len: 111 microversion: 2.1 time: 0.048171 Apr 02 21:00:31.067331 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1158/2596] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:31 2022] DELETE /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:31.074637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Action: 'update', calling method: .version_select at 0x7f54d42191f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:31.183854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.184297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.185335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.185860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.225433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.226136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.227098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.228286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.293390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e3456bac-e030-4ad0-b640-1718f0e7ee4a tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d?user_id=1075b4ad158f4193a4b58a003d74942a" status: 200 len: 328 microversion: 2.1 time: 0.223960 Apr 02 21:00:31.294500 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1159/2597] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:00:31 2022] PUT /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d?user_id=1075b4ad158f4193a4b58a003d74942a => generated 328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:31.299557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.300244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.307484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.308050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.308939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.309459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.432480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29bfeef0-c46f-4e6d-ac0e-41557586fc52 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/4f0409d9-18d8-4449-a1b6-ed3fbf33e506" status: 202 len: 0 microversion: 2.1 time: 1.317680 Apr 02 21:00:31.434573 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1439/2598] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:00:30 2022] DELETE /compute/v2.1/os-floating-ips/4f0409d9-18d8-4449-a1b6-ed3fbf33e506 => generated 0 bytes in 1323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:00:31.442290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.443577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 00b05964-ec44-4336-bb67-fabe511c77aa] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.460493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.461248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.464122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.464641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.482759 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance 00b05964-ec44-4336-bb67-fabe511c77aa could not be found. Apr 02 21:00:31.483492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance 00b05964-ec44-4336-bb67-fabe511c77aa could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.484410 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4af36f25-1644-40d2-869d-15bb620b51d5 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa" status: 404 len: 111 microversion: 2.1 time: 0.048271 Apr 02 21:00:31.485174 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1440/2599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:31 2022] GET /compute/v2.1/servers/00b05964-ec44-4336-bb67-fabe511c77aa => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:31.491922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.492796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] [instance: 7b367d88-0807-449d-bd01-d227a66e6958] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.499767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.500228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.501070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.501527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.516375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] HTTP exception thrown: Instance 7b367d88-0807-449d-bd01-d227a66e6958 could not be found. Apr 02 21:00:31.517560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] Returning 404 to user: Instance 7b367d88-0807-449d-bd01-d227a66e6958 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.518419 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a8aa9d7-05c3-4ee6-9e2f-ccb96a5bc5d0 tempest-ServersAdminTestJSON-1400430964 tempest-ServersAdminTestJSON-1400430964-project] 10.222.0.18 "GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958" status: 404 len: 111 microversion: 2.1 time: 0.032011 Apr 02 21:00:31.519337 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1441/2600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:31 2022] GET /compute/v2.1/servers/7b367d88-0807-449d-bd01-d227a66e6958 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:31.524358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-729f57a9-d079-4f0e-94c9-106e9761416b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '.version_select at 0x7f54d4d18ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.580247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.591315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.592646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.595969 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a27ec4d-1a5a-47de-969f-b07e30995a85 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.300248 Apr 02 21:00:31.599338 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1160/2601] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:31 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:31.604924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b04107bf-fbf9-4d94-8bbb-8c1bbf64ab02 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:31.606239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b04107bf-fbf9-4d94-8bbb-8c1bbf64ab02 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.607045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b04107bf-fbf9-4d94-8bbb-8c1bbf64ab02 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action" status: 400 len: 142 microversion: 2.1 time: 0.006684 Apr 02 21:00:31.607567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1161/2602] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:31 2022] POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action => generated 142 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:00:31.622283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.623675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.632346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.633137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.634154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.634798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.659611 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-729f57a9-d079-4f0e-94c9-106e9761416b tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d?user_id=1075b4ad158f4193a4b58a003d74942a" status: 200 len: 370 microversion: 2.1 time: 0.136900 Apr 02 21:00:31.661398 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1442/2603] 10.222.0.18 () {58 vars in 1322 bytes} [Sat Apr 2 21:00:31 2022] GET /compute/v2.1/os-quota-sets/f7f0ec86b93c4dd189c56134bd05e47d?user_id=1075b4ad158f4193a4b58a003d74942a => generated 370 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:31.674514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87c7b441-3a97-4b5b-a0a3-3a89dce34569 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d47a1040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.703088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-87c7b441-3a97-4b5b-a0a3-3a89dce34569 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Image not found. Apr 02 21:00:31.703979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87c7b441-3a97-4b5b-a0a3-3a89dce34569 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Image not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.705690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87c7b441-3a97-4b5b-a0a3-3a89dce34569 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006" status: 404 len: 62 microversion: 2.1 time: 0.040282 Apr 02 21:00:31.707179 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1443/2604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:31 2022] DELETE /compute/v2.1/images/b10d036d-92e1-4ded-9a15-b19d9167f006 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:31.714610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:31.721145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.727747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.728310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.729467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.730363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.772390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Acquired lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 21:00:31.869540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.884304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.889472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:31.890542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f180d0e3-38bb-412a-ade9-0e6207969e1c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.282085 Apr 02 21:00:31.891121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1162/2605] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:31 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:31.899064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.899680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.907692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.908141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.909257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.909386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.940983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance a010647f-dc6e-4a5e-9767-100a054b5fda could not be found. Apr 02 21:00:31.941638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance a010647f-dc6e-4a5e-9767-100a054b5fda could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.942513 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fafd7632-1ab0-457a-bd22-d729e6068e76 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 404 len: 111 microversion: 2.1 time: 0.050463 Apr 02 21:00:31.943094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1163/2606] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:31 2022] DELETE /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:31.960874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-714ef0a3-a92a-48dc-888f-c562c908f187 req-8dfb3924-5c46-4a07-a6f6-67c83019deb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b367d88-0807-449d-bd01-d227a66e6958", "name": "network-vif-deleted", "tag": "2249859f-5022-4c72-a7ee-251258b261cb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:31.980605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-714ef0a3-a92a-48dc-888f-c562c908f187 req-8dfb3924-5c46-4a07-a6f6-67c83019deb2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:31.981994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Releasing lock "refresh_cache-987ad6d2-f2dd-4d82-901a-4b73f5721684" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 21:00:31.983038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] HTTP exception thrown: floating IP not found Apr 02 21:00:31.983191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Returning 404 to user: floating IP not found {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:31.984732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-714ef0a3-a92a-48dc-888f-c562c908f187 req-8dfb3924-5c46-4a07-a6f6-67c83019deb2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:31.985325 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7908576-09de-4b40-b912-0d8b05cbd4f5 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action" status: 404 len: 67 microversion: 2.1 time: 0.276623 Apr 02 21:00:31.991645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1444/2607] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:31 2022] POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action => generated 67 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:31.997060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:31.998132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: a010647f-dc6e-4a5e-9767-100a054b5fda] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:31.999991 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-714ef0a3-a92a-48dc-888f-c562c908f187 req-8dfb3924-5c46-4a07-a6f6-67c83019deb2 service nova] Creating event network-vif-deleted:2249859f-5022-4c72-a7ee-251258b261cb for instance 7b367d88-0807-449d-bd01-d227a66e6958 on nch1-master-1 Apr 02 21:00:32.006204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.006990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.007182 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-714ef0a3-a92a-48dc-888f-c562c908f187 req-8dfb3924-5c46-4a07-a6f6-67c83019deb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056613 Apr 02 21:00:32.007955 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1164/2608] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:32.008514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.009312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.017028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-871c64db-ff85-4252-8c34-73d2d6567fe8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:32.028950 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance a010647f-dc6e-4a5e-9767-100a054b5fda could not be found. Apr 02 21:00:32.029566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance a010647f-dc6e-4a5e-9767-100a054b5fda could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:32.030477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-83e15fe7-f57c-4c57-9d21-441101157f03 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda" status: 404 len: 111 microversion: 2.1 time: 0.037822 Apr 02 21:00:32.031070 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1445/2609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:31 2022] GET /compute/v2.1/servers/a010647f-dc6e-4a5e-9767-100a054b5fda => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:32.037200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.038272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.044895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.045828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.046910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.047582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.075286 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-871c64db-ff85-4252-8c34-73d2d6567fe8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Apr 02 21:00:32.076003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-871c64db-ff85-4252-8c34-73d2d6567fe8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:32.082696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-871c64db-ff85-4252-8c34-73d2d6567fe8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action" status: 404 len: 88 microversion: 2.1 time: 0.069364 Apr 02 21:00:32.082696 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1165/2610] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:00:32 2022] POST /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684/action => generated 88 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:32.094336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0824af4-14bd-4f0c-a7dc-eb61de3c88f9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '.version_select at 0x7f54d4b14b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.125456 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c0824af4-14bd-4f0c-a7dc-eb61de3c88f9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Image not found. Apr 02 21:00:32.127700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0824af4-14bd-4f0c-a7dc-eb61de3c88f9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:32.128981 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0824af4-14bd-4f0c-a7dc-eb61de3c88f9 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d" status: 404 len: 62 microversion: 2.1 time: 0.040951 Apr 02 21:00:32.132159 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1166/2611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:32 2022] DELETE /compute/v2.1/images/8af4bcb9-8c3a-4215-adfa-eb8573e0ce0d => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:00:32.134432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.135070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.142126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.142837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.143389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.143840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.174612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:32.217073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:32.226065 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77969328-dd25-4742-a89b-931c0f585f10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1709 microversion: 2.1 time: 0.193714 Apr 02 21:00:32.226856 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1446/2612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:32 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:32.234429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4f83f0e-d517-4d84-b517-6551b99b3d1e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Calling method '.version_select at 0x7f54d4758e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.266914 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-27058d94-be9f-41b4-afd0-cd61f6bc0a57 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "DELETE /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 204 len: 0 microversion: 2.1 time: 0.135790 Apr 02 21:00:32.268078 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1167/2613] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:32 2022] DELETE /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:32.275210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.275840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.281898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.283166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.283944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.284386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.299417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance 3ea0ad92-ff3e-49af-b783-93700d77d500 could not be found. Apr 02 21:00:32.300028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance 3ea0ad92-ff3e-49af-b783-93700d77d500 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:32.300912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b85fe87-c097-4139-97e8-1b65f072d396 tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 404 len: 111 microversion: 2.1 time: 0.031519 Apr 02 21:00:32.301694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1168/2614] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:32 2022] DELETE /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:32.307988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.308668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.314641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.315104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.315889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.316336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.460629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:32.467516 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4f83f0e-d517-4d84-b517-6551b99b3d1e tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.239298 Apr 02 21:00:32.468330 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1447/2615] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:00:32 2022] GET /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b/defaults => generated 371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:32.468496 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f533dd6-738f-4634-82db-ca1b2002b76e tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1543 microversion: 2.1 time: 0.165912 Apr 02 21:00:32.469006 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1169/2616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:32 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1543 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:32.484196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-253d3698-137d-4db4-8b33-95194eff8b72 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Action: 'update', calling method: .version_select at 0x7f54d4d8fdc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:32.487505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.488513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] [instance: 3ea0ad92-ff3e-49af-b783-93700d77d500] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.503713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.504177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.510083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.511137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.531703 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] HTTP exception thrown: Instance 3ea0ad92-ff3e-49af-b783-93700d77d500 could not be found. Apr 02 21:00:32.533197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] Returning 404 to user: Instance 3ea0ad92-ff3e-49af-b783-93700d77d500 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:32.534470 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03370125-729c-4d63-949f-4a1f33c3caab tempest-ImagesTestJSON-724739985 tempest-ImagesTestJSON-724739985-project] 10.222.0.18 "GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500" status: 404 len: 111 microversion: 2.1 time: 0.065222 Apr 02 21:00:32.535053 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1448/2617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:32 2022] GET /compute/v2.1/servers/3ea0ad92-ff3e-49af-b783-93700d77d500 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:32.576510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-253d3698-137d-4db4-8b33-95194eff8b72 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.577294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-253d3698-137d-4db4-8b33-95194eff8b72 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.580429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-253d3698-137d-4db4-8b33-95194eff8b72 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.582777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-253d3698-137d-4db4-8b33-95194eff8b72 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.617598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.618541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.630169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.630841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.631642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.632088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.827297 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-253d3698-137d-4db4-8b33-95194eff8b72 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b" status: 200 len: 329 microversion: 2.1 time: 0.346704 Apr 02 21:00:32.828229 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1170/2618] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Apr 2 21:00:32 2022] PUT /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b => generated 329 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:32.840137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d119ee05-37aa-4413-81ff-072d1b230357 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Action: 'update', calling method: .version_select at 0x7f54d4c240d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:32.897624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:32.911792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:32.913452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:32.914658 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05c02eeb-6494-4aee-93e6-87cfb40ed183 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.302867 Apr 02 21:00:32.928060 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1449/2619] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:32 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:32.928060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:32.928060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:32.937297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.937786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:32.938591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:32.939121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.123424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d119ee05-37aa-4413-81ff-072d1b230357 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.123954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d119ee05-37aa-4413-81ff-072d1b230357 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.124716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d119ee05-37aa-4413-81ff-072d1b230357 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.125197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d119ee05-37aa-4413-81ff-072d1b230357 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.240566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:33.249644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:33.251728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:33.254735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-901d9eea-3c4f-4023-a4fb-d82ad85e317b tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.338477 Apr 02 21:00:33.255713 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1450/2620] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:32 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:33.264701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:33.265687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:33.273770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.274482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.275505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.275948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.497011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:33.507309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d657a311-b5f2-4fca-bddf-1c43cd1f33f9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1713 microversion: 2.1 time: 0.249412 Apr 02 21:00:33.508436 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1451/2621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:33 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1713 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:33.526694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:33.528604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:33.537526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.538591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.539714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.541090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.548770 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d119ee05-37aa-4413-81ff-072d1b230357 tempest-QuotasAdminTestJSON-1248983099 tempest-QuotasAdminTestJSON-1248983099-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b" status: 200 len: 329 microversion: 2.1 time: 0.712540 Apr 02 21:00:33.550000 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1171/2622] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Apr 2 21:00:32 2022] PUT /compute/v2.1/os-quota-sets/aa687e6fcec34214b7558572a2832f9b => generated 329 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:33.732191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:33.740255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3fb3609d-9c0c-42a8-a192-6441ed98477c tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1543 microversion: 2.1 time: 0.221428 Apr 02 21:00:33.741294 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1452/2623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:33 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1543 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:33.941090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:33.941715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:33.949087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.949550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:33.950969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:33.951422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:34.275632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:34.277081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:34.288173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:34.288681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:34.289493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:34.293066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:34.511515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:34.524249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:34.527146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:34.528815 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a02e436-8971-4be1-833d-c2facaafda31 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.592747 Apr 02 21:00:34.529635 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1172/2624] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:33 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:34.551750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:34.559832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:34.561406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:34.562587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-784ac0d1-2341-4b53-9ffb-ffd8c5107fa4 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.291782 Apr 02 21:00:34.564430 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1453/2625] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:34 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:34.758435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:34.759152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:34.769204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:34.769671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:34.770475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:34.770925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.010076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-591055262", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:35.087619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:00:35.101279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599136c98fd4400898e3468875543781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ca6952e8fb440c9a06d487b045cbc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:35.113096 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b837edcc-2321-46e4-9973-c293bbc2a5ca tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 200 len: 1543 microversion: 2.1 time: 0.358827 Apr 02 21:00:35.119342 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1454/2626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:34 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 1543 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:35.187006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ccf526e0-2868-4041-9f0f-9fbfd2692a8a req-dc70d368-f998-4142-82bd-9b10f99138fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987ad6d2-f2dd-4d82-901a-4b73f5721684", "name": "network-vif-deleted", "tag": "0c806072-0f4f-4e01-816a-691781e5cbd9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:35.200743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ccf526e0-2868-4041-9f0f-9fbfd2692a8a req-dc70d368-f998-4142-82bd-9b10f99138fa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.203578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ccf526e0-2868-4041-9f0f-9fbfd2692a8a req-dc70d368-f998-4142-82bd-9b10f99138fa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.223682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ccf526e0-2868-4041-9f0f-9fbfd2692a8a req-dc70d368-f998-4142-82bd-9b10f99138fa service nova] Creating event network-vif-deleted:0c806072-0f4f-4e01-816a-691781e5cbd9 for instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 on nch1-master-1 Apr 02 21:00:35.239065 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ccf526e0-2868-4041-9f0f-9fbfd2692a8a req-dc70d368-f998-4142-82bd-9b10f99138fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055610 Apr 02 21:00:35.242731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1455/2627] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:35.513607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb99ad4e-9b26-4cd3-a8e5-ede88bfb4e47 tempest-AZV2TestJSON-273699244 tempest-AZV2TestJSON-273699244-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:35.515668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb99ad4e-9b26-4cd3-a8e5-ede88bfb4e47 tempest-AZV2TestJSON-273699244 tempest-AZV2TestJSON-273699244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.516134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb99ad4e-9b26-4cd3-a8e5-ede88bfb4e47 tempest-AZV2TestJSON-273699244 tempest-AZV2TestJSON-273699244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.517753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb99ad4e-9b26-4cd3-a8e5-ede88bfb4e47 tempest-AZV2TestJSON-273699244 tempest-AZV2TestJSON-273699244-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.518070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb99ad4e-9b26-4cd3-a8e5-ede88bfb4e47 tempest-AZV2TestJSON-273699244 tempest-AZV2TestJSON-273699244-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.554319 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb99ad4e-9b26-4cd3-a8e5-ede88bfb4e47 tempest-AZV2TestJSON-273699244 tempest-AZV2TestJSON-273699244-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.248369 Apr 02 21:00:35.556193 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1456/2628] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Apr 2 21:00:35 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:00:35.565783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7d04b102-b199-4c8d-a279-c6e4fcd0a9b2 req-48972122-4aeb-4018-86e2-c4b9b9405224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760e84eb-7fa1-420b-9884-1f3c0e6f3d8c", "name": "network-vif-unplugged", "status": "completed", "tag": "2f0b5d01-2163-42f7-ad38-54ff616d2346"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:35.582030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7d04b102-b199-4c8d-a279-c6e4fcd0a9b2 req-48972122-4aeb-4018-86e2-c4b9b9405224 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.582840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7d04b102-b199-4c8d-a279-c6e4fcd0a9b2 req-48972122-4aeb-4018-86e2-c4b9b9405224 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.589813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:00:35.590350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:00:35.590717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:00:35.591136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:00:35.591560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:00:35.598882 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7d04b102-b199-4c8d-a279-c6e4fcd0a9b2 req-48972122-4aeb-4018-86e2-c4b9b9405224 service nova] Creating event network-vif-unplugged:2f0b5d01-2163-42f7-ad38-54ff616d2346 for instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c on nch2-master-1 Apr 02 21:00:35.605367 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7d04b102-b199-4c8d-a279-c6e4fcd0a9b2 req-48972122-4aeb-4018-86e2-c4b9b9405224 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046623 Apr 02 21:00:35.607175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1457/2629] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:35.608121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.608611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.609430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.610376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.613862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:35.615039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:35.626678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.627907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.630821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.632573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.647470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Getting quotas for project b271883cfeac443e8f5d5f2e555835d7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:35.654633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Getting quotas for user 7a9228e1bd8248bba26145bdbf7e2378 and project b271883cfeac443e8f5d5f2e555835d7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:35.674464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:00:35.702399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:00:35.849074 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00a60ef9-b28c-4ae6-a50f-0b4dcbbd311e tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185822 Apr 02 21:00:35.862485 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1173/2630] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:00:35.894745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:35.895377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:35.915551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:35.918484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.919175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.921818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:35.924366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:35.925855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:35.928040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:35.930027 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-acf782eb-67bb-497e-9ee3-e76a505fca0a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.320957 Apr 02 21:00:35.931813 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1458/2631] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:35 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:35.938508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c17382d-2d57-4b60-8e1a-0c2b4beaf30a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:35.940172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c17382d-2d57-4b60-8e1a-0c2b4beaf30a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:36.027396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c17382d-2d57-4b60-8e1a-0c2b4beaf30a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:36.039305 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c17382d-2d57-4b60-8e1a-0c2b4beaf30a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1215 microversion: 2.1 time: 0.105996 Apr 02 21:00:36.041141 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1459/2632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:35 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:36.137119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:36.137925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] [instance: 987ad6d2-f2dd-4d82-901a-4b73f5721684] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:36.147633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:36.148738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:36.149550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:36.150189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:36.167225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] HTTP exception thrown: Instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 could not be found. Apr 02 21:00:36.168024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] Returning 404 to user: Instance 987ad6d2-f2dd-4d82-901a-4b73f5721684 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:36.168903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf350a90-7f25-49fe-ac66-5fe6c0b791c8 tempest-FloatingIPsAssociationNegativeTestJSON-149582311 tempest-FloatingIPsAssociationNegativeTestJSON-149582311-project] 10.222.0.18 "GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684" status: 404 len: 111 microversion: 2.1 time: 0.037227 Apr 02 21:00:36.175957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:36.183096 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1460/2633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:36 2022] GET /compute/v2.1/servers/987ad6d2-f2dd-4d82-901a-4b73f5721684 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:00:36.187657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:36.190229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:36.193303 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f672e3e2-acd4-4937-8336-47e501bdffbf tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.330112 Apr 02 21:00:36.194401 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1174/2634] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:35 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:36.950487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:36.951196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:36.972566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:36.974550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:36.975637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:36.978001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:37.059956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:37.062546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:37.075838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:37.076576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:37.077580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:37.080277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:37.179385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.188806 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f031aa7a-4145-4341-97b2-d4577d4d572d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1267 microversion: 2.1 time: 0.134642 Apr 02 21:00:37.193075 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1175/2635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:37 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:37.214315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:37.215066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:37.224993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:37.226174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:37.227706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:37.228543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:37.237743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.250261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.256656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.258356 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76fcb7e9-6341-4a92-a608-a486821381d6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1745 microversion: 2.20 time: 0.312206 Apr 02 21:00:37.259345 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1461/2636] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:36 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1745 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:37.570796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.589413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.591061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:37.592497 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d2e591c3-0fa4-472f-acc2-52ebd9c477d0 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.383790 Apr 02 21:00:37.593235 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1176/2637] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:37 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:37.635908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-250d5513-30c1-4f2a-9abe-28d223601e77 req-5cda0047-3ecc-4013-8de5-d500e8d69c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760e84eb-7fa1-420b-9884-1f3c0e6f3d8c", "tag": "2f0b5d01-2163-42f7-ad38-54ff616d2346"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:37.649886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-250d5513-30c1-4f2a-9abe-28d223601e77 req-5cda0047-3ecc-4013-8de5-d500e8d69c2b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:37.650379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-250d5513-30c1-4f2a-9abe-28d223601e77 req-5cda0047-3ecc-4013-8de5-d500e8d69c2b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:37.666866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-250d5513-30c1-4f2a-9abe-28d223601e77 req-5cda0047-3ecc-4013-8de5-d500e8d69c2b service nova] Creating event network-changed:2f0b5d01-2163-42f7-ad38-54ff616d2346 for instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c on nch2-master-1 Apr 02 21:00:37.672510 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-250d5513-30c1-4f2a-9abe-28d223601e77 req-5cda0047-3ecc-4013-8de5-d500e8d69c2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042226 Apr 02 21:00:37.674080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1462/2638] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:38.139531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-580810078", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": "none"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:38.200230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:00:38.201372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:00:38.202069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:00:38.202882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:00:38.203484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:00:38.209512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:38.212016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:38.221345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.223272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.224138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.226657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.226926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.228771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.230079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.230701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.256711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Getting quotas for project 0e9312a463f0419ca125b1155492d2c5. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:38.263266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Getting quotas for user 41359fff35654f228021d168daf5f8d3 and project 0e9312a463f0419ca125b1155492d2c5. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:38.286668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:00:38.302789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:00:38.397181 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be323ca3-010f-4d91-a487-29d1e0d08bfb tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.565903 Apr 02 21:00:38.408157 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1177/2639] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 21:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 21:00:38.413467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:38.418080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:38.438159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.440926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.442971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.443673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.550530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.568288 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7341df3-027e-44f2-b00d-851a3dc78ebb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1273 microversion: 2.1 time: 0.364845 Apr 02 21:00:38.569528 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1463/2640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:38 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1273 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:38.575211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48736182-66e0-4ec3-97f4-1e0adbd8f9b6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:38.577552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48736182-66e0-4ec3-97f4-1e0adbd8f9b6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:38.692995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48736182-66e0-4ec3-97f4-1e0adbd8f9b6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.701460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48736182-66e0-4ec3-97f4-1e0adbd8f9b6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.703865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48736182-66e0-4ec3-97f4-1e0adbd8f9b6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.713201 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48736182-66e0-4ec3-97f4-1e0adbd8f9b6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "PUT /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1358 microversion: 2.75 time: 0.142055 Apr 02 21:00:38.715543 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1464/2641] 10.222.0.18 () {62 vars in 1296 bytes} [Sat Apr 2 21:00:38 2022] PUT /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:38.741135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:38.742486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:38.750420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.751140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.752104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:38.752751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:38.976823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.992124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.994375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:38.995864 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eda03fc6-e669-4590-95be-8bdff49ab330 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1745 microversion: 2.20 time: 0.586384 Apr 02 21:00:38.997228 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1178/2642] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:38 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1745 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:39.006375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56910270-0736-44da-8243-d6587e33f0dd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:39.007547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56910270-0736-44da-8243-d6587e33f0dd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:39.148104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56910270-0736-44da-8243-d6587e33f0dd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:39.160103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56910270-0736-44da-8243-d6587e33f0dd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:39.164252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56910270-0736-44da-8243-d6587e33f0dd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:39.174862 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56910270-0736-44da-8243-d6587e33f0dd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1358 microversion: 2.75 time: 0.171288 Apr 02 21:00:39.181832 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1179/2643] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:38 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:39.202998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:39.241887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:39.247580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:39.249273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c0e1bef-2ff3-49fd-83bf-5e75712edc6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.519074 Apr 02 21:00:39.251410 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1465/2644] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:38 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:39.586957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:39.587858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:39.602936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:39.608192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:39.614383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:39.615961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.018191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:40.019358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:40.036848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:40.038701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.040025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:40.041949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.551259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.564716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.577457 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f4b5695-db1c-46b9-a891-3dc45b1ded14 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 0.995080 Apr 02 21:00:40.577730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.578379 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1180/2645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:39 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:40.580433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.582194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4928a48-3566-4beb-b050-b7f97de2b2d7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.570828 Apr 02 21:00:40.594580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:40.594580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:40.595864 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1466/2646] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:40 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:40.601825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:40.602720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:40.616962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:40.617421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.618209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:40.618650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.618778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:40.619460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.620519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:40.621202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:40.912234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.921374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.924809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:40.926348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4055d1a6-2321-4ab4-a4cc-24bed09277ac tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.329166 Apr 02 21:00:40.927495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1467/2647] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:40 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:41.010949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:41.028081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:41.029793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:41.047832 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58aa7a8c-0063-4855-817b-e1c7f29eda93 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1416 microversion: 2.75 time: 0.468292 Apr 02 21:00:41.059054 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1181/2648] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:40 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1416 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:41.148540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-49527407", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:41.220622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:00:41.597388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:41.598845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:41.611045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:41.611786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:41.613537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:41.614225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:41.890310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:00:41.890849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:00:41.892119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:00:41.892672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:00:41.893492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:00:41.905605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:41.906207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:41.908136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:41.908845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:41.934158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:41.941600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:41.960616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:00:41.963871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:00:42.040239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08fc2d3c-ba8c-480b-b115-9e5ff2425b36 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110675 Apr 02 21:00:42.051210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1468/2649] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:00:42.057013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:42.058095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:42.068618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.072560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.073806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.081969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.387627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.406909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.415038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.418255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b626620-3745-4517-8b68-4c5ae585366d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.364119 Apr 02 21:00:42.420269 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1469/2650] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:42 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:42.420757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.434589 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b103368d-ace8-447b-b578-32df88300f65 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 0.843586 Apr 02 21:00:42.435755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-11878220-5d4e-44db-87fe-9cd3eaf05cc9 req-2cc8027e-a010-4b3b-9841-a819437f4c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c451750-95c9-45f1-aa8d-6f96ba7040df", "tag": "86734008-b39f-4f81-80a0-6f3c477fc49f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:42.458054 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1182/2651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:41 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:42.471234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-11878220-5d4e-44db-87fe-9cd3eaf05cc9 req-2cc8027e-a010-4b3b-9841-a819437f4c87 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.471698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-11878220-5d4e-44db-87fe-9cd3eaf05cc9 req-2cc8027e-a010-4b3b-9841-a819437f4c87 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.476063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:42.482576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:42.497128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.497586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.499469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.501980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.506946 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-11878220-5d4e-44db-87fe-9cd3eaf05cc9 req-2cc8027e-a010-4b3b-9841-a819437f4c87 service nova] Creating event network-changed:86734008-b39f-4f81-80a0-6f3c477fc49f for instance 6c451750-95c9-45f1-aa8d-6f96ba7040df on nch2-master-1 Apr 02 21:00:42.523629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-11878220-5d4e-44db-87fe-9cd3eaf05cc9 req-2cc8027e-a010-4b3b-9841-a819437f4c87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098234 Apr 02 21:00:42.527843 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1470/2652] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:42.543389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d6808d6-a3ae-4a5a-b444-d925a3e81539 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:42.545245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d6808d6-a3ae-4a5a-b444-d925a3e81539 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:42.698774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d6808d6-a3ae-4a5a-b444-d925a3e81539 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.717349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d6808d6-a3ae-4a5a-b444-d925a3e81539 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1213 microversion: 2.1 time: 0.186638 Apr 02 21:00:42.718455 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1471/2653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:42 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:42.723833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:42.724688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:42.732442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.733193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.734160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.734785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.887228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.901366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.903178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:42.910855 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-625a6cfc-2360-4dc6-96f5-55e909bfde2c tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1416 microversion: 2.75 time: 0.191180 Apr 02 21:00:42.924810 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1472/2654] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:42 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1416 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:42.931847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e849c910-4bd6-43fc-bbbc-09a251676161 req-4862382c-99d1-4258-bbb0-2c2183e111a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "name": "network-vif-plugged", "status": "completed", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:42.944303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e849c910-4bd6-43fc-bbbc-09a251676161 req-4862382c-99d1-4258-bbb0-2c2183e111a2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:42.944787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e849c910-4bd6-43fc-bbbc-09a251676161 req-4862382c-99d1-4258-bbb0-2c2183e111a2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:42.959751 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e849c910-4bd6-43fc-bbbc-09a251676161 req-4862382c-99d1-4258-bbb0-2c2183e111a2 service nova] Creating event network-vif-plugged:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch2-master-1 Apr 02 21:00:42.965610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e849c910-4bd6-43fc-bbbc-09a251676161 req-4862382c-99d1-4258-bbb0-2c2183e111a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039238 Apr 02 21:00:42.966601 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1473/2655] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:43.025911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:43.036942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:43.039729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:43.041616 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a9480040-61cd-4ebb-8aa5-1f876d49910f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1487 microversion: 2.25 time: 0.582474 Apr 02 21:00:43.042813 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1183/2656] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:42 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1487 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:43.440162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:43.441243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:43.451610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:43.452429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:43.461393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:43.464619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:43.465794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:43.466385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:43.467063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:43.467719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:43.471524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:43.472213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:43.886065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:43.902827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:43.905531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:43.910982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-750ad284-b26e-4001-ae0b-3074809c5500 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.476102 Apr 02 21:00:43.911883 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1474/2657] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:43 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:43.926637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:43.929318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:43.948686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:43.959813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:43.961052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:43.961704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.101753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.111748 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ce32a6a-fb87-4d2c-a46a-64cef65d6624 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1283 microversion: 2.1 time: 0.197270 Apr 02 21:00:44.115939 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1475/2658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:43 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:44.132369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:44.133419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:44.153779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:44.155019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.155340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:44.155992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.465148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.476128 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2314151f-78b8-4940-ab47-110060d2288f tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 1.028380 Apr 02 21:00:44.477501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1184/2659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:43 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:44.482864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:44.483666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:44.491109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:44.491894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.493033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:44.493695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.683233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.692797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.694615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.701282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2b5249f-90f8-4f57-b886-6fa83239c341 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1416 microversion: 2.75 time: 0.579598 Apr 02 21:00:44.734207 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1476/2660] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:44 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1416 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:44.923665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.930442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:44.933564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:44.954831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.956876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:44.957422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:44.958133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.960602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:44.961593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:44.966930 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d62c738-9116-4aa8-98a6-4ec040681544 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1477 microversion: 2.25 time: 0.487474 Apr 02 21:00:44.996269 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1185/2661] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:44 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1477 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:45.014540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74a5fce2-c520-4b7a-8023-0c292d69b7f5 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '.version_select at 0x7f54d4c94e50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:45.021458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74a5fce2-c520-4b7a-8023-0c292d69b7f5 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:45.023503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74a5fce2-c520-4b7a-8023-0c292d69b7f5 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:45.059995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74a5fce2-c520-4b7a-8023-0c292d69b7f5 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.055708 Apr 02 21:00:45.063213 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1186/2662] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Apr 2 21:00:45 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:45.084761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:45.085884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:45.099447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:45.100192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:45.101204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:45.104291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:45.620383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:45.638177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:45.642558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:45.655525 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61ffc93a-ac33-449c-92e1-e5378ebcab7b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.723116 Apr 02 21:00:45.656169 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1477/2663] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:44 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:45.672197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:45.674604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:45.694550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:45.701114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:45.702326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:45.702947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:45.946142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] Lazy-loading 'services' on Instance uuid 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:00:45.994459 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b3eed8b-3583-4dee-83cb-ee26ec194301 tempest-LiveAutoBlockMigrationV225Test-253478136 tempest-LiveAutoBlockMigrationV225Test-253478136-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1970 microversion: 2.25 time: 0.912871 Apr 02 21:00:45.996126 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1187/2664] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:45 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1970 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:46.005412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:46.013114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.026614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.028613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.029672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.030780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.112545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.124827 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e01ddb91-9528-499f-af14-89a51a83afa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.467446 Apr 02 21:00:46.125792 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1478/2665] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:45 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:46.131914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:46.132542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.148874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.150198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.151887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.152664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.271685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.296147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.299655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.306309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b23229a2-15e0-4221-825e-b180978cba29 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1437 microversion: 2.75 time: 0.179296 Apr 02 21:00:46.328423 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1479/2666] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:46 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1437 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:46.340440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:46.341874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.356023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.357092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.358124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.359509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.366675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.379337 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7cdea988-127c-4ad7-90e7-42096803a92d tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 0.376247 Apr 02 21:00:46.380360 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1188/2667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:45 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:46.390980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:46.396614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.408184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:46.411812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.413744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.416081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.417958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.543548 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "DELETE /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 204 len: 0 microversion: 2.25 time: 0.212216 Apr 02 21:00:46.548685 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1480/2668] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:46 2022] DELETE /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:00:46.560814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:46.563868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.565633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:00:46.566036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:00:46.566520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:00:46.566936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:00:46.567360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:00:46.571909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.572377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.573203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.574198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.650301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.662379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.662849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.670101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.670572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.842307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.861184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.863404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:46.872209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c346f7c-ebb4-4b32-8b5f-5edd92eba302 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "POST /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7/action" status: 202 len: 1494 microversion: 2.75 time: 0.489339 Apr 02 21:00:46.874137 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1189/2669] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:00:46 2022] POST /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7/action => generated 1494 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 02 21:00:46.880613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:46.881487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:46.888139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.888875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:46.893682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:46.894377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.001804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.030236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.037281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.045022 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e9b43b8-7a35-4dfb-8127-a9b76c700154 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1483 microversion: 2.25 time: 0.490068 Apr 02 21:00:47.050957 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1481/2670] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:46 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1483 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:47.066533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:47.069219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:47.088085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.088619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.089436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.089887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.193936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.205079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.206856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.214729 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-466ae3d0-13c4-4ae8-873c-ad81ca73d50a tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.162191 Apr 02 21:00:47.216315 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1482/2671] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:47 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:47.221313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:47.222028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:47.231059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.237356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.238484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.239122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.289530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.305352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.306868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.314945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ef8ac61-bcfc-4840-8d84-61e978b4126c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.439000 Apr 02 21:00:47.315553 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1190/2672] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:46 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:47.380207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-31077302-9d4d-48a3-947f-690b7eb8c9e8 req-f8f754ec-d22b-446c-b784-1f602f02822c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05bed59b-2f6c-45b3-baf5-0ba5ef23941b", "tag": "e1e3d74e-3a5d-4dc5-a08b-0090fe56ec49"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:47.400708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-31077302-9d4d-48a3-947f-690b7eb8c9e8 req-f8f754ec-d22b-446c-b784-1f602f02822c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.403749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-31077302-9d4d-48a3-947f-690b7eb8c9e8 req-f8f754ec-d22b-446c-b784-1f602f02822c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.437085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-31077302-9d4d-48a3-947f-690b7eb8c9e8 req-f8f754ec-d22b-446c-b784-1f602f02822c service nova] Creating event network-changed:e1e3d74e-3a5d-4dc5-a08b-0090fe56ec49 for instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b on nch2-master-1 Apr 02 21:00:47.458840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.463670 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-31077302-9d4d-48a3-947f-690b7eb8c9e8 req-f8f754ec-d22b-446c-b784-1f602f02822c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087659 Apr 02 21:00:47.464939 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1191/2673] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:47.470943 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30076eb4-0888-4009-a198-2ea6e38c0a09 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.251282 Apr 02 21:00:47.472064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:47.472362 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1483/2674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:47 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:47.473207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:47.480061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.480858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.482444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:47.482904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:47.777705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:47.786571 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8d4fc92a-e115-4b2b-be34-d05cfc875adb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 0.319438 Apr 02 21:00:47.787973 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1192/2675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:47 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:48.070507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:48.071698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:48.085189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.087417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.088663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.092005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.236244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:48.236890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:48.248723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.249185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.249981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.250421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.255019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.268079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.271088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.273531 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-12f3cdac-107c-4f8e-abfe-0dbedf381b03 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 200 len: 1441 microversion: 2.25 time: 0.207669 Apr 02 21:00:48.287040 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1484/2676] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:48 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 1441 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:48.333182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:48.334222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:48.379947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.382409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.385277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.385967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.462287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.477073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.500273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.513525 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4a2ee3c-bc4c-4a09-b4ae-8b386e92cd7b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.282218 Apr 02 21:00:48.517306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1193/2677] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:48 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:48.530343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c70325c6-7d20-4f96-824a-b2a55e8f1810 req-34d9584b-cbdf-4180-8c1c-d2b44ab9c0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760e84eb-7fa1-420b-9884-1f3c0e6f3d8c", "name": "network-vif-deleted", "tag": "2f0b5d01-2163-42f7-ad38-54ff616d2346"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:48.557310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c70325c6-7d20-4f96-824a-b2a55e8f1810 req-34d9584b-cbdf-4180-8c1c-d2b44ab9c0ae service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.558279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c70325c6-7d20-4f96-824a-b2a55e8f1810 req-34d9584b-cbdf-4180-8c1c-d2b44ab9c0ae service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.599326 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c70325c6-7d20-4f96-824a-b2a55e8f1810 req-34d9584b-cbdf-4180-8c1c-d2b44ab9c0ae service nova] Creating event network-vif-deleted:2f0b5d01-2163-42f7-ad38-54ff616d2346 for instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c on nch1-master-1 Apr 02 21:00:48.606354 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c70325c6-7d20-4f96-824a-b2a55e8f1810 req-34d9584b-cbdf-4180-8c1c-d2b44ab9c0ae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087217 Apr 02 21:00:48.609323 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1194/2678] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:48.619477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:48.620919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:48.633146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.634221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.636120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.636865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.717512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.731851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.733812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:48.735258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-958a84d8-aca2-4ed1-b3e7-20de683f675d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.405988 Apr 02 21:00:48.742722 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1485/2679] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:48 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:48.804096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:48.805724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:48.821508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.822010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:48.823452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:48.823998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.014016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:49.029561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c84c0873-88d0-45f2-a529-26c3cff3fc1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.417004 Apr 02 21:00:49.031856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1195/2680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:48 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:49.228760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:49.250687 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bcffafd5-8d2f-4d5b-904d-3d0dfdbb130a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 0.451153 Apr 02 21:00:49.252802 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1486/2681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:48 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:49.293526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:49.294428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:49.305318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:49.305780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.307636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:49.308177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.332719 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] HTTP exception thrown: Instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c could not be found. Apr 02 21:00:49.333635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Returning 404 to user: Instance 760e84eb-7fa1-420b-9884-1f3c0e6f3d8c could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:49.334745 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6b250c53-1ff6-4926-93a9-ae2848ef3eef tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c" status: 404 len: 111 microversion: 2.25 time: 0.045202 Apr 02 21:00:49.337720 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1196/2682] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:49 2022] GET /compute/v2.1/servers/760e84eb-7fa1-420b-9884-1f3c0e6f3d8c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:00:49.491312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c57d917a-9363-4454-84bc-c98a85c7c8e3 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d48f7700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:49.539444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:49.542237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:49.551536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:49.553286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.554355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:49.554355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.581920 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c57d917a-9363-4454-84bc-c98a85c7c8e3 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10" status: 200 len: 637 microversion: 2.1 time: 0.095130 Apr 02 21:00:49.583293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1487/2683] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:00:49 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10 => generated 637 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:49.597921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00524af2-75ad-42f6-9bef-adc25bb8465e tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d47330d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:49.650176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:49.659997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:49.665450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:49.672082 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f1d9cecd-b1fb-4610-a542-c8f5aa3cbdee tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.139381 Apr 02 21:00:49.674112 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1197/2684] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:49 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:49.711805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-00524af2-75ad-42f6-9bef-adc25bb8465e tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:49.718314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-00524af2-75ad-42f6-9bef-adc25bb8465e tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:49.757269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:49.757889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:49.764929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:49.765397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.766188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:49.766678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:49.970248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.006109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.009998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.011258 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f700fa9-c56c-473f-86c5-fc83aad0c920 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.257968 Apr 02 21:00:50.012890 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1198/2685] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:49 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:50.026172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d1c2f1ae-8b41-4559-8023-dc0ec40627c5 req-70458979-ed18-4c04-ba96-0e083e38d27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c451750-95c9-45f1-aa8d-6f96ba7040df", "name": "network-vif-plugged", "status": "completed", "tag": "86734008-b39f-4f81-80a0-6f3c477fc49f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:50.035695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d1c2f1ae-8b41-4559-8023-dc0ec40627c5 req-70458979-ed18-4c04-ba96-0e083e38d27d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.036853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d1c2f1ae-8b41-4559-8023-dc0ec40627c5 req-70458979-ed18-4c04-ba96-0e083e38d27d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.051509 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d1c2f1ae-8b41-4559-8023-dc0ec40627c5 req-70458979-ed18-4c04-ba96-0e083e38d27d service nova] Creating event network-vif-plugged:86734008-b39f-4f81-80a0-6f3c477fc49f for instance 6c451750-95c9-45f1-aa8d-6f96ba7040df on nch2-master-1 Apr 02 21:00:50.057818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d1c2f1ae-8b41-4559-8023-dc0ec40627c5 req-70458979-ed18-4c04-ba96-0e083e38d27d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040198 Apr 02 21:00:50.059121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1199/2686] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:50.065662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:50.066418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:50.073978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.074500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.075313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.075764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.184890 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00524af2-75ad-42f6-9bef-adc25bb8465e tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.592895 Apr 02 21:00:50.186052 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1488/2687] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:49 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:50.195523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1198340b-0d0f-4161-a8d1-85e7fafb9e3b tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4733f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:50.389217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.407849 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c6e13ba2-0075-49f5-bdb5-2735e8af60a1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.346175 Apr 02 21:00:50.408984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1200/2688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:50 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:50.417753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:50.419335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:50.429309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.429961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.431364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.432045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.673986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.687069 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a15bb2d-109f-434d-a9ac-f4e7cb6336ba tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1315 microversion: 2.1 time: 0.276897 Apr 02 21:00:50.687773 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1201/2689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:50 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:50.703046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:50.704029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:50.709405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1198340b-0d0f-4161-a8d1-85e7fafb9e3b tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "DELETE /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.518306 Apr 02 21:00:50.712988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.713186 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1489/2690] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Apr 2 21:00:50 2022] DELETE /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata/os_version => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:50.713881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.715022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:50.715690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:50.717839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cbf9b606-1b6b-462b-abf5-edef65521157 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4a94940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:50.768728 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cbf9b606-1b6b-462b-abf5-edef65521157 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 37 microversion: 2.1 time: 0.054456 Apr 02 21:00:50.769331 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1490/2691] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:00:50 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 37 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:50.780419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-187a7aeb-7559-4889-aa1b-53e3a3c6347f tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d4a28430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:50.799345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.808146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.809702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:50.817734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb1788b3-30c2-471c-95cf-8ceeb687cbcd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.118158 Apr 02 21:00:50.819071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1202/2692] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:50 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:50.874704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-187a7aeb-7559-4889-aa1b-53e3a3c6347f tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:50.884211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-187a7aeb-7559-4889-aa1b-53e3a3c6347f tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:51.030883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.031504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:51.039425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.040020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.041121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.041854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.229568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:51.241602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:51.243184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:51.244547 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6cf5b3f-85c3-43cc-9d68-a767ef1afce0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.217521 Apr 02 21:00:51.255776 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1203/2693] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:51.262829 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-187a7aeb-7559-4889-aa1b-53e3a3c6347f tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.486936 Apr 02 21:00:51.263706 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1491/2694] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:50 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:51.277507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afb98dcc-1a76-410f-8276-735b6e3efdbe tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4ab0dc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.321160 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afb98dcc-1a76-410f-8276-735b6e3efdbe tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.047493 Apr 02 21:00:51.322203 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1204/2695] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata/os_distro => generated 33 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:51.332656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef619750-49ae-40ca-824c-8ba124b67640 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d47339d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:51.382146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef619750-49ae-40ca-824c-8ba124b67640 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:51.386929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef619750-49ae-40ca-824c-8ba124b67640 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:51.424658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.425688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:51.439651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.442595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.443538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.445426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.620816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:51.632348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f711303-2684-4b83-80f2-d5db3e16314f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.211593 Apr 02 21:00:51.632962 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1205/2696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:51.649040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.649576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:51.664908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.664908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.665696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.666584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.710667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:51.734446 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef619750-49ae-40ca-824c-8ba124b67640 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.406007 Apr 02 21:00:51.735413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1492/2697] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:51 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:51.741716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.742696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:51.749698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.750157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.750978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.751422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.838793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36654676-d49c-42c3-b968-194a99c796ca tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 204 len: 0 microversion: 2.25 time: 0.204495 Apr 02 21:00:51.839814 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1206/2698] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:51 2022] DELETE /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:00:51.851301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6bb07e5b-f839-4f8b-8e63-19af665c60c0 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4af7c10>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.921927 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6bb07e5b-f839-4f8b-8e63-19af665c60c0 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.078419 Apr 02 21:00:51.922838 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1207/2699] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:51.929283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.930272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:51.936804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.937471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.938991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.939625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.959606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:51.971375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0809ea0-97d8-45bc-a304-4038505d27f1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1465 microversion: 2.1 time: 0.234562 Apr 02 21:00:51.972309 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1493/2700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:51.978857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:51.980056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:51.987870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.989198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:51.990638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:51.991269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.009122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.020427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.023531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.030223 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d5a5624-4054-4cfa-be1c-86e954ea6eb5 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.106162 Apr 02 21:00:52.031144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1208/2701] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:52.038714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e10c3ae2-7db3-4405-934d-cc2dad9e5869 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d49f3310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:52.092176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-e10c3ae2-7db3-4405-934d-cc2dad9e5869 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:52.098803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-e10c3ae2-7db3-4405-934d-cc2dad9e5869 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:52.213786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.223284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.225391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.228596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60a3260f-7c6c-42ec-ada2-d50c9bbc915d tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1565 microversion: 2.25 time: 0.253066 Apr 02 21:00:52.228596 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1494/2702] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:51 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1565 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:52.245059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:52.245791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:52.253596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.254314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.255320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.255938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.286579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:52.431634 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9768a9c-adcc-4043-9015-d943b144a152 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 204 len: 0 microversion: 2.1 time: 0.203196 Apr 02 21:00:52.434058 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1495/2703] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:52 2022] DELETE /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:52.442014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:52.443289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:52.450509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.452690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.452690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.452690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.567381 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e10c3ae2-7db3-4405-934d-cc2dad9e5869 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.534282 Apr 02 21:00:52.568337 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1209/2704] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:52 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:52.573968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:52.574595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:52.586841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.587554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.589180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.597142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.700926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.712799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.714574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.715857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e0dc8af-f4b5-4b6d-965f-acaee8f145d9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.280288 Apr 02 21:00:52.716655 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1496/2705] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:52 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:52.729789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ad1afe2-6efc-41a1-8130-a538bc946b65 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d4a94c10>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:52.771138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:52.786776 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d98f03c-adfe-4077-8b4f-d2edace998cb tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1471 microversion: 2.1 time: 0.217084 Apr 02 21:00:52.796843 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1210/2706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:52 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:52.814720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:52.815361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:52.816658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8ad1afe2-6efc-41a1-8130-a538bc946b65 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:52.825452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8ad1afe2-6efc-41a1-8130-a538bc946b65 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:52.834616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.835084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:52.835884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:52.837830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.018099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.026474 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5084a33f-7f40-4ee6-b34a-794628522d4a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.221641 Apr 02 21:00:53.027247 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1211/2707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:52 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:53.050354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:53.051247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:53.058943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.059793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.060896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.061534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.146328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.155896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.159112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.165284 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f3dfca3-b936-45fe-acb8-1f9c8a7c565b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.118853 Apr 02 21:00:53.166006 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1212/2708] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:53 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:53.248826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:53.249870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:53.277449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.278061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.279586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.281002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.295145 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ad1afe2-6efc-41a1-8130-a538bc946b65 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 64 microversion: 2.1 time: 0.577590 Apr 02 21:00:53.295759 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1497/2709] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:52 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 64 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:53.308171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5319057-0519-4c2b-bd80-53dea476bf33 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4a28d30>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:53.374472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.387205 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5319057-0519-4c2b-bd80-53dea476bf33 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 64 microversion: 2.1 time: 0.085469 Apr 02 21:00:53.393506 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1498/2710] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:00:53 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 64 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:53.399017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0f0c65b-9dd9-4dcb-ac6e-8d4bd3febc82 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d4a141f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:53.400263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.402301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:53.403556 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb67ca69-ac9c-4cc3-80e5-6904b6688dc9 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 200 len: 1523 microversion: 2.25 time: 0.160876 Apr 02 21:00:53.404314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1213/2711] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:53 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:53.455987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2ad5feba-43b8-4497-846c-1bb51f46b54c req-2c2a84f1-8349-445d-a114-1c24e1546dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a6f315a-5c0b-48ec-9e78-16942df1a9f7", "name": "network-vif-deleted", "tag": "12334738-596e-4bda-85ff-6807e7a908f4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:53.468216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2ad5feba-43b8-4497-846c-1bb51f46b54c req-2c2a84f1-8349-445d-a114-1c24e1546dae service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.469003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2ad5feba-43b8-4497-846c-1bb51f46b54c req-2c2a84f1-8349-445d-a114-1c24e1546dae service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.490048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d0f0c65b-9dd9-4dcb-ac6e-8d4bd3febc82 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:53.491032 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2ad5feba-43b8-4497-846c-1bb51f46b54c req-2c2a84f1-8349-445d-a114-1c24e1546dae service nova] Creating event network-vif-deleted:12334738-596e-4bda-85ff-6807e7a908f4 for instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 on nch1-master-1 Apr 02 21:00:53.495962 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2ad5feba-43b8-4497-846c-1bb51f46b54c req-2c2a84f1-8349-445d-a114-1c24e1546dae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051746 Apr 02 21:00:53.496922 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1214/2712] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:53.504509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d0f0c65b-9dd9-4dcb-ac6e-8d4bd3febc82 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:53.736812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:53.737517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:53.757866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.758326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:53.759117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:53.759556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.006086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.019187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.020299 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0f0c65b-9dd9-4dcb-ac6e-8d4bd3febc82 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.625146 Apr 02 21:00:54.021789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.023299 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40a7d297-70be-48ac-b027-12845207d56e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.292315 Apr 02 21:00:54.024966 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1499/2713] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:53 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:00:54.030491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.031419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:54.036546 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1215/2714] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:53 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:00:54.044246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-aed4c101-28d0-46ba-9a1b-48d1585cf9da req-21f2b8d0-86da-4ae7-9887-b16a6c54c09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05bed59b-2f6c-45b3-baf5-0ba5ef23941b", "name": "network-vif-plugged", "status": "completed", "tag": "e1e3d74e-3a5d-4dc5-a08b-0090fe56ec49"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:54.051108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.051715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.052673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.053270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.059937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-aed4c101-28d0-46ba-9a1b-48d1585cf9da req-21f2b8d0-86da-4ae7-9887-b16a6c54c09b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.060702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-aed4c101-28d0-46ba-9a1b-48d1585cf9da req-21f2b8d0-86da-4ae7-9887-b16a6c54c09b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.078986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-aed4c101-28d0-46ba-9a1b-48d1585cf9da req-21f2b8d0-86da-4ae7-9887-b16a6c54c09b service nova] Creating event network-vif-plugged:e1e3d74e-3a5d-4dc5-a08b-0090fe56ec49 for instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b on nch2-master-1 Apr 02 21:00:54.092063 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-aed4c101-28d0-46ba-9a1b-48d1585cf9da req-21f2b8d0-86da-4ae7-9887-b16a6c54c09b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051075 Apr 02 21:00:54.094234 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1216/2715] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:54.112603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-885639c3-cb53-4110-a8d9-390ceffc0f30 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update', calling method: .version_select at 0x7f54d4a13310>, body: {"meta": {"os_version": "alt"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:54.226442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-885639c3-cb53-4110-a8d9-390ceffc0f30 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:54.232135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-885639c3-cb53-4110-a8d9-390ceffc0f30 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:54.324611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9228e1bd8248bba26145bdbf7e2378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b271883cfeac443e8f5d5f2e555835d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.336706 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c650123-8675-4970-aa17-6ba8ab9323d1 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 200 len: 1471 microversion: 2.1 time: 0.309674 Apr 02 21:00:54.337530 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1500/2716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:54 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:54.359121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.360772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:54.368328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.369230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.370224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.370980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.542818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.555545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5f210375-4397-47f6-9c2b-0394ef71339d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1313 microversion: 2.1 time: 0.216605 Apr 02 21:00:54.556861 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1501/2717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:54 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:54.561979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.562853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:54.581581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.582715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.583583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.584147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.641900 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-885639c3-cb53-4110-a8d9-390ceffc0f30 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.544637 Apr 02 21:00:54.643000 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1217/2718] 10.222.0.18 () {60 vars in 1312 bytes} [Sat Apr 2 21:00:54 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata/os_version => generated 31 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:54.649106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.653449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 9a6f315a-5c0b-48ec-9e78-16942df1a9f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:54.665932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.666874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.667953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.668739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.684734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] HTTP exception thrown: Instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 could not be found. Apr 02 21:00:54.685604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Returning 404 to user: Instance 9a6f315a-5c0b-48ec-9e78-16942df1a9f7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:54.686670 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0554fabd-36f9-40be-ade8-7d0e9b775a55 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7" status: 404 len: 111 microversion: 2.25 time: 0.042569 Apr 02 21:00:54.687457 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1218/2719] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:54 2022] GET /compute/v2.1/servers/9a6f315a-5c0b-48ec-9e78-16942df1a9f7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:00:54.696427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19511ae4-2dc5-49a7-b9de-bb85bc985535 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4919ca0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.701451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.711037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.717000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:54.725329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8eb5571e-0752-4a31-bd70-b1c11c375764 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.167117 Apr 02 21:00:54.726100 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1502/2720] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:54 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:54.730962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.731708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:54.738384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.739074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.740013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.740686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.770127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:54.784303 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19511ae4-2dc5-49a7-b9de-bb85bc985535 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 58 microversion: 2.1 time: 0.091985 Apr 02 21:00:54.785018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1219/2721] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:00:54 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 58 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:54.797778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37bac055-e015-4cb2-8d82-017cfff207f6 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'update_all', calling method: .version_select at 0x7f54d4919f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:54.861632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-37bac055-e015-4cb2-8d82-017cfff207f6 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:54.867590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-37bac055-e015-4cb2-8d82-017cfff207f6 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:54.890879 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f24a8da7-088b-4d62-9153-639f7a1b436e tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 204 len: 0 microversion: 2.25 time: 0.161424 Apr 02 21:00:54.895273 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1503/2722] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:54 2022] DELETE /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:00:54.908754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ed6ce170-b5b6-4eca-87c8-56590a71fc9d req-8e15d6dc-2056-4d1a-9973-f671f1e06f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c451750-95c9-45f1-aa8d-6f96ba7040df", "name": "network-vif-deleted", "tag": "86734008-b39f-4f81-80a0-6f3c477fc49f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:54.925645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ed6ce170-b5b6-4eca-87c8-56590a71fc9d req-8e15d6dc-2056-4d1a-9973-f671f1e06f6c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:54.926107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ed6ce170-b5b6-4eca-87c8-56590a71fc9d req-8e15d6dc-2056-4d1a-9973-f671f1e06f6c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:54.953140 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ed6ce170-b5b6-4eca-87c8-56590a71fc9d req-8e15d6dc-2056-4d1a-9973-f671f1e06f6c service nova] Creating event network-vif-deleted:86734008-b39f-4f81-80a0-6f3c477fc49f for instance 6c451750-95c9-45f1-aa8d-6f96ba7040df on nch2-master-1 Apr 02 21:00:54.968364 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ed6ce170-b5b6-4eca-87c8-56590a71fc9d req-8e15d6dc-2056-4d1a-9973-f671f1e06f6c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070652 Apr 02 21:00:54.969012 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1504/2723] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:54.990408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:54.991142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:55.015463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.015941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.025555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.026192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.240564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.258398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.259913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.261162 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2aa9130e-958d-4ff5-bd72-e25bb7cf4215 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1548 microversion: 2.25 time: 0.290978 Apr 02 21:00:55.261725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1505/2724] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:54 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1548 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:55.282033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:55.282772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:55.290108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.290570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.291371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.291786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.324041 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37bac055-e015-4cb2-8d82-017cfff207f6 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 61 microversion: 2.1 time: 0.533079 Apr 02 21:00:55.324850 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1220/2725] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:54 2022] PUT /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 61 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:55.334176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd79973c-eb23-4291-909d-ab3a6b186ca8 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Action: 'create', calling method: .version_select at 0x7f54d49c6040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:55.391510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bd79973c-eb23-4291-909d-ab3a6b186ca8 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:55.396784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bd79973c-eb23-4291-909d-ab3a6b186ca8 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Getting quotas for user c9a56ed7266f40e18f6a3aaacdd064f6 and project 3eb50f24a3f64b759a99b9b20c150caf. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:55.537944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.556010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.564347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.566303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5cdc2d1-8b3e-46a5-b8ff-038a3e8d1762 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.292129 Apr 02 21:00:55.569464 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1506/2726] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:55 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:55.577759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:55.579294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:55.608125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.609655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.612767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.613438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.658018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. Apr 02 21:00:55.659108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:55.661292 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-178fda70-e469-424b-af14-d32b97ce1b29 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 404 len: 111 microversion: 2.1 time: 0.090564 Apr 02 21:00:55.664149 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1507/2727] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:55 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:55.675565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:55.678372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:55.693978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.694429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.697406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.699910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.951577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:55.961061 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-561d4bd7-7886-4144-8c27-f63a79bb6165 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1500 microversion: 2.1 time: 0.295579 Apr 02 21:00:55.972835 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1508/2728] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:55 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1500 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:55.978130 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd79973c-eb23-4291-909d-ab3a6b186ca8 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "POST /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 85 microversion: 2.1 time: 0.647634 Apr 02 21:00:55.979015 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1221/2729] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Apr 2 21:00:55 2022] POST /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 85 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:00:55.983828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-221074609", "metadata": {"image_type": "test"}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:55.983828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:55.987907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.988905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.993450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:55.993912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:55.994969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:55.995775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.003529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.004065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.004960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.005553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.025745 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. Apr 02 21:00:56.026385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:56.029365 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28f45325-8cd5-440c-b404-374a5aae2612 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "POST /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df/action" status: 404 len: 111 microversion: 2.1 time: 0.055371 Apr 02 21:00:56.030077 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1509/2730] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Apr 2 21:00:55 2022] POST /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.039615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.042443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.055600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.065931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.067326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.067463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.091425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.099841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.102792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.103500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:56.108934 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07148398-0648-452c-b74f-1da54436a384 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.118343 Apr 02 21:00:56.110667 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1222/2731] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:55 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:56.120331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b135908-29e3-44bd-8dec-a04ee089ffd9 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] Calling method '.version_select at 0x7f54d4955c10>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.184587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b135908-29e3-44bd-8dec-a04ee089ffd9 tempest-ImagesMetadataTestJSON-2110322628 tempest-ImagesMetadataTestJSON-2110322628-project] 10.222.0.18 "GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata" status: 200 len: 85 microversion: 2.1 time: 0.072453 Apr 02 21:00:56.185290 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1223/2732] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Apr 2 21:00:56 2022] GET /compute/v2.1/images/a3cbbd6d-efb4-4225-b313-1d59cdf95e10/metadata => generated 85 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:00:56.196236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-908520b1-949a-493f-a018-b1cf943ccc97 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1784867463", "metadata": {"image_type": "test"}}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:56.199977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-908520b1-949a-493f-a018-b1cf943ccc97 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Failed to fetch instance by id tempest-invalid-219780218 {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 21:00:56.200618 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-908520b1-949a-493f-a018-b1cf943ccc97 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance tempest-invalid-219780218 could not be found. Apr 02 21:00:56.201123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-908520b1-949a-493f-a018-b1cf943ccc97 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance tempest-invalid-219780218 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:56.206039 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-908520b1-949a-493f-a018-b1cf943ccc97 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "POST /compute/v2.1/servers/tempest-invalid-219780218/action" status: 404 len: 100 microversion: 2.1 time: 0.013858 Apr 02 21:00:56.217970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1224/2733] 10.222.0.18 () {60 vars in 1245 bytes} [Sat Apr 2 21:00:56 2022] POST /compute/v2.1/servers/tempest-invalid-219780218/action => generated 100 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.224764 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34655d0b-042f-4437-af6f-e1337a08eaa1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 204 len: 0 microversion: 2.1 time: 0.193214 Apr 02 21:00:56.224971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8475d2b1-1e65-494d-804e-6991ece0e984 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1012837578"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:56.228567 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1510/2734] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:56 2022] DELETE /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:56.233412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8475d2b1-1e65-494d-804e-6991ece0e984 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 21:00:56.233944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8475d2b1-1e65-494d-804e-6991ece0e984 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 02 21:00:56.236007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8475d2b1-1e65-494d-804e-6991ece0e984 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:56.236904 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8475d2b1-1e65-494d-804e-6991ece0e984 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017838 Apr 02 21:00:56.244958 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1225/2735] 10.222.0.18 () {60 vars in 1274 bytes} [Sat Apr 2 21:00:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.247587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.249711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.259282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4cd7bad6-ecac-4de4-bcc5-2d7d4539f77b tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1438683452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:56.260303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4cd7bad6-ecac-4de4-bcc5-2d7d4539f77b tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 21:00:56.260844 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4cd7bad6-ecac-4de4-bcc5-2d7d4539f77b tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 02 21:00:56.261531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4cd7bad6-ecac-4de4-bcc5-2d7d4539f77b tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:56.262249 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4cd7bad6-ecac-4de4-bcc5-2d7d4539f77b tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012339 Apr 02 21:00:56.263054 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1226/2736] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Apr 2 21:00:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.264017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.264611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.265472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.268857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.280779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.281270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.289735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.290673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.291718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.292308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.308399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. Apr 02 21:00:56.309049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:56.310035 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c3f426b-65c2-40bd-9295-a5f9e49c3272 tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 404 len: 111 microversion: 2.1 time: 0.034917 Apr 02 21:00:56.314245 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1227/2737] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:00:56 2022] DELETE /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.319412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.320298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.326505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.327256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.328007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.328580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.440548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.478901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.481007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.488163 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3976fdc1-c7dd-4468-9270-00207845bf98 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 200 len: 1506 microversion: 2.25 time: 0.169809 Apr 02 21:00:56.489167 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1228/2738] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:56 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:56.528983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.531724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] [instance: 6c451750-95c9-45f1-aa8d-6f96ba7040df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.549620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.552668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.558684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.560193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.564149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.579199 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-397fea3b-6e59-4405-a888-efc57ec6cb0b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1506 microversion: 2.1 time: 0.345532 Apr 02 21:00:56.579838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1511/2739] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:56 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:56.590573 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] HTTP exception thrown: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. Apr 02 21:00:56.591274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] Returning 404 to user: Instance 6c451750-95c9-45f1-aa8d-6f96ba7040df could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:56.593221 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8ad9716-3027-4f9e-b9c4-968d6690334a tempest-ImagesNegativeTestJSON-1321377340 tempest-ImagesNegativeTestJSON-1321377340-project] 10.222.0.18 "GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df" status: 404 len: 111 microversion: 2.1 time: 0.101415 Apr 02 21:00:56.595434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d9c7df49-962a-486c-bcdc-0875321db396 req-00478ed4-9849-4153-ba5f-a67404e2b545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d2897f-4f31-4c6f-87ee-0279c8e9a3af", "name": "network-vif-deleted", "tag": "7f987878-99ad-40c2-b531-b8c74a1c3c64"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:56.598237 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1229/2740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:56 2022] GET /compute/v2.1/servers/6c451750-95c9-45f1-aa8d-6f96ba7040df => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:00:56.605961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:56.607045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:56.616184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d9c7df49-962a-486c-bcdc-0875321db396 req-00478ed4-9849-4153-ba5f-a67404e2b545 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.616799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d9c7df49-962a-486c-bcdc-0875321db396 req-00478ed4-9849-4153-ba5f-a67404e2b545 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.632728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.633544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.633815 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d9c7df49-962a-486c-bcdc-0875321db396 req-00478ed4-9849-4153-ba5f-a67404e2b545 service nova] Creating event network-vif-deleted:7f987878-99ad-40c2-b531-b8c74a1c3c64 for instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af on nch1-master-1 Apr 02 21:00:56.636964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:56.637637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:56.640516 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d9c7df49-962a-486c-bcdc-0875321db396 req-00478ed4-9849-4153-ba5f-a67404e2b545 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059019 Apr 02 21:00:56.647039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1512/2741] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:56.834046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.846015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.847607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:56.849070 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67353342-6625-4d24-93e1-438be2be8b1a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1740 microversion: 2.20 time: 0.249739 Apr 02 21:00:56.849812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1230/2742] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:56 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:57.134064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:57.134928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:57.143356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.143941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.144861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.145399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.234941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:57.243126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:57.244666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:57.249933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36114f1b-36b5-413a-9e3f-654908e5bc0d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.124085 Apr 02 21:00:57.251031 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1513/2743] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:57 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:57.507595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:57.508930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: d8d2897f-4f31-4c6f-87ee-0279c8e9a3af] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:57.518874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.519651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.520835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.521520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.539999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] HTTP exception thrown: Instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af could not be found. Apr 02 21:00:57.541073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Returning 404 to user: Instance d8d2897f-4f31-4c6f-87ee-0279c8e9a3af could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:00:57.542168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-283d120b-c6a1-4c03-a7f7-9e48aaf54edc tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af" status: 404 len: 111 microversion: 2.25 time: 0.039040 Apr 02 21:00:57.546203 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1231/2744] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:57 2022] GET /compute/v2.1/servers/d8d2897f-4f31-4c6f-87ee-0279c8e9a3af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:00:57.565837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:57.566363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:57.583403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.583885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.585068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.585527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.598950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:57.600363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:57.608623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.609586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.611539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.612296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.624377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:00:57.755123 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28893ad6-f8d0-4474-855b-13b703702b6c tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "DELETE /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 204 len: 0 microversion: 2.25 time: 0.207386 Apr 02 21:00:57.758427 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1514/2745] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:00:57 2022] DELETE /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 02 21:00:57.768259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:57.771640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:57.782717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.783708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.786008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.786896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.971298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:57.979811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:57.981909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:57.983797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-976977d9-fe33-410e-af5a-f77e94c51a14 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1564 microversion: 2.25 time: 0.221129 Apr 02 21:00:57.985467 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1515/2746] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:57 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1564 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:57.990192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:57.990804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:57.997416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.997871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:57.998846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:57.999465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:58.161290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.169231 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8d764e3b-7b8d-4ad8-9e26-a5e10b618793 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1506 microversion: 2.1 time: 0.575562 Apr 02 21:00:58.172979 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1232/2747] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:57 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1506 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:00:58.216532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.225718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.227426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.228772 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3af2e3fd-8a89-42ac-888d-313c6de819fe tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1722 microversion: 2.20 time: 0.242141 Apr 02 21:00:58.229762 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1516/2748] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:57 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:58.274147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:58.275182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:58.297820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:58.299394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:58.301499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:58.302640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:58.395533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.405542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.408003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:58.414555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a036285-7902-4117-adf5-f539b419b8bd tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.148129 Apr 02 21:00:58.428907 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1233/2749] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:58 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:58.870747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e06abc85-d644-41cb-8ea9-12a9f3afd5ac tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d4d183a0>, body: {"keypair": {"name": "tempest-keypair-1310672503"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:58.895568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-e06abc85-d644-41cb-8ea9-12a9f3afd5ac tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:58.901533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-e06abc85-d644-41cb-8ea9-12a9f3afd5ac tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:58.991294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-1bd44acc-274e-42c5-b455-9004a33069aa req-0ba046b8-cb86-4b7c-aadc-69d27076e09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282887e6-5c5b-4492-8a31-c1cf713cf95f", "name": "network-vif-deleted", "tag": "b729c68d-47c0-4cf5-b93a-585056bd9955"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:59.004821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1bd44acc-274e-42c5-b455-9004a33069aa req-0ba046b8-cb86-4b7c-aadc-69d27076e09a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.005672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1bd44acc-274e-42c5-b455-9004a33069aa req-0ba046b8-cb86-4b7c-aadc-69d27076e09a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.026020 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-1bd44acc-274e-42c5-b455-9004a33069aa req-0ba046b8-cb86-4b7c-aadc-69d27076e09a service nova] Creating event network-vif-deleted:b729c68d-47c0-4cf5-b93a-585056bd9955 for instance 282887e6-5c5b-4492-8a31-c1cf713cf95f on nch2-master-1 Apr 02 21:00:59.038883 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-1bd44acc-274e-42c5-b455-9004a33069aa req-0ba046b8-cb86-4b7c-aadc-69d27076e09a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051294 Apr 02 21:00:59.040303 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1234/2750] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:59.065461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:59.068265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:59.106093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.108074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-e06abc85-d644-41cb-8ea9-12a9f3afd5ac tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:59.109373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.112257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.112747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.115404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-e06abc85-d644-41cb-8ea9-12a9f3afd5ac tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:59.142160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e06abc85-d644-41cb-8ea9-12a9f3afd5ac tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.415952 Apr 02 21:00:59.146932 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1517/2751] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:00:58 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 422 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:59.158915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d38fafc-615c-48e4-bc01-68c4548619b7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4733700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:59.169315 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d38fafc-615c-48e4-bc01-68c4548619b7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1310672503" status: 200 len: 707 microversion: 2.2 time: 0.016888 Apr 02 21:00:59.170102 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1518/2752] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Apr 2 21:00:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1310672503 => generated 707 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:00:59.187206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02f343f7-d681-4691-aff6-bc94a3737f1c tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4d5dc10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:59.221626 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02f343f7-d681-4691-aff6-bc94a3737f1c tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310672503" status: 204 len: 0 microversion: 2.2 time: 0.043496 Apr 02 21:00:59.222536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1519/2753] 10.222.0.18 () {60 vars in 1260 bytes} [Sat Apr 2 21:00:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310672503 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:00:59.229338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:59.229979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:59.232854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.239522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.240058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.241209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.241886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.244128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.245767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4eaee1ddad0041828fb2e65677e2da25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a3f8d3d3e94b31ab9aa73d8905b12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.247159 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-120c820b-1282-4042-8009-e85852294f7f tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 200 len: 1346 microversion: 2.25 time: 0.205283 Apr 02 21:00:59.247957 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1235/2754] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:59 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 1346 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:59.254255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-de1d2a7b-b309-4888-9d2e-e54457415db3 req-1ffe71e7-2cb8-4920-9b63-e06723128021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05bed59b-2f6c-45b3-baf5-0ba5ef23941b", "name": "network-vif-deleted", "tag": "e1e3d74e-3a5d-4dc5-a08b-0090fe56ec49"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:59.263120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de1d2a7b-b309-4888-9d2e-e54457415db3 req-1ffe71e7-2cb8-4920-9b63-e06723128021 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.263851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de1d2a7b-b309-4888-9d2e-e54457415db3 req-1ffe71e7-2cb8-4920-9b63-e06723128021 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.282663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-de1d2a7b-b309-4888-9d2e-e54457415db3 req-1ffe71e7-2cb8-4920-9b63-e06723128021 service nova] Creating event network-vif-deleted:e1e3d74e-3a5d-4dc5-a08b-0090fe56ec49 for instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b on nch2-master-1 Apr 02 21:00:59.291146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-de1d2a7b-b309-4888-9d2e-e54457415db3 req-1ffe71e7-2cb8-4920-9b63-e06723128021 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040750 Apr 02 21:00:59.291858 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1236/2755] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:00:59.299024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d4a13e50>, body: {"keypair": {"name": "tempest-keypair-46207204"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:00:59.319084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:00:59.323528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.326433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:00:59.331356 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-50eef14d-ed63-4113-b4db-48c3707a987f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 200 len: 1464 microversion: 2.1 time: 0.107607 Apr 02 21:00:59.342372 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1520/2756] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:00:59 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 1464 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:00:59.345257 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] [5d48f72a-35ff-4bd3-aa4e-f47d5036bcbd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:00:59.347719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:59.348363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:59.354791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.355263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.356041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.356573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.539682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.549822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.551324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.552529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f305ad3b-2407-47d9-b827-ff4f045668e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1722 microversion: 2.20 time: 0.209101 Apr 02 21:00:59.553289 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1521/2757] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:59 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:59.558082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:00:59.558698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:00:59.564873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.565338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.566119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:00:59.566561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:00:59.647007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.656043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.658186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:00:59.663865 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6243512d-3ca4-404d-a972-c112e80a2928 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.109043 Apr 02 21:00:59.664548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1522/2758] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:00:59 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:00:59.975577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-428342958", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "2127fd39-f5aa-452a-9beb-bdc4f201d2d4"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:00.026447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] validate_networks() for [('2127fd39-f5aa-452a-9beb-bdc4f201d2d4', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:00.352826 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] [5d48f72a-35ff-4bd3-aa4e-f47d5036bcbd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56110. Apr 02 21:01:00.360923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:00.361394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:00.361834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:00.362255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:00.362673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:00.371595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.372053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.372901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.373347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.389927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for project 46605b214f8144ebbbd2aab432bb7633. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:00.395059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for user de9e0b13df3b487cb16732fcf86746b3 and project 46605b214f8144ebbbd2aab432bb7633. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:00.406673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:00.409632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:00.454941 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-efc35cb2-51c3-4a88-8811-bad59fc280fc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532718 Apr 02 21:01:00.460431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1523/2759] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:01:00.461216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.461810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] [instance: 282887e6-5c5b-4492-8a31-c1cf713cf95f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:00.467869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.468336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.469172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.469995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:00.470322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.474807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:00.490187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afb400ba-d2b7-4f98-8f8c-8ebfcb1569a7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.2 time: 1.196797 Apr 02 21:01:00.490984 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] HTTP exception thrown: Instance 282887e6-5c5b-4492-8a31-c1cf713cf95f could not be found. Apr 02 21:01:00.491602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] Returning 404 to user: Instance 282887e6-5c5b-4492-8a31-c1cf713cf95f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:00.492481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b44dc16-5e69-4397-be8a-a5f4382749c5 tempest-LiveAutoBlockMigrationV225Test-1782887781 tempest-LiveAutoBlockMigrationV225Test-1782887781-project] 10.222.0.18 "GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f" status: 404 len: 111 microversion: 2.25 time: 0.035411 Apr 02 21:01:00.493034 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1524/2760] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:00 2022] GET /compute/v2.1/servers/282887e6-5c5b-4492-8a31-c1cf713cf95f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:00.496101 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1237/2761] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:00:59 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1203 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:00.497910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.498559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:00.502966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c93fff4d-88fb-471a-8cce-c39e307464e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.503711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c93fff4d-88fb-471a-8cce-c39e307464e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:00.504806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.505329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.506063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.506498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.521251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b could not be found. Apr 02 21:01:00.521863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:00.522712 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-426757dd-230d-4df9-a367-7415e3c13188 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 404 len: 111 microversion: 2.1 time: 0.028759 Apr 02 21:01:00.523269 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1525/2762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:00 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:00.538057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b92b278c-b873-4f58-948b-012a603c4fa5 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4733e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.558963 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b92b278c-b873-4f58-948b-012a603c4fa5 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46207204" status: 204 len: 0 microversion: 2.2 time: 0.034543 Apr 02 21:01:00.560059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1526/2763] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Apr 2 21:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46207204 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:00.572784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6042b30c-067a-4235-b8d9-542cbb46b28f tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d47a1160>, body: {"keypair": {"name": "tempest-keypair-2050745947", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:00.582949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c93fff4d-88fb-471a-8cce-c39e307464e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.590099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-6042b30c-067a-4235-b8d9-542cbb46b28f tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:00.591468 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c93fff4d-88fb-471a-8cce-c39e307464e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1224 microversion: 2.1 time: 0.094146 Apr 02 21:01:00.592541 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1238/2764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:00 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:00.598339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.599150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:00.602488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-6042b30c-067a-4235-b8d9-542cbb46b28f tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:00.606487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.607133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.608087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.608720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.639031 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6042b30c-067a-4235-b8d9-542cbb46b28f tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.072261 Apr 02 21:01:00.643879 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1527/2765] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 21:01:00 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Apr 02 21:01:00.656763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b28c6871-c2d1-41ea-901f-71a7187db930 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d49f7c10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.683075 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b28c6871-c2d1-41ea-901f-71a7187db930 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050745947" status: 204 len: 0 microversion: 2.2 time: 0.032610 Apr 02 21:01:00.684361 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1528/2766] 10.222.0.18 () {60 vars in 1260 bytes} [Sat Apr 2 21:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050745947 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:00.690967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:00.691955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:00.701109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.701674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.704793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:00.705411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:00.777299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.786919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.788523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.794115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56aff765-a42b-4d18-9346-475be87d5a97 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.107962 Apr 02 21:01:00.796632 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1529/2767] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:00 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:00.801339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78427e2f-85ea-4e8a-a245-a605d37f17b9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d4bd31f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-449264266"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:00.822791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-78427e2f-85ea-4e8a-a245-a605d37f17b9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:00.827512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-78427e2f-85ea-4e8a-a245-a605d37f17b9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:00.865816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.875039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.878091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:00.880083 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d64edb3d-79d4-4f9d-b88d-34e0713620dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1722 microversion: 2.20 time: 0.286232 Apr 02 21:01:00.881784 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1239/2768] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:00 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:00.887385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1211773589", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:00.985910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:00.987438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-78427e2f-85ea-4e8a-a245-a605d37f17b9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:00.993507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-78427e2f-85ea-4e8a-a245-a605d37f17b9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:01.011167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78427e2f-85ea-4e8a-a245-a605d37f17b9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.215280 Apr 02 21:01:01.012178 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1530/2769] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:01:00 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:01.022154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed4eeea6-affc-478e-9fe8-a71ae86f63aa tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d47338b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-703772174"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:01.051340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ed4eeea6-affc-478e-9fe8-a71ae86f63aa tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:01.056870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ed4eeea6-affc-478e-9fe8-a71ae86f63aa tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:01.381605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:01.383125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:01.383659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:01.384168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:01.384676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:01.393973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:01.394621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:01.395699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:01.396480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:01.414094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:01.419373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:01.439004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:01.441916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:01.509597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ed4eeea6-affc-478e-9fe8-a71ae86f63aa tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:01.510871 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0edfd5c-fa17-434a-97a5-a3fbc247fa68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626480 Apr 02 21:01:01.511915 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1240/2770] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:01.520181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ed4eeea6-affc-478e-9fe8-a71ae86f63aa tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:01.540574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38ab42f4-e1b6-484e-83fe-25eed1f0ff97 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:01.541586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38ab42f4-e1b6-484e-83fe-25eed1f0ff97 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:01.545445 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed4eeea6-affc-478e-9fe8-a71ae86f63aa tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.527146 Apr 02 21:01:01.551947 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1531/2771] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:01:01 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 534 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:01.557698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b790c9e1-bd23-47a7-8bb6-a6caa42b96a3 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d49f70d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-369154256"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:01.575603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b790c9e1-bd23-47a7-8bb6-a6caa42b96a3 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:01.582348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b790c9e1-bd23-47a7-8bb6-a6caa42b96a3 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:01.623860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38ab42f4-e1b6-484e-83fe-25eed1f0ff97 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:01.633944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38ab42f4-e1b6-484e-83fe-25eed1f0ff97 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1215 microversion: 2.1 time: 0.112277 Apr 02 21:01:01.636124 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1241/2772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:01 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:01.648101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:01.649081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:01.656364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:01.657704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:01.658874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:01.659487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:01.774122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:01.783399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a62e0436-4504-49a3-bf24-81771ab7dfa6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1276 microversion: 2.1 time: 0.145979 Apr 02 21:01:01.790704 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1242/2773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:01 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:01.814113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:01.815053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:01.823270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:01.826183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:01.826987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:01.831350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.013626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b790c9e1-bd23-47a7-8bb6-a6caa42b96a3 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:02.017564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:02.024671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b790c9e1-bd23-47a7-8bb6-a6caa42b96a3 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:02.029930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:02.031558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:02.046206 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0850198a-7571-46b7-ac86-61e5e760a05b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.235984 Apr 02 21:01:02.047184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1243/2774] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:01 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:02.064343 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b790c9e1-bd23-47a7-8bb6-a6caa42b96a3 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.511174 Apr 02 21:01:02.065326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:02.065953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:02.070161 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1532/2775] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:01:01 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 518 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:02.080361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-10f56d73-c703-4f12-ae7f-66e10811a8ee req-aceac304-0955-4ef9-a37b-c0061289481c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "name": "network-vif-unplugged", "status": "completed", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:02.097861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.098650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.099450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.100291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.112381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-10f56d73-c703-4f12-ae7f-66e10811a8ee req-aceac304-0955-4ef9-a37b-c0061289481c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.112872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-10f56d73-c703-4f12-ae7f-66e10811a8ee req-aceac304-0955-4ef9-a37b-c0061289481c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.128659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_external_events [req-10f56d73-c703-4f12-ae7f-66e10811a8ee req-aceac304-0955-4ef9-a37b-c0061289481c service nova] Unable to find a host for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c. Dropping event network-vif-unplugged {{(pid=136518) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 02 21:01:02.129572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-10f56d73-c703-4f12-ae7f-66e10811a8ee req-aceac304-0955-4ef9-a37b-c0061289481c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053505 Apr 02 21:01:02.130194 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1533/2776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 02 21:01:02.145981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-385f8fbb-f84c-4041-b9c7-8fa32f9e2213 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4793ee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:02.149282 ncdv-master-1 devstack@n-api.service[136518]: WARNING oslo_db.sqlalchemy.utils [None req-385f8fbb-f84c-4041-b9c7-8fa32f9e2213 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 02 21:01:02.158715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-385f8fbb-f84c-4041-b9c7-8fa32f9e2213 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1721 microversion: 2.2 time: 0.023942 Apr 02 21:01:02.159310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1534/2777] 10.222.0.18 () {60 vars in 1176 bytes} [Sat Apr 2 21:01:02 2022] GET /compute/v2.1/os-keypairs => generated 1721 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:02.169704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b17c8b4-aa2b-4206-8231-0a10f1a80ce9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4733670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:02.207587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b17c8b4-aa2b-4206-8231-0a10f1a80ce9 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-369154256" status: 204 len: 0 microversion: 2.2 time: 0.041732 Apr 02 21:01:02.208517 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1535/2778] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Apr 2 21:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-369154256 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:02.216546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1656333-d745-491d-b5ef-dce355aef167 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d45bd820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:02.253256 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1656333-d745-491d-b5ef-dce355aef167 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-703772174" status: 204 len: 0 microversion: 2.2 time: 0.039960 Apr 02 21:01:02.256092 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1536/2779] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Apr 2 21:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-703772174 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:02.268068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ea5950e-cd6c-4fb2-ad60-19c7c8b249f2 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4d5d790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:02.294309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ea5950e-cd6c-4fb2-ad60-19c7c8b249f2 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-449264266" status: 204 len: 0 microversion: 2.2 time: 0.030939 Apr 02 21:01:02.296013 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1537/2780] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Apr 2 21:01:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-449264266 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:02.306622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51453a6d-afd4-4c3e-b408-eaf7cd4c7bc0 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d4793820>, body: {"keypair": {"name": "tempest-keypair-1807503773"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:02.324517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-51453a6d-afd4-4c3e-b408-eaf7cd4c7bc0 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:02.333587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-51453a6d-afd4-4c3e-b408-eaf7cd4c7bc0 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:02.431606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:02.463845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:02.465616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:02.467734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bcb7ca8-5c7d-40df-9b4d-6dd80c8e2f13 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1665 microversion: 2.20 time: 0.418199 Apr 02 21:01:02.482226 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1244/2781] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:02 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1665 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:02.488235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35aae13b-58e7-47bc-9a5c-0ca232ff5912"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:02.489694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:02.497823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.498700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.499627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.500276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.923170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-606427bc-5696-4d98-88b9-87ad1dcd2940 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.439130 Apr 02 21:01:02.923809 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1245/2782] 10.222.0.18 () {62 vars in 1363 bytes} [Sat Apr 2 21:01:02 2022] POST /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments => generated 188 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:01:02.933171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:02.935010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:02.943848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.944523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:02.945809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:02.946439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.040664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.050436 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-68edb845-d148-4d02-86e7-ecff09bfc727 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1267 microversion: 2.1 time: 0.123883 Apr 02 21:01:03.052361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1246/2783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:02 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:03.065494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:03.066128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:03.081461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.082145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.084080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.086971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.116002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-51453a6d-afd4-4c3e-b408-eaf7cd4c7bc0 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:03.122732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-51453a6d-afd4-4c3e-b408-eaf7cd4c7bc0 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:03.139177 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51453a6d-afd4-4c3e-b408-eaf7cd4c7bc0 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.837259 Apr 02 21:01:03.139778 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1538/2784] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:01:02 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 838 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:03.145845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:03.152987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:03.163317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.163791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.164719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.165424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.259305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.271000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.273036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.278713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2f224c65-cecb-45a5-aa09-7bdc4f65a6a7 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.137489 Apr 02 21:01:03.287992 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1539/2785] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:03 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:03.293498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:03.294401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:03.302044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.302743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.303771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.304404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.405397 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/action" status: 202 len: 0 microversion: 2.20 time: 0.124508 Apr 02 21:01:03.406382 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1540/2786] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:01:03 2022] POST /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:03.412717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aacf3610-f0f2-4698-be73-3c7eb904df2d tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d4aad310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:03.420833 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aacf3610-f0f2-4698-be73-3c7eb904df2d tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1807503773" status: 200 len: 707 microversion: 2.2 time: 0.013375 Apr 02 21:01:03.427223 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1541/2787] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Apr 2 21:01:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1807503773 => generated 707 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:03.432583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:03.433266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:03.443836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.444413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.445596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:03.446141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:03.519309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.528185 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3a917fc-9403-4087-bfa8-6613ba865578 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.469782 Apr 02 21:01:03.528802 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1247/2788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:03 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:03.533537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c6deb51-3572-477e-988e-326d326c76fe tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d42db940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:03.536362 ncdv-master-1 devstack@n-api.service[136517]: WARNING oslo_db.sqlalchemy.utils [None req-2c6deb51-3572-477e-988e-326d326c76fe tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 02 21:01:03.543506 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c6deb51-3572-477e-988e-326d326c76fe tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.013535 Apr 02 21:01:03.544628 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1248/2789] 10.222.0.18 () {60 vars in 1176 bytes} [Sat Apr 2 21:01:03 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:03.556069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-609c0a7e-246f-45fa-87cb-38ac4ce5df56 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d49ebd30>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:03.582573 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-609c0a7e-246f-45fa-87cb-38ac4ce5df56 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807503773" status: 204 len: 0 microversion: 2.2 time: 0.031289 Apr 02 21:01:03.585813 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1249/2790] 10.222.0.18 () {60 vars in 1260 bytes} [Sat Apr 2 21:01:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807503773 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:03.599154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Action: 'create', calling method: .version_select at 0x7f54d421c160>, body: {"keypair": {"name": "tempest-keypair-1377513397", "type": "x509"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:03.641827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:03.656198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:03.669777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.681060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.682936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:03.684929 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0c8dd0c0-462a-4c9c-b9fc-34f905b10b3e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1751 microversion: 2.20 time: 0.256445 Apr 02 21:01:03.685606 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1542/2791] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:03 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:03.700787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.processutils [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpsy2nednu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsy2nednu/temp.key -subj /CN=d1c5ac48a61849fc90c23809370b28a7 -extensions v3_req_client {{(pid=136517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 02 21:01:04.072073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.073300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:04.083382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.084658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.086551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.087614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.170152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.181462 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26d32f1e-4b49-4b06-8352-72e1ccb3152a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1273 microversion: 2.1 time: 0.116595 Apr 02 21:01:04.185899 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1543/2792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:04 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:04.195760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.processutils [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpsy2nednu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsy2nednu/temp.key -subj /CN=d1c5ac48a61849fc90c23809370b28a7 -extensions v3_req_client" returned: 0 in 0.494s {{(pid=136517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 02 21:01:04.197718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.processutils [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpsy2nednu/temp.key -password pass: {{(pid=136517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 02 21:01:04.244197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.processutils [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpsy2nednu/temp.key -password pass:" returned: 0 in 0.043s {{(pid=136517) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 02 21:01:04.318167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.319398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:04.320349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:04.329088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Getting quotas for user d1c5ac48a61849fc90c23809370b28a7 and project 110cfdc19f714eaaae221aacca056c08. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:04.356624 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bf82e80c-fd90-4db6-8918-a3bf22b89bc7 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.764345 Apr 02 21:01:04.358603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1250/2793] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Apr 2 21:01:03 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 767 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:04.361926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.362622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.366769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.367612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.374542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e837fc20-bd77-4839-85d1-c489fb498bcd tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d49c6b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.392298 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e837fc20-bd77-4839-85d1-c489fb498bcd tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1377513397" status: 200 len: 1534 microversion: 2.2 time: 0.026809 Apr 02 21:01:04.394039 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1251/2794] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Apr 2 21:01:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1377513397 => generated 1534 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:04.414380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-197c7557-5ed6-4c9e-a771-7f6a8f155ddf tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d49a49d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.420296 ncdv-master-1 devstack@n-api.service[136517]: WARNING oslo_db.sqlalchemy.utils [None req-197c7557-5ed6-4c9e-a771-7f6a8f155ddf tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 02 21:01:04.433272 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-197c7557-5ed6-4c9e-a771-7f6a8f155ddf tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.030387 Apr 02 21:01:04.435167 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1252/2795] 10.222.0.18 () {60 vars in 1176 bytes} [Sat Apr 2 21:01:04 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:04.451124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b4b5bb1-78c2-44ae-9c11-86204f3ff726 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] Calling method '.version_select at 0x7f54d49ebd30>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.498360 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b4b5bb1-78c2-44ae-9c11-86204f3ff726 tempest-KeyPairsV22TestJSON-1445948748 tempest-KeyPairsV22TestJSON-1445948748-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377513397" status: 204 len: 0 microversion: 2.2 time: 0.055169 Apr 02 21:01:04.502717 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1253/2796] 10.222.0.18 () {60 vars in 1260 bytes} [Sat Apr 2 21:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377513397 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:04.520180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.529875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.530929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.541972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b9a151b-e25e-4e73-91d6-73ec5b73f9c3 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.245273 Apr 02 21:01:04.552531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.554389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:04.555202 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1544/2797] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:04 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:04.567065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.567795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.569161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.570172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.706103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:04.707878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:04.715999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.716935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.719002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.719618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.925404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.937281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.941416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.942580 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79596292-bf9a-4ea7-ab6f-fff331009937 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1751 microversion: 2.20 time: 0.242448 Apr 02 21:01:04.944438 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1545/2798] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:04 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:04.949497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ce620536-dc2e-416e-b264-c029d4a2b3e0 req-0db779af-f0d7-4942-9fd4-4a4dd9136a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12ed6253-6272-447a-b897-496efb357d2c", "tag": "a4cfd1fe-7824-486d-82f6-5473be5624bc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:04.963063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:04.970012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ce620536-dc2e-416e-b264-c029d4a2b3e0 req-0db779af-f0d7-4942-9fd4-4a4dd9136a7b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:04.970471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ce620536-dc2e-416e-b264-c029d4a2b3e0 req-0db779af-f0d7-4942-9fd4-4a4dd9136a7b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:04.970807 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f77329a0-3b0d-4202-854a-084687ac5ce2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.429020 Apr 02 21:01:04.971412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1254/2799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:04 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:04.982268 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ce620536-dc2e-416e-b264-c029d4a2b3e0 req-0db779af-f0d7-4942-9fd4-4a4dd9136a7b service nova] Creating event network-changed:a4cfd1fe-7824-486d-82f6-5473be5624bc for instance 12ed6253-6272-447a-b897-496efb357d2c on nch2-master-1 Apr 02 21:01:04.989032 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ce620536-dc2e-416e-b264-c029d4a2b3e0 req-0db779af-f0d7-4942-9fd4-4a4dd9136a7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043099 Apr 02 21:01:04.989995 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1546/2800] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:05.207376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:05.208625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:05.221806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:05.225272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:05.226359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:05.227086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:05.661167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4600700f-eec1-48bc-919b-d6c5949d9bac tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] Calling method '.version_select at 0x7f54d47331f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:05.662038 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:01:05.662038 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:01:05.675799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4600700f-eec1-48bc-919b-d6c5949d9bac tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.153610 Apr 02 21:01:05.676379 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1547/2801] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 21:01:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:01:05.685794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:05.686524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:05.693819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:05.694406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:05.695557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:05.695997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:05.729801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:05.744151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46068fc1-6254-4329-808b-5aa25bc248e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.547007 Apr 02 21:01:05.745596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1255/2802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:05 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:05.750414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2374cdf6-7932-4646-b4a5-addcb1b9239c tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] Action: 'update', calling method: .version_select at 0x7f54d49c6ca0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:05.752497 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:01:05.752497 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:01:05.780267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:05.792828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:05.794483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:05.801833 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f59ddbe6-0e6a-47ad-9bd6-766d3e3aa157 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.120152 Apr 02 21:01:05.802930 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1548/2803] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:05 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:05.965360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:05.966023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:05.977101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:05.977434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:05.979513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:05.980111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:06.054382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2374cdf6-7932-4646-b4a5-addcb1b9239c tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.307481 Apr 02 21:01:06.061619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1256/2804] 10.222.0.18 () {60 vars in 1205 bytes} [Sat Apr 2 21:01:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:06.069344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:06.070613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:06.079270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:06.079270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:06.079270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:06.079664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:06.221480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:06.231418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:06.232977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:06.234149 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-97880bc9-3477-4a82-acb8-ad56efd354eb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1753 microversion: 2.20 time: 0.274827 Apr 02 21:01:06.235058 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1549/2805] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:05 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1753 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:06.244077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ab20a17-a85f-472c-a3b0-95ce28f9a17a tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] Calling method '.version_select at 0x7f54d496c790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:06.244939 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:01:06.244939 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:01:06.259509 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ab20a17-a85f-472c-a3b0-95ce28f9a17a tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023195 Apr 02 21:01:06.268051 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1550/2806] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 21:01:06 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:06.286623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ccca6cd1-5857-4b35-9977-22df460a6fb7 tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] Action: 'update', calling method: .version_select at 0x7f54d496ce50>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:06.288391 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:01:06.288391 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:01:06.427636 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ccca6cd1-5857-4b35-9977-22df460a6fb7 tempest-QuotaClassesAdminTestJSON-1065428499 tempest-QuotaClassesAdminTestJSON-1065428499-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.159926 Apr 02 21:01:06.428750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1551/2807] 10.222.0.18 () {60 vars in 1205 bytes} [Sat Apr 2 21:01:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:01:06.537334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:06.565602 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-610e4287-7bba-42b0-9a68-bf273b40079c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.498282 Apr 02 21:01:06.574972 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1257/2808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:06 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:06.762738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:06.763613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:06.772970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:06.774983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:06.776735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:06.780177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:06.822198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:06.822811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:06.838398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:06.839017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:06.839995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:06.844871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:07.010041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.023521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.027816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.041105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.057047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f5ba863-b333-450d-ba5f-2fdc130e3140 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.298975 Apr 02 21:01:07.058024 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7fabb861-0854-484c-9df4-d78df6cd1b4e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.239796 Apr 02 21:01:07.068181 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1552/2809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:06 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:07.073978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-df1cdaed-f7a9-4115-91fa-8dad7904c4de req-98abd115-1c0d-45c9-a92e-cee3aa005da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25509bd1-b73f-48ea-af8c-c66e7bd1a312", "tag": "ecba1cfd-1d70-4d61-bdd4-80f253df2828"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:07.074897 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1258/2810] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:06 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:07.084387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-df1cdaed-f7a9-4115-91fa-8dad7904c4de req-98abd115-1c0d-45c9-a92e-cee3aa005da4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:07.085146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-df1cdaed-f7a9-4115-91fa-8dad7904c4de req-98abd115-1c0d-45c9-a92e-cee3aa005da4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:07.113637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-df1cdaed-f7a9-4115-91fa-8dad7904c4de req-98abd115-1c0d-45c9-a92e-cee3aa005da4 service nova] Creating event network-changed:ecba1cfd-1d70-4d61-bdd4-80f253df2828 for instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 on nch2-master-1 Apr 02 21:01:07.120043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-df1cdaed-f7a9-4115-91fa-8dad7904c4de req-98abd115-1c0d-45c9-a92e-cee3aa005da4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050320 Apr 02 21:01:07.121301 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1553/2811] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:07.254237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:07.255032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:07.262781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:07.263811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:07.264906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:07.265526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:07.454608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.465912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.467629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:07.469878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1345f60-a723-4175-ad0e-7dfa917cc5f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.218954 Apr 02 21:01:07.471093 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1259/2812] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:07 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:07.584125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:07.584916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:07.591640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:07.592125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:07.592942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:07.593546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.076827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:08.077302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.078592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:08.086829 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8a79e4d-a425-4321-a8a9-1c1ce4184a45 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.506921 Apr 02 21:01:08.087826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.088251 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1554/2813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:07 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:08.088671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.089618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.090206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.096163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:08.097663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:08.106642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.107520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.108931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.109563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.276310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.315928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.320570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.326405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.331596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a8db5db-3a9f-45dc-9094-12d8fe3da7d6 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.242231 Apr 02 21:01:08.334304 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1555/2814] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:08 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:08.347644 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-902f8177-8fa3-4f38-b985-c0e1092a4a62 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.275869 Apr 02 21:01:08.357630 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1260/2815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:08 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:08.489234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:08.489855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:08.508260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.508764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.509588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.510063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:08.813027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.834835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.836559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:08.837862 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0198476a-b525-476a-a4ab-1eae8d62959d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.353493 Apr 02 21:01:08.854043 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1556/2816] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:08 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:08.948180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5bae34b0-10fb-4664-b224-c2ac186f44cf req-3c8316f4-6a88-4cfc-a5fd-17504989ee85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:08.963375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5bae34b0-10fb-4664-b224-c2ac186f44cf req-3c8316f4-6a88-4cfc-a5fd-17504989ee85 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:08.963832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5bae34b0-10fb-4664-b224-c2ac186f44cf req-3c8316f4-6a88-4cfc-a5fd-17504989ee85 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.000272 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5bae34b0-10fb-4664-b224-c2ac186f44cf req-3c8316f4-6a88-4cfc-a5fd-17504989ee85 service nova] Creating event network-changed:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch1-master-1 Apr 02 21:01:09.012598 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5bae34b0-10fb-4664-b224-c2ac186f44cf req-3c8316f4-6a88-4cfc-a5fd-17504989ee85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067736 Apr 02 21:01:09.013479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1261/2817] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:09.109022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:09.109743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:09.135172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.136005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.137069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.137503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.214105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-858970c3-6270-4dc0-af6f-3dd0f9f28c58 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d492b160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1048610974", "description": "tempest-description-1146700594"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:09.402954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:09.411457 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e92693dc-bd3a-4ec2-bc8e-4fc04c6eb0e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.306835 Apr 02 21:01:09.412069 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1262/2818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:09 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:09.416907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:09.417545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:09.424337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.424853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.425644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.426096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.505391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:09.511243 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-858970c3-6270-4dc0-af6f-3dd0f9f28c58 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.464410 Apr 02 21:01:09.513437 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1557/2819] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:09 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:09.513548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:09.515496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:09.523405 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4035e5fd-1da5-4e0d-8776-9327a5ce80ea tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.110157 Apr 02 21:01:09.524202 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1263/2820] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:09 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:09.537653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:09.539875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:09.542729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8936cbdf-61b7-4a1c-8a73-7fe0d52937a8 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d4af7dc0>, body: {"security_group_rule": {"parent_group_id": "aebfdad6-c33b-4f4a-9e54-dc22c339d210", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:09.549999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.550550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.551573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.552207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.741902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8936cbdf-61b7-4a1c-8a73-7fe0d52937a8 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.203213 Apr 02 21:01:09.743014 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1264/2821] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:09.754435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-180f7338-b2ea-41ae-8609-9c9a45c9c78d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d4aca940>, body: {"security_group_rule": {"parent_group_id": "aebfdad6-c33b-4f4a-9e54-dc22c339d210", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:09.862402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-180f7338-b2ea-41ae-8609-9c9a45c9c78d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: This rule already exists in group aebfdad6-c33b-4f4a-9e54-dc22c339d210 Apr 02 21:01:09.863540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-180f7338-b2ea-41ae-8609-9c9a45c9c78d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 400 to user: This rule already exists in group aebfdad6-c33b-4f4a-9e54-dc22c339d210 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:09.864483 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-180f7338-b2ea-41ae-8609-9c9a45c9c78d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.115627 Apr 02 21:01:09.869042 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1265/2822] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:09 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:09.869728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:09.874025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:09.875869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:09.880475 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22cde413-1035-460b-af26-b2fcd7bd76bb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.364707 Apr 02 21:01:09.890542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.890542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.892265 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1558/2823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:09 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:09.894134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:09.894613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:09.898024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59415ed5-46ac-408f-a891-66d11f3dab21 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d4797790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:10.109364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:10.128742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:10.135328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:10.141481 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd500d9a-41c9-46b1-8206-c20bc4c19c21 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.269799 Apr 02 21:01:10.143899 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1266/2824] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:09 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:10.334826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59415ed5-46ac-408f-a891-66d11f3dab21 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/1c576e8a-79d1-4efb-9a98-bc892dd26fc3" status: 202 len: 0 microversion: 2.1 time: 0.441211 Apr 02 21:01:10.339915 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1559/2825] 10.222.0.18 () {58 vars in 1286 bytes} [Sat Apr 2 21:01:09 2022] DELETE /compute/v2.1/os-security-group-rules/1c576e8a-79d1-4efb-9a98-bc892dd26fc3 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:10.357587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9e6ac99-254a-4bec-87e2-f1b0134bcf95 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d4af7af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1845068207", "description": "tempest-description-1946855120"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:10.428507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:10.429151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:10.438263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:10.438729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:10.452794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:10.454174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:10.763969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:10.764984 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9e6ac99-254a-4bec-87e2-f1b0134bcf95 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.421652 Apr 02 21:01:10.774923 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1267/2826] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:10.775677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2d9c5a3-69f8-4e15-a125-9f76644875dc tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.351163 Apr 02 21:01:10.776734 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1560/2827] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:10 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:10.790623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:10.791059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3cd3ef8-3969-42c9-abe4-e35696586547 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d47db820>, body: {"security_group_rule": {"parent_group_id": "18517cee-f2f1-4b9b-85ea-ed279586fcde", "ip_protocol": "tcp", "from_port": 108820672, "to_port": 22}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:10.791939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:10.813575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:10.816143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:10.818691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:10.820827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:10.955496 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c3cd3ef8-3969-42c9-abe4-e35696586547 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Invalid port range 108820672:22. Former value cannot be greater than the later Apr 02 21:01:10.956479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3cd3ef8-3969-42c9-abe4-e35696586547 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 400 to user: Invalid port range 108820672:22. Former value cannot be greater than the later {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:10.963148 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c3cd3ef8-3969-42c9-abe4-e35696586547 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.184843 Apr 02 21:01:10.964349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1561/2828] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:10 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:10.965168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:10.980141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:10.981189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:10.981427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:10.983156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:11.007906 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0fd13ebf-da17-4e55-90c4-2c4b67d34bf4 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.231660 Apr 02 21:01:11.008591 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1268/2829] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:10 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:11.009614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:11.013943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af2bd9a9-bdf8-476d-b50c-85808ea1e230 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d4acaca0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-591210913", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:11.014692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:11.015624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:11.016215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:11.016795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-af2bd9a9-bdf8-476d-b50c-85808ea1e230 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Security group id should be uuid Apr 02 21:01:11.017594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af2bd9a9-bdf8-476d-b50c-85808ea1e230 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 400 to user: Security group id should be uuid {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:11.018585 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af2bd9a9-bdf8-476d-b50c-85808ea1e230 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008998 Apr 02 21:01:11.019117 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1269/2830] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:11 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 21:01:11.048539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de771c2f-ac1a-47b6-b408-12be3c86cb1d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d49a44c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1817948057", "description": "tempest-description-301896712"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:11.310096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:11.318934 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d614d525-6007-482e-acfb-61500ab8ce73 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.352388 Apr 02 21:01:11.328743 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1562/2831] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:10 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:11.328743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:11.328743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:11.345782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:11.347001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:11.348172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:11.348720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:11.415774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de771c2f-ac1a-47b6-b408-12be3c86cb1d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.380237 Apr 02 21:01:11.417211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1270/2832] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:11.430033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9018fdc1-eb34-4d7a-a54e-83571a6a6d9f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d421cc10>, body: {"security_group_rule": {"parent_group_id": "e35389b9-b75c-414e-a61b-8e4a1949e024", "ip_protocol": "tempest-999-46653507", "from_port": 22, "to_port": 22}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:11.525645 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-9018fdc1-eb34-4d7a-a54e-83571a6a6d9f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Invalid IP protocol tempest-999-46653507. Apr 02 21:01:11.527616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9018fdc1-eb34-4d7a-a54e-83571a6a6d9f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 400 to user: Invalid IP protocol tempest-999-46653507. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:11.528923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9018fdc1-eb34-4d7a-a54e-83571a6a6d9f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.103358 Apr 02 21:01:11.530184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1271/2833] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:11 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 02 21:01:11.540952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81cebb77-d13f-4e4d-abb5-db1a8905c3dd tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d4af7af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1656841538", "description": "tempest-description-1590022046"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:11.545688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:11.556494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:11.558659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:11.560512 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb7cd23f-c1cf-4d3b-a359-0b9c890ef220 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.238902 Apr 02 21:01:11.573691 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1563/2834] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:11 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:11.755045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81cebb77-d13f-4e4d-abb5-db1a8905c3dd tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.219492 Apr 02 21:01:11.755666 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1272/2835] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:01:11.769051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-570e0558-f362-4dc8-ac9b-8a8fe8083a55 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d47584c0>, body: {"security_group_rule": {"parent_group_id": "9e9f7b86-6785-4360-939a-eaa2ec1a8dd8", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:11.792823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:11.793667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:11.806284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:11.815047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:11.819406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:11.823264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:11.881244 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-570e0558-f362-4dc8-ac9b-8a8fe8083a55 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Apr 02 21:01:11.882131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-570e0558-f362-4dc8-ac9b-8a8fe8083a55 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:11.883240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-570e0558-f362-4dc8-ac9b-8a8fe8083a55 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.119970 Apr 02 21:01:11.883844 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1564/2836] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:01:11.898729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0e903d1-bc33-474e-8bec-6f2a22e3c432 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d47db790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1470442346", "description": "tempest-description-3671651"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:12.088377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:12.104966 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8b13929-e19a-4812-8c19-ef9a1ad68cc2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.314836 Apr 02 21:01:12.106933 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1273/2837] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:11 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:12.117570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0e903d1-bc33-474e-8bec-6f2a22e3c432 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.227482 Apr 02 21:01:12.118877 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1565/2838] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:11 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:12.128846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:12.130706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:12.158500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.163563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.167257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.168795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.304814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:12.319130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:12.322157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:12.333823 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f6e69b3-9f4a-4abc-abcb-901cd363b202 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.213686 Apr 02 21:01:12.339624 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1566/2839] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:12 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:12.347659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a8ce9d9-b3f9-48c8-8fe2-9eb058e697bb tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d47db160>, body: {"security_group_rule": {"parent_group_id": "8113b659-4c7b-4589-946f-a7b092d8f445", "ip_protocol": "tcp", "from_port": 22, "to_port": 1132129596}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:12.395529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2095546964", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:12.483772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:12.488939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0a8ce9d9-b3f9-48c8-8fe2-9eb058e697bb tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Invalid port range 22:1132129596. Valid TCP ports should be between 1-65535 Apr 02 21:01:12.489869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a8ce9d9-b3f9-48c8-8fe2-9eb058e697bb tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 400 to user: Invalid port range 22:1132129596. Valid TCP ports should be between 1-65535 {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:12.490832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a8ce9d9-b3f9-48c8-8fe2-9eb058e697bb tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.149305 Apr 02 21:01:12.491525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1567/2840] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:12 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:12.498671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0a7d90e4-58a1-49c7-9d36-a4cc2fbaa303 req-8bcc3fce-3f33-449a-92f8-d68f1ee1da47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ed6253-6272-447a-b897-496efb357d2c", "name": "network-vif-plugged", "status": "completed", "tag": "a4cfd1fe-7824-486d-82f6-5473be5624bc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:12.535605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0a7d90e4-58a1-49c7-9d36-a4cc2fbaa303 req-8bcc3fce-3f33-449a-92f8-d68f1ee1da47 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.536374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0a7d90e4-58a1-49c7-9d36-a4cc2fbaa303 req-8bcc3fce-3f33-449a-92f8-d68f1ee1da47 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.564311 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0a7d90e4-58a1-49c7-9d36-a4cc2fbaa303 req-8bcc3fce-3f33-449a-92f8-d68f1ee1da47 service nova] Creating event network-vif-plugged:a4cfd1fe-7824-486d-82f6-5473be5624bc for instance 12ed6253-6272-447a-b897-496efb357d2c on nch2-master-1 Apr 02 21:01:12.578824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0a7d90e4-58a1-49c7-9d36-a4cc2fbaa303 req-8bcc3fce-3f33-449a-92f8-d68f1ee1da47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084979 Apr 02 21:01:12.579912 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1568/2841] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:12.587842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:12.589812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:12.599064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.599914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.600907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.601499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.878602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:12.888033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8aaba18e-e339-4b55-aa5d-2a22cf76a041 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.306628 Apr 02 21:01:12.889130 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1569/2842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:12 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:12.894545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5cc96064-2188-4b34-9b27-b5dd6708600d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Action: 'create', calling method: .version_select at 0x7f54d4bd31f0>, body: {"security_group_rule": {"parent_group_id": "c6d87a0c-b342-4d7a-aa51-f5bb96e66d58", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:12.917738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-5cc96064-2188-4b34-9b27-b5dd6708600d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6d87a0c-b342-4d7a-aa51-f5bb96e66d58 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:12.918353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-5cc96064-2188-4b34-9b27-b5dd6708600d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Neutron security group c6d87a0c-b342-4d7a-aa51-f5bb96e66d58 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:01:12.918884 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-5cc96064-2188-4b34-9b27-b5dd6708600d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Security group c6d87a0c-b342-4d7a-aa51-f5bb96e66d58 does not exist Apr 02 21:01:12.918884 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-eac39cbd-4c0b-4a42-8273-bd7108a54cd5'] Apr 02 21:01:12.919638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5cc96064-2188-4b34-9b27-b5dd6708600d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 404 to user: Security group c6d87a0c-b342-4d7a-aa51-f5bb96e66d58 does not exist Apr 02 21:01:12.919638 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-eac39cbd-4c0b-4a42-8273-bd7108a54cd5'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:12.920637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5cc96064-2188-4b34-9b27-b5dd6708600d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.030361 Apr 02 21:01:12.921397 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1570/2843] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Apr 2 21:01:12 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:12.929687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:12.930380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:12.945824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.946854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.949116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.949995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.966465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:12.967059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:12.967687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:12.968247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:12.969388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:12.988117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.988841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:12.989788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:12.995425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:13.036297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Getting quotas for project de63710973d349dea7a070116eeb6d33. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:13.042282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Getting quotas for user 9a3cb2d2505e446ba9cc6b429f07e9f6 and project de63710973d349dea7a070116eeb6d33. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:13.056953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:13.059696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:13.120640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.124096 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ec308f73-a884-4044-b66d-58b68c361565 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013975 Apr 02 21:01:13.126052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1274/2844] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:13.136439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.138163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.139441 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2cf4a382-89e9-4463-b0a5-5d6efcd8d700 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.217184 Apr 02 21:01:13.146887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3cb5ac88-43f8-49cc-8963-5ee17a28d59f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d49a4820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.150444 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1571/2845] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:12 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:13.162906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.163796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:13.174428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:13.175138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:13.176828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:13.177481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:13.222178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-3cb5ac88-43f8-49cc-8963-5ee17a28d59f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 729c2567-6457-44c1-9adf-283254e19abd does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:13.223691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-3cb5ac88-43f8-49cc-8963-5ee17a28d59f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Neutron security group rule 729c2567-6457-44c1-9adf-283254e19abd not found {{(pid=136517) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Apr 02 21:01:13.224399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3cb5ac88-43f8-49cc-8963-5ee17a28d59f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] HTTP exception thrown: Security group rule 729c2567-6457-44c1-9adf-283254e19abd does not exist Apr 02 21:01:13.224399 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-91ca81b6-eab8-448e-8690-4ce3ca87309a'] Apr 02 21:01:13.225260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3cb5ac88-43f8-49cc-8963-5ee17a28d59f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Returning 404 to user: Security group rule 729c2567-6457-44c1-9adf-283254e19abd does not exist Apr 02 21:01:13.225260 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-91ca81b6-eab8-448e-8690-4ce3ca87309a'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:13.226338 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3cb5ac88-43f8-49cc-8963-5ee17a28d59f tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/729c2567-6457-44c1-9adf-283254e19abd" status: 404 len: 199 microversion: 2.1 time: 0.099170 Apr 02 21:01:13.227198 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1275/2846] 10.222.0.18 () {58 vars in 1286 bytes} [Sat Apr 2 21:01:13 2022] DELETE /compute/v2.1/os-security-group-rules/729c2567-6457-44c1-9adf-283254e19abd => generated 199 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:13.236948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc8506d2-65ad-40a8-b281-0fb8c0393e40 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.237579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc8506d2-65ad-40a8-b281-0fb8c0393e40 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:13.294998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc8506d2-65ad-40a8-b281-0fb8c0393e40 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.304706 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc8506d2-65ad-40a8-b281-0fb8c0393e40 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1214 microversion: 2.1 time: 0.076153 Apr 02 21:01:13.322800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1276/2847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:13 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:13.333891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6238662-54a6-4525-ba22-344478cf4bb4 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d42db4c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.395842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.404820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2616fb31-1b45-4853-8e74-1fb728456216 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1324 microversion: 2.1 time: 0.252734 Apr 02 21:01:13.407522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1572/2848] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:13 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:13.419270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.419886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:13.428567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:13.429067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:13.429961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:13.430406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:13.518555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.534101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.536709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:13.545516 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b202467-e042-4570-b918-bd4eafef409b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.138733 Apr 02 21:01:13.547070 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1573/2849] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:13 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:13.638395 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6238662-54a6-4525-ba22-344478cf4bb4 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8113b659-4c7b-4589-946f-a7b092d8f445" status: 202 len: 0 microversion: 2.1 time: 0.311785 Apr 02 21:01:13.639198 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1277/2850] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:13 2022] DELETE /compute/v2.1/os-security-groups/8113b659-4c7b-4589-946f-a7b092d8f445 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:13.651189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3d660894-a692-4bdf-a01a-4bce4e6df8ef tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d48f7790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.898009 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3d660894-a692-4bdf-a01a-4bce4e6df8ef tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9e9f7b86-6785-4360-939a-eaa2ec1a8dd8" status: 202 len: 0 microversion: 2.1 time: 0.252720 Apr 02 21:01:13.899708 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1574/2851] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:13 2022] DELETE /compute/v2.1/os-security-groups/9e9f7b86-6785-4360-939a-eaa2ec1a8dd8 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:01:13.908206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.912025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:13.920081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cc91afb1-e887-4af5-a7b2-4b6487c61535 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d492ba60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:13.931097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:13.931921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:13.935542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:13.936887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.140542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.151630 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9fcc3c0-4e72-4e03-9689-3a028b422ae1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.246590 Apr 02 21:01:14.152889 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1278/2852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:13 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:14.168093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.180661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:14.193430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.193896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.194960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.195415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.276531 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cc91afb1-e887-4af5-a7b2-4b6487c61535 tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/e35389b9-b75c-414e-a61b-8e4a1949e024" status: 202 len: 0 microversion: 2.1 time: 0.366075 Apr 02 21:01:14.281047 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1575/2853] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:13 2022] DELETE /compute/v2.1/os-security-groups/e35389b9-b75c-414e-a61b-8e4a1949e024 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:14.287654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-025c3e48-36c6-45a9-a1eb-3476c5298ade tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d47db790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.482604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.498233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.500524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.502698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55372707-e777-4856-a54d-fbf29f994f83 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.338381 Apr 02 21:01:14.515552 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1279/2854] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:14 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:14.521133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.521809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:14.548923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.549727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.551018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.551778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.628165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-025c3e48-36c6-45a9-a1eb-3476c5298ade tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/18517cee-f2f1-4b9b-85ea-ed279586fcde" status: 202 len: 0 microversion: 2.1 time: 0.344867 Apr 02 21:01:14.629672 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1576/2855] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:14 2022] DELETE /compute/v2.1/os-security-groups/18517cee-f2f1-4b9b-85ea-ed279586fcde => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:14.636989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.637848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:14.640050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.645580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.646116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.646975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.647487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.655005 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a0233b26-99e5-45ce-b486-894819c6f1ca tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.138176 Apr 02 21:01:14.655602 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1280/2856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:14 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:14.670466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.671098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:14.677145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.677607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.678380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.678821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.749781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.758031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.759558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.764390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de6d6366-aef6-4c88-ac47-db9085edd955 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.107827 Apr 02 21:01:14.765246 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1281/2857] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:14 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:14.770070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b32243f2-3b1d-436a-b794-4ad28038344f req-a4434701-760b-4de3-a49c-a4974fa95944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25509bd1-b73f-48ea-af8c-c66e7bd1a312", "name": "network-vif-plugged", "status": "completed", "tag": "ecba1cfd-1d70-4d61-bdd4-80f253df2828"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:14.777892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b32243f2-3b1d-436a-b794-4ad28038344f req-a4434701-760b-4de3-a49c-a4974fa95944 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.778281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b32243f2-3b1d-436a-b794-4ad28038344f req-a4434701-760b-4de3-a49c-a4974fa95944 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.795673 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b32243f2-3b1d-436a-b794-4ad28038344f req-a4434701-760b-4de3-a49c-a4974fa95944 service nova] Creating event network-vif-plugged:ecba1cfd-1d70-4d61-bdd4-80f253df2828 for instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 on nch2-master-1 Apr 02 21:01:14.801645 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b32243f2-3b1d-436a-b794-4ad28038344f req-a4434701-760b-4de3-a49c-a4974fa95944 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035335 Apr 02 21:01:14.802679 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1282/2858] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:14.807983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5eb3298d-a720-484f-bc58-5ff9f947461d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] Calling method '.version_select at 0x7f54d42bc700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.812770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:14.823746 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a0b561b-f708-4bf1-ac87-1147f122fd03 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.191583 Apr 02 21:01:14.824580 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1577/2859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:14 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:14.862920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:14.863689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:14.879947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.881348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:14.886557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:14.888494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.134878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.143340 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5def9c0-bc34-4950-b6d6-c99ac06a700b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.299405 Apr 02 21:01:15.144208 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1578/2860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:14 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:15.153968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5eb3298d-a720-484f-bc58-5ff9f947461d tempest-SecurityGroupRulesNegativeTestJSON-593519846 tempest-SecurityGroupRulesNegativeTestJSON-593519846-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/aebfdad6-c33b-4f4a-9e54-dc22c339d210" status: 202 len: 0 microversion: 2.1 time: 0.349965 Apr 02 21:01:15.155287 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1283/2861] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:14 2022] DELETE /compute/v2.1/os-security-groups/aebfdad6-c33b-4f4a-9e54-dc22c339d210 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:15.161017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3f27095-e49b-4a8d-a1ac-d64d8f32d806 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1221383218", "metadata": {"": ""}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:15.162384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3f27095-e49b-4a8d-a1ac-d64d8f32d806 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:15.163221 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3f27095-e49b-4a8d-a1ac-d64d8f32d806 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action" status: 400 len: 170 microversion: 2.1 time: 0.006274 Apr 02 21:01:15.163724 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1579/2862] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Apr 2 21:01:15 2022] POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action => generated 170 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:15.170852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:15.171516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:15.171622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:15.172171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:15.178056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.178836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.179348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.179798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.183294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.183755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.184619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.185071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.429491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.437239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-91b379cc-0b8a-421f-9ce9-074641a3645d tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.269251 Apr 02 21:01:15.446019 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1580/2863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:15 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:15.468006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:15.468978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:15.475321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.475985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.477149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.477778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.491647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.513078 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64a2b157-c5aa-443e-9d21-808a5d831321 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1315 microversion: 2.1 time: 0.343727 Apr 02 21:01:15.522976 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1284/2864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:15 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:15.523475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:15.524096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:15.532396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.533264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.535071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.535735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.789798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.799912 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e832aa5b-c4fe-4f16-9bfc-ad6a3955ce4c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.336593 Apr 02 21:01:15.801099 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1581/2865] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:15 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:15.806033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:15.806969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:15.814126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.814911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.815856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.816433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.894465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.910502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.912039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:15.913268 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44af214a-22ac-4d98-95ef-02d235a0bd25 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.395112 Apr 02 21:01:15.914213 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1285/2866] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:15 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:15.919078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:15.919702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:15.926574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.927035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:15.927984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:15.928437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.001034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.006453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.009382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.011043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.015247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86d1ed29-0658-4300-bf1f-2197ce596d07 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.212903 Apr 02 21:01:16.016111 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1582/2867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:15 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:16.016224 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-679e87a7-8f69-4588-a9dd-083af15ed76b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.100615 Apr 02 21:01:16.020618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca203770-f59c-4fcc-aaee-1a5ac897c8c8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1525777481", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:16.022158 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1286/2868] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:15 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:16.022373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca203770-f59c-4fcc-aaee-1a5ac897c8c8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:16.023154 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca203770-f59c-4fcc-aaee-1a5ac897c8c8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action" status: 400 len: 938 microversion: 2.1 time: 0.006370 Apr 02 21:01:16.024080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1583/2869] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Apr 2 21:01:16 2022] POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action => generated 938 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:16.041812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:16.042511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:16.049653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.050080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.050873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.051497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.280106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.291033 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1ca84153-8756-45c9-b088-f61bd953c886 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.252956 Apr 02 21:01:16.306489 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1287/2870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:16 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:16.316665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:16.317803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:16.330521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.331258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.332314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.333060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.520593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.528782 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abec938d-0459-4265-9336-5baf0e5ef8b1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.217076 Apr 02 21:01:16.529918 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1584/2871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:16 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:16.531129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:16.532236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:16.539637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.540093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.540903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.541344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.551796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cfa3a2fe-7f35-45aa-b3fb-f2168a61ba1a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:16.553197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cfa3a2fe-7f35-45aa-b3fb-f2168a61ba1a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:16.554302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cfa3a2fe-7f35-45aa-b3fb-f2168a61ba1a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action" status: 400 len: 619 microversion: 2.1 time: 0.006868 Apr 02 21:01:16.559643 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1585/2872] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Apr 2 21:01:16 2022] POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:01:16.568498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:16.570623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:16.584267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.585116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.586115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.586715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.692979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.702700 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f9200eb-af9e-4bbb-a5b3-7d190ad0ac32 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1502 microversion: 2.1 time: 0.176119 Apr 02 21:01:16.713071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1288/2873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:16 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:16.931657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:16.932497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:16.942748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.943733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.944606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:16.947716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:16.958045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:16.970899 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69b75e58-0c94-4179-ba53-8955ab1e2693 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.409190 Apr 02 21:01:16.980809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1586/2874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:16 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:16.994197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:16.994829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:17.002889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.003457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.004338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.004823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.191438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.206148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.207573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.208932 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afeb5e81-9241-4054-a208-af12009348ad tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.281339 Apr 02 21:01:17.209882 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1289/2875] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:16 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:17.214962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:17.215590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:17.221773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.222325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.223020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.223808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.308435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.318218 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1585b97-e7cf-4e77-a6aa-8589891eb197 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.107038 Apr 02 21:01:17.319970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1290/2876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:17 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:17.333021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:17.333957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:17.341118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.342693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.344395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.345176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.357938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.368997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96d54e69-0c72-4bc2-8803-a703be0b624e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.380021 Apr 02 21:01:17.370349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1587/2877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:16 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:17.400241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-940499550"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:17.402814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:17.419392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.420476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.423826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.424517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.486207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.501032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.502878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:17.509698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6dbfb4a-7f6c-45dd-9c7d-f7eb3616dcf2 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.186367 Apr 02 21:01:17.513764 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1291/2878] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:17 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:17.938559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5cf5d84-8a20-4335-bcd9-03a127c3b232 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action" status: 202 len: 0 microversion: 2.1 time: 0.542914 Apr 02 21:01:17.939657 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1588/2879] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:17 2022] POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:01:17.950428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1758820042"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:17.952387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:17.966495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.967211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:17.968212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:17.970954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.022382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Cannot 'createImage' instance 12ed6253-6272-447a-b897-496efb357d2c while it is in task_state image_snapshot_pending Apr 02 21:01:18.023733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 409 to user: Cannot 'createImage' instance 12ed6253-6272-447a-b897-496efb357d2c while it is in task_state image_snapshot_pending {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:18.024736 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-251891c7-c0f8-4dd4-9862-7966f4550b51 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action" status: 409 len: 167 microversion: 2.1 time: 0.078916 Apr 02 21:01:18.025922 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1292/2880] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:17 2022] POST /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c/action => generated 167 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:01:18.039218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76a90122-486a-455f-b5a7-ca7b82054c57 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '.version_select at 0x7f54d47a1160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:18.217122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76a90122-486a-455f-b5a7-ca7b82054c57 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/images/495f9ca9-ce09-4cab-b06d-f372334378cd" status: 204 len: 0 microversion: 2.1 time: 0.185076 Apr 02 21:01:18.217122 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1589/2881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:18 2022] DELETE /compute/v2.1/images/495f9ca9-ce09-4cab-b06d-f372334378cd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:18.227509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:18.228785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:18.231752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:18.232659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:18.243761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.244335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.245100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.245547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.246754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.249002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.250092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.250766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.502426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.511485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40b6dfc4-1128-45ce-b189-2da2d6ddb210 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1532 microversion: 2.1 time: 0.289887 Apr 02 21:01:18.522613 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1293/2882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:18 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1532 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:18.530397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:18.531016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:18.540315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.540893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.543333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.543839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.569433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.582800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.589395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.590646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46dedaa3-43b9-462a-bed5-9f22976d9aa1 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.367666 Apr 02 21:01:18.591568 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1590/2883] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:18 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:18.596440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86c9ac5d-fed3-4ddc-8558-865ff0a92915"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:18.596440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:18.607560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.608054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.608944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.609880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.630373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.641057 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e36c3ce-5cc9-4a3a-8c03-614e38f97046 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.115312 Apr 02 21:01:18.645400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1294/2884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:18 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:18.651594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:18.652808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:18.659251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.659930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.661114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:18.661856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:18.767579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.782730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.784297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:18.790316 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c431ca3e-93f2-4c58-8aca-ae3c17abfa1e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.143843 Apr 02 21:01:18.791306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1295/2885] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:18 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:19.082690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee32416a-1937-4449-aa31-9796c16b7eb6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488158 Apr 02 21:01:19.100259 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1591/2886] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:01:18 2022] POST /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:19.529825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:19.530456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:19.539549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.540010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.540828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.541268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.611477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:19.614092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:19.630003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.630724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.632410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.633042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.735874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.747138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5edb723-078e-4923-bf7d-f4ea613f1199 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1538 microversion: 2.1 time: 0.221675 Apr 02 21:01:19.749031 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1296/2887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:19 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1538 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:19.769058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:19.769683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:19.788273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.788900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.790251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.791893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.862410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.875608 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6fc339d8-a7ba-43d3-85e4-1d99c3deb128 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.120045 Apr 02 21:01:19.875608 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1297/2888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:19 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:19.881400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:19.882558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:19.895238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.897774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.897774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:19.898439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:19.911768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.925764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.927149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.928332 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8425112b-ebe9-46a4-8fbe-2b422f1ffe9a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.322192 Apr 02 21:01:19.929375 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1592/2889] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:19 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:19.984240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.993868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:19.995423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:20.001238 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aa026545-fb60-45d0-82d3-3552c8947a71 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.124645 Apr 02 21:01:20.002004 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1298/2890] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:19 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:20.060092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-315817a1-91fd-457d-848c-5fb9c8391600 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54d47d8b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1911121866", "description": "tempest-description-1364936319"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:20.197969 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-315817a1-91fd-457d-848c-5fb9c8391600 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.267459 Apr 02 21:01:20.199012 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1593/2891] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:20.211569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-736a638e-6b54-40c5-885d-7a47dc3ef67d tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54d42e59d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-490939418", "description": "tempest-description-1146761862"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:20.359231 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-736a638e-6b54-40c5-885d-7a47dc3ef67d tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.152976 Apr 02 21:01:20.360614 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1299/2892] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:20.409901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-787031084", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "66aaa886-49ae-4a46-8667-522d2a887f2a"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:20.461868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] validate_networks() for [('66aaa886-49ae-4a46-8667-522d2a887f2a', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:20.768738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:20.769366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:20.775674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:20.776182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:20.776952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:20.777400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:20.808562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:20.809070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:20.809632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:20.810125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:20.810612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:20.820002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:20.820592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:20.821475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:20.821998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:20.839351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Getting quotas for project 23ceefc39a5247ae86277ab79385c021. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:20.845687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Getting quotas for user ad3cf44a90a54b1eb08ba969847862e5 and project 23ceefc39a5247ae86277ab79385c021. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:20.858579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:20.860578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:20.905648 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6dae9297-8e27-439f-8117-d16fca535dcf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500761 Apr 02 21:01:20.906850 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1594/2893] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:20.911580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:20.912205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:20.918489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:20.919849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:20.920314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:20.921350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:20.921812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:20.927714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-115a0dee-f462-4b37-a62f-276595027f6b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1538 microversion: 2.1 time: 0.164190 Apr 02 21:01:20.928488 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1300/2894] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:20 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1538 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:20.941833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6665cb10-d230-4e8e-9769-d416bcdba57a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:20.942460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6665cb10-d230-4e8e-9769-d416bcdba57a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:20.985399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:20.993974 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54f735f0-3458-41a7-99b7-6c89d0c2cd5c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.086094 Apr 02 21:01:20.994759 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1595/2895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:20 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:20.997411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6665cb10-d230-4e8e-9769-d416bcdba57a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.000567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:21.001782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:21.005158 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6665cb10-d230-4e8e-9769-d416bcdba57a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1215 microversion: 2.1 time: 0.075589 Apr 02 21:01:21.015413 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1301/2896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:20 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:21.015513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:21.015513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:21.015513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:21.015513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:21.021357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:21.021982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:21.027963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:21.028390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:21.029198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:21.029636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:21.103610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.112130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.113991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.119875 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1aa71b71-1cad-4fa2-b841-5827c6dec3ac tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.102273 Apr 02 21:01:21.122371 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1302/2897] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:21 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:21.167491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.176518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.178270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:21.179571 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08b732c8-ab9d-4b63-a093-0106b3ff08bf tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.183794 Apr 02 21:01:21.180222 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1596/2898] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:20 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:21.945058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:21.945707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:21.952679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:21.953864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:21.954638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:21.955078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.010403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.012509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.023362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.024080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.025068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.025665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.091914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.101455 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f7a064c3-1795-455e-b777-e83dd91a053e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1218 microversion: 2.1 time: 0.094953 Apr 02 21:01:22.102064 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1597/2899] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:22 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:22.103163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.107858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.108490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.113076 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d82abb2-a656-4d48-931e-3fe7b4a2e166 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1520 microversion: 2.1 time: 0.172122 Apr 02 21:01:22.116507 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1303/2900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:21 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:22.116665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.116665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.116665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.116910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.132954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.133614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.141460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.141983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.142806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.143253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.171316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:01:22.183648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.195024 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76395e62-5f23-4a63-a960-7111e3bca276 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1219 microversion: 2.1 time: 0.091305 Apr 02 21:01:22.195871 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1598/2901] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:22 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:22.200577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.201287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.207349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.207807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.208623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.209075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.256297 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52e078ff-3014-44d2-968c-8a452eb6a5ca tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 204 len: 0 microversion: 2.1 time: 0.128952 Apr 02 21:01:22.256968 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1304/2902] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:01:22 2022] DELETE /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:22.263062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.263780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.269762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.270225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.271020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.271467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.281070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.289252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.290780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.295610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6050ece9-ed91-4961-9229-6b90fe9a3a3d tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.098760 Apr 02 21:01:22.296189 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1599/2903] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:22 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:22.301315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.301927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.310231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.310863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.311783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.312342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.426553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.435191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.436817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.438534 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61dc1d1f-b489-418d-a6bb-6fce28dbffc9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.179861 Apr 02 21:01:22.439354 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1305/2904] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:22 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:22.454674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.455449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.461684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.462237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.463077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.463526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.465336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.473377 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e64a143-8ced-4c6f-b3c2-c0e39c589801 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1526 microversion: 2.1 time: 0.176181 Apr 02 21:01:22.473969 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1600/2905] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:22 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:22.489254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:01:22.563757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 204 len: 0 microversion: 2.1 time: 0.112004 Apr 02 21:01:22.564822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1306/2906] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:01:22 2022] DELETE /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:22.573748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:22.574468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:22.581972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.583545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.583545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:22.583953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:22.732311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:22.740404 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36eccd7d-e606-475d-88ab-dafdb8f36122 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1554 microversion: 2.1 time: 0.170929 Apr 02 21:01:22.741000 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1601/2907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:22 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:23.119374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:23.120284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:23.129685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.130717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.132181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.132748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.204129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.212147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:23.213760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:23.226460 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8e2fba95-54ab-47a3-ab35-a8ac84c60771 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1266 microversion: 2.1 time: 0.111522 Apr 02 21:01:23.228316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.229694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.231908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1307/2908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:23 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:23.232794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.233548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.315760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:23.316311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:23.328774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.329244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.330034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.330799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.375064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.386750 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1ba19d75-df28-4eb2-82f1-6fe115945237 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1275 microversion: 2.1 time: 0.179494 Apr 02 21:01:23.387542 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1602/2909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:23 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:23.423039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.434919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.437839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.442174 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5776446b-f66a-4d1a-8f5b-75035bce2a35 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1446 microversion: 2.75 time: 0.130949 Apr 02 21:01:23.442763 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1308/2910] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:23 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:23.465222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:23.466055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:23.473563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.474114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.474892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.475332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.493326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:23.493960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:23.503976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.504541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.506175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.507068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.725707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.734643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.735892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa62d2b2-d566-403f-aa53-0d8faa73f6e7 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1526 microversion: 2.1 time: 0.247895 Apr 02 21:01:23.745267 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1309/2911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:23 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1526 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:23.751436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.753746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:23.755122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-404ad782-b98e-4361-9b81-c538ecf7d5b4 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.294983 Apr 02 21:01:23.756656 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1603/2912] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:23 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:23.760311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:23.761031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:23.768613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.769073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:23.769858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:23.770303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.039452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-85d2b6fc-6080-40bb-9ef9-e996f15efcdc req-4e0c4d5a-fce6-4ecd-ab45-95077cc696d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ed6253-6272-447a-b897-496efb357d2c", "name": "network-vif-plugged", "status": "completed", "tag": "a4cfd1fe-7824-486d-82f6-5473be5624bc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:24.047674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-85d2b6fc-6080-40bb-9ef9-e996f15efcdc req-4e0c4d5a-fce6-4ecd-ab45-95077cc696d1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.048127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-85d2b6fc-6080-40bb-9ef9-e996f15efcdc req-4e0c4d5a-fce6-4ecd-ab45-95077cc696d1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.059766 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-85d2b6fc-6080-40bb-9ef9-e996f15efcdc req-4e0c4d5a-fce6-4ecd-ab45-95077cc696d1 service nova] Creating event network-vif-plugged:a4cfd1fe-7824-486d-82f6-5473be5624bc for instance 12ed6253-6272-447a-b897-496efb357d2c on nch2-master-1 Apr 02 21:01:24.060612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:24.065616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-85d2b6fc-6080-40bb-9ef9-e996f15efcdc req-4e0c4d5a-fce6-4ecd-ab45-95077cc696d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030138 Apr 02 21:01:24.066628 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1604/2913] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:01:24.071590 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76c7a7a6-58ba-4e35-a22d-757f37ab8083 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1554 microversion: 2.1 time: 0.316683 Apr 02 21:01:24.072193 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1310/2914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:23 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1554 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:24.251715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:24.253056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:24.259622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.260077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.261124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.261729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.333839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:24.342469 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-135d576f-2165-4d5f-9291-8664789e65ae tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1272 microversion: 2.1 time: 0.096951 Apr 02 21:01:24.342958 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1605/2915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:24 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:24.405335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:24.405964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:24.413087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.413556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.414351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.414845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.469052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:24.469815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:24.477257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.477937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.479197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.480391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.601158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:24.610466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:24.612258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:24.618174 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3dc69196-1cde-4402-8f15-95359aede1f9 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1452 microversion: 2.75 time: 0.155695 Apr 02 21:01:24.640223 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1606/2916] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:24 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:24.753612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:24.754232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:24.773007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.773401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.774693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.774693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.915288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:24.927476 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-77682d05-9950-4bba-aa5c-c5ecbd57e5bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.525895 Apr 02 21:01:24.928080 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1311/2917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:24 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:24.937918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:24.938583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:24.947735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.948483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:24.949281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:24.949903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.022276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.030303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7188678c-137e-45e3-9c8e-420f2b80c34e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 200 len: 1526 microversion: 2.1 time: 0.281076 Apr 02 21:01:25.031572 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1607/2918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:24 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 1526 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:25.036807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-6cf5bc6d-5ded-49c5-85a2-f18f72917efc req-57f0d1ec-1e49-45e1-932b-9157b37dd8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131b7001-ae40-4b02-b3f4-be3e6c25dbef", "tag": "fb18d231-9f39-41dd-b0ec-34aeb8c41f47"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:25.056066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6cf5bc6d-5ded-49c5-85a2-f18f72917efc req-57f0d1ec-1e49-45e1-932b-9157b37dd8f9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.056066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6cf5bc6d-5ded-49c5-85a2-f18f72917efc req-57f0d1ec-1e49-45e1-932b-9157b37dd8f9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.068280 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-6cf5bc6d-5ded-49c5-85a2-f18f72917efc req-57f0d1ec-1e49-45e1-932b-9157b37dd8f9 service nova] Creating event network-changed:fb18d231-9f39-41dd-b0ec-34aeb8c41f47 for instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef on nch1-master-1 Apr 02 21:01:25.075105 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-6cf5bc6d-5ded-49c5-85a2-f18f72917efc req-57f0d1ec-1e49-45e1-932b-9157b37dd8f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040712 Apr 02 21:01:25.075105 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1608/2919] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:25.092288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:25.093124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:25.100654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.101121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.101919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.102424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.355832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.366336 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0f7c55b7-15fd-4d1a-8513-0b61a32a38ce tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1554 microversion: 2.1 time: 0.278709 Apr 02 21:01:25.366946 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1609/2920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:25 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1554 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:25.380705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:25.381323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:25.387284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.387739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.388529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.388972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.627086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.634296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5bf08ea-9602-496a-a7a7-651ec41fa55a tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.257212 Apr 02 21:01:25.635042 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1610/2921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:25 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:25.639883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-13a43625-64bc-42cc-a355-070c72579b9f req-6612266b-0502-469a-8f41-9eaf6f925040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ed6253-6272-447a-b897-496efb357d2c", "name": "network-vif-deleted", "tag": "a4cfd1fe-7824-486d-82f6-5473be5624bc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:25.648348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-13a43625-64bc-42cc-a355-070c72579b9f req-6612266b-0502-469a-8f41-9eaf6f925040 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.648883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-13a43625-64bc-42cc-a355-070c72579b9f req-6612266b-0502-469a-8f41-9eaf6f925040 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.660163 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-13a43625-64bc-42cc-a355-070c72579b9f req-6612266b-0502-469a-8f41-9eaf6f925040 service nova] Creating event network-vif-deleted:a4cfd1fe-7824-486d-82f6-5473be5624bc for instance 12ed6253-6272-447a-b897-496efb357d2c on nch2-master-1 Apr 02 21:01:25.665303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-13a43625-64bc-42cc-a355-070c72579b9f req-6612266b-0502-469a-8f41-9eaf6f925040 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029302 Apr 02 21:01:25.666599 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1611/2922] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:25.671790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:25.672521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:25.678886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.679206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.679993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.680494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.688267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.697820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.699585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.701120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d1d014c-69ae-411f-8055-647fad0b64f5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.771864 Apr 02 21:01:25.701899 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1312/2923] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:24 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:25.775434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.783884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.785444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:25.792064 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a919256-faa5-4794-ac7d-99d8063a3606 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1452 microversion: 2.75 time: 0.124298 Apr 02 21:01:25.792924 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1612/2924] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:25 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:25.946052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:25.947025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:25.954663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.955460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:25.957307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:25.957794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.049597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:26.050258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:26.061890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.062910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.063742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.064222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.092616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance 12ed6253-6272-447a-b897-496efb357d2c could not be found. Apr 02 21:01:26.099266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance 12ed6253-6272-447a-b897-496efb357d2c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:26.109731 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0332ad28-4579-44fc-b631-ee18d5101d85 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 404 len: 111 microversion: 2.1 time: 0.064466 Apr 02 21:01:26.110592 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1613/2925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:26 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:26.122511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a66db054-349f-445b-82f5-baa4304272ad tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'create', calling method: .version_select at 0x7f54d4822820>, body: {"keypair": {"name": "tempest-keypair-2028769559"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:26.168030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a66db054-349f-445b-82f5-baa4304272ad tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for project 46605b214f8144ebbbd2aab432bb7633. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:26.176497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a66db054-349f-445b-82f5-baa4304272ad tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for user de9e0b13df3b487cb16732fcf86746b3 and project 46605b214f8144ebbbd2aab432bb7633. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:26.309832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.323157 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3896f9e7-9d9c-4bd8-88d5-f02472195759 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.381766 Apr 02 21:01:26.326682 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1313/2926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:25 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:26.383594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:26.384618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:26.391435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.392732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.393803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.394461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.442589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.443260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.443880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lazy-loading 'fault' on Instance uuid 25509bd1-b73f-48ea-af8c-c66e7bd1a312 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:26.518516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.531712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3354935d-a45e-4fab-bee6-2606f2808240 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 200 len: 1351 microversion: 2.1 time: 0.151736 Apr 02 21:01:26.532866 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1314/2927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:26 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 1351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:26.634319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a66db054-349f-445b-82f5-baa4304272ad tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for project 46605b214f8144ebbbd2aab432bb7633. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:26.642034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a66db054-349f-445b-82f5-baa4304272ad tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for user de9e0b13df3b487cb16732fcf86746b3 and project 46605b214f8144ebbbd2aab432bb7633. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:26.658490 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a66db054-349f-445b-82f5-baa4304272ad tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.541895 Apr 02 21:01:26.659351 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1614/2928] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:01:26 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:26.661101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:26.661981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:26.679894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.680374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.681273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.681896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.721334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:26.721973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:26.728042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.728775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.729715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.730169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.878335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.886899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.888553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.889827 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eaa9a0b0-9a44-4bf6-a150-cd769356d9b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.173401 Apr 02 21:01:26.891345 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1615/2929] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:26 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:26.895482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:26.896205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:26.902200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.902777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.903625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:26.904139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:26.973600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.982082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.983604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:26.988592 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-37890fd6-cb7e-4198-bd57-cc5fabb6f54b tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1452 microversion: 2.75 time: 0.096507 Apr 02 21:01:26.989168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1616/2930] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:26 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:27.211634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:27.219085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d013f71f-c46a-4194-83a5-31e581baddc4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.570695 Apr 02 21:01:27.219670 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1315/2931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:26 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:27.343597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:27.344354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:27.354713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.355337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.356111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.356662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.551701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:27.552499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:27.557248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:27.560790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.561565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.563398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.564143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.569809 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ceecd0e9-347c-4a2d-ba51-1e7648aad05a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.230114 Apr 02 21:01:27.579480 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1617/2932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:27 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:27.581580 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. Apr 02 21:01:27.582274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:27.583514 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3679c988-52e8-436b-b25a-fc4e62e26d48 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 404 len: 111 microversion: 2.1 time: 0.037085 Apr 02 21:01:27.584561 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1316/2933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:27 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:01:27.682285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b012f6c0-8121-4ae4-8473-45919fd47dec req-a9dd98cc-301e-4ff9-8fc1-ce2cbbdf2928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25509bd1-b73f-48ea-af8c-c66e7bd1a312", "name": "network-vif-deleted", "tag": "ecba1cfd-1d70-4d61-bdd4-80f253df2828"}, {"name": "network-changed", "server_uuid": "2bf6ba71-9588-4ab5-ba8b-068b074706da", "tag": "1cf9c0d2-1588-40b8-b842-d029691bdb18"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:27.694067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b012f6c0-8121-4ae4-8473-45919fd47dec req-a9dd98cc-301e-4ff9-8fc1-ce2cbbdf2928 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.694207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:27.694302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b012f6c0-8121-4ae4-8473-45919fd47dec req-a9dd98cc-301e-4ff9-8fc1-ce2cbbdf2928 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.694986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:27.700825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.701280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.702056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.702493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.709026 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b012f6c0-8121-4ae4-8473-45919fd47dec req-a9dd98cc-301e-4ff9-8fc1-ce2cbbdf2928 service nova] Creating event network-vif-deleted:ecba1cfd-1d70-4d61-bdd4-80f253df2828 for instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 on nch2-master-1 Apr 02 21:01:27.709709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b012f6c0-8121-4ae4-8473-45919fd47dec req-a9dd98cc-301e-4ff9-8fc1-ce2cbbdf2928 service nova] Creating event network-changed:1cf9c0d2-1588-40b8-b842-d029691bdb18 for instance 2bf6ba71-9588-4ab5-ba8b-068b074706da on nch1-master-1 Apr 02 21:01:27.717628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. Apr 02 21:01:27.718188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b012f6c0-8121-4ae4-8473-45919fd47dec req-a9dd98cc-301e-4ff9-8fc1-ce2cbbdf2928 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039415 Apr 02 21:01:27.718307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:27.719413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1618/2934] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:27.719548 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-599f68d5-0bd5-4e00-af61-2b905529ed25 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029853 Apr 02 21:01:27.720781 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1317/2935] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:01:27 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:01:27.877523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2016553641", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:27.909114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:27.909844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:27.917045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.917745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.918703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:27.919302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:27.943266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:28.134216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.144440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.146281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.147487 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afad96b1-50a3-46cc-a1e1-ad1bb02b0d44 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.242781 Apr 02 21:01:28.148101 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1318/2936] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:27 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:28.152988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:28.153792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:28.161083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.161742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.162691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.163310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.252178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.261042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.263095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.269356 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a347fd49-1fc7-4a24-9e2d-b546a4a871aa tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1452 microversion: 2.75 time: 0.119970 Apr 02 21:01:28.270671 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1319/2937] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:28 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:28.287538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:28.288162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:28.297340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.297954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.299428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.301251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.478837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.487954 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ef3b8ddc-d94c-4752-8997-affa82fa1087 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.215959 Apr 02 21:01:28.488906 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1320/2938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:28 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:28.597639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:28.598508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:28.605483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.608316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.609351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.609979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.659252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:28.659894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:28.660408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:28.660845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:28.661262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:28.670286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.670925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.672003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:28.672674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:28.696273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:28.716531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:28.734495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:28.737606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:28.790816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.802818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42746b15-6217-4bf2-a682-b2670b42272a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.219939 Apr 02 21:01:28.815097 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1321/2939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:28 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:28.869387 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1eda3da7-94cb-4315-a06e-77820f615b1e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995942 Apr 02 21:01:28.878922 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1619/2940] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:28.880967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6a799c5-883c-4187-9c25-94b548c04d15 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:28.881999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6a799c5-883c-4187-9c25-94b548c04d15 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:28.947181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6a799c5-883c-4187-9c25-94b548c04d15 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:28.964137 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6a799c5-883c-4187-9c25-94b548c04d15 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd" status: 200 len: 1215 microversion: 2.1 time: 0.087053 Apr 02 21:01:28.975477 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1322/2941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:28 2022] GET /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:28.983456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0821f97-a068-4468-9239-0460ae5fb721 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:28.984924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0821f97-a068-4468-9239-0460ae5fb721 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:29.002771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0821f97-a068-4468-9239-0460ae5fb721 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:01:29.167375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:29.168148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:29.176880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.177522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.178478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.179124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.363735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-e0821f97-a068-4468-9239-0460ae5fb721 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Instance Mapping does not exist while attempting local delete cleanup. Apr 02 21:01:29.364163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.365934 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0821f97-a068-4468-9239-0460ae5fb721 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd" status: 204 len: 0 microversion: 2.1 time: 0.387935 Apr 02 21:01:29.366686 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1620/2942] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:01:28 2022] DELETE /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:29.374514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:29.375222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:29.377474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.379228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.380747 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20f3734e-7088-4126-814c-6de85efc7d0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.217659 Apr 02 21:01:29.381875 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1323/2943] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:29 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:29.387509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdf48c3a-4024-4600-b85c-4517a30d17d8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:29.388337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bdf48c3a-4024-4600-b85c-4517a30d17d8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:29.392635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.393161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.393970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.394411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.394990 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-bdf48c3a-4024-4600-b85c-4517a30d17d8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance f2c714a2-cc85-43f7-b74e-16e09497fdbd could not be found. Apr 02 21:01:29.395876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdf48c3a-4024-4600-b85c-4517a30d17d8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance f2c714a2-cc85-43f7-b74e-16e09497fdbd could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:29.396954 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bdf48c3a-4024-4600-b85c-4517a30d17d8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd" status: 404 len: 111 microversion: 2.1 time: 0.013922 Apr 02 21:01:29.397664 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1324/2944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:29 2022] GET /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:29.447017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1007183503", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:29.503628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.510141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:29.519310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.522662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.532433 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9518e976-f7e8-4279-9304-c6d7fc7e14d1 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1437 microversion: 2.75 time: 0.163916 Apr 02 21:01:29.534154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1621/2945] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:29 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1437 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:29.562896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:29.564404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:29.575136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.575928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.578696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.579557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.837166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:29.846101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c970786f-075d-403b-8d6e-b366e9498a7e tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.309469 Apr 02 21:01:29.852415 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1622/2946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:29 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:29.942268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:29.942703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:29.943187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:29.943599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:29.944019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:29.953263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.953722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.954532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.955197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.972627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:29.973754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:29.975340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:29.978113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:29.981615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.982067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.982828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:29.983262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:29.991211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:29.993602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:30.050412 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b044026-cca6-403d-990d-1813832b0c63 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607127 Apr 02 21:01:30.051537 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1325/2947] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:01:30.060610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2105823596", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:30.080647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:30.081285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:30.082510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:30.082817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:30.083402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:30.130200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] validate_networks() for [('2127fd39-f5aa-452a-9beb-bdc4f201d2d4', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:30.199574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:30.216544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.217633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.219891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.223335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.412510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:30.431226 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6cdea29a-b95f-4366-8ed8-706a231e159d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7/action" status: 202 len: 1940 microversion: 2.75 time: 0.583336 Apr 02 21:01:30.436662 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1623/2948] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:01:29 2022] POST /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7/action => generated 1940 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 02 21:01:30.447478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:30.448363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:30.458768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.459543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.460181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.460988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.637142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:30.645131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1fdf9761-03e7-434a-b2ba-69a279b9562e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.211504 Apr 02 21:01:30.645713 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1624/2949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:30 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:30.650292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:30.650901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:30.657534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.657992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.658773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.659378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.742164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:30.750461 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b372971-248e-49e0-83bb-7d43cbbf1c9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1219 microversion: 2.1 time: 0.103734 Apr 02 21:01:30.752973 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1625/2950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:30 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:30.758701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:30.760233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:30.776553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.779023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.780030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.780578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.935484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:30.935960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:30.936421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:30.937039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:30.937995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:30.947799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.949282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.950414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:30.951196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:30.981613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for project 46605b214f8144ebbbd2aab432bb7633. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:30.990700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for user de9e0b13df3b487cb16732fcf86746b3 and project 46605b214f8144ebbbd2aab432bb7633. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:31.007397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.009352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:31.012831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:31.021609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.023492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.024759 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-889d82d2-89a4-40c1-bb58-3db076bbde58 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.269779 Apr 02 21:01:31.025969 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1626/2951] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:30 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:31.040795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:31.041408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:31.048245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.048741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.049537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.049990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.090837 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d28a916-071f-4215-9b09-33796f967c23 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.037251 Apr 02 21:01:31.097966 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1326/2952] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:31.118134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:31.118778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:31.128089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.129069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.130812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.131443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.191561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:31.233905 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6debb331-0be2-40ac-9ff7-c3f5af9869c9 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.206743 Apr 02 21:01:31.234571 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1627/2953] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:31 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:31.241042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45434a5b-0021-4666-b0be-f6680e45d73a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:31.241717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-45434a5b-0021-4666-b0be-f6680e45d73a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:31.392445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45434a5b-0021-4666-b0be-f6680e45d73a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.401460 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-45434a5b-0021-4666-b0be-f6680e45d73a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1225 microversion: 2.1 time: 0.165802 Apr 02 21:01:31.405124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.413194 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1628/2954] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:31 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:31.414667 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37c15753-a730-4d3e-9789-f3edc27c30f6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.314974 Apr 02 21:01:31.418334 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1327/2955] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:31 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:31.421585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-981a2d8d-df88-44d8-b48f-7d4b35b53af3 req-7b216d20-e7d6-4bc9-b9c2-256ec4e2f10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "name": "network-vif-plugged", "status": "completed", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:31.431540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-981a2d8d-df88-44d8-b48f-7d4b35b53af3 req-7b216d20-e7d6-4bc9-b9c2-256ec4e2f10a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.432579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-981a2d8d-df88-44d8-b48f-7d4b35b53af3 req-7b216d20-e7d6-4bc9-b9c2-256ec4e2f10a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.452578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-981a2d8d-df88-44d8-b48f-7d4b35b53af3 req-7b216d20-e7d6-4bc9-b9c2-256ec4e2f10a service nova] Creating event network-vif-plugged:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch1-master-1 Apr 02 21:01:31.464172 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-981a2d8d-df88-44d8-b48f-7d4b35b53af3 req-7b216d20-e7d6-4bc9-b9c2-256ec4e2f10a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048016 Apr 02 21:01:31.465623 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1629/2956] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:31.662571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:31.663531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:31.672832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.673320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.674265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.674711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.770839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:31.771748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:31.778159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.778809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.779784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:31.780240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:31.851099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.861932 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60750a31-1f20-4bd3-a89a-693dbca04a81 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1273 microversion: 2.1 time: 0.097137 Apr 02 21:01:31.872559 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1630/2957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:31 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:31.921036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:31.931075 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4ed8d3a-433b-4883-82ab-452d29637ce8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.272739 Apr 02 21:01:31.932590 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1328/2958] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:31 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:32.043211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:32.043781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:32.050349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.050800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.051573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.052012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.209505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:32.218957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:32.220487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:32.222867 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-916dadaf-37f5-440a-87ae-e6ed3b81404c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.183222 Apr 02 21:01:32.228681 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1631/2959] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:32 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:32.254736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:32.255277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:32.274766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.275252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.276211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.276826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.435247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:32.437770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:32.438874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:32.454019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.455344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.456164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.456652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.465131 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-873e2a64-c1b0-4b80-9eb1-9dfb50550c7c tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.214985 Apr 02 21:01:32.465539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1329/2960] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:32 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:32.470832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:32.475035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:32.488205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.488916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.491124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.491583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.549827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:32.557776 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68ee44c2-959d-44fb-aac2-906aef7c346c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1295 microversion: 2.1 time: 0.125448 Apr 02 21:01:32.564859 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1632/2961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:32 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1295 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:32.865782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:32.873152 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b5541d4-3f03-4ec7-9c66-b1bf8ae51996 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.406362 Apr 02 21:01:32.873926 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1330/2962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:32 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:32.885912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:32.886698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:32.893196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.893657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.894431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.894875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.949752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:32.950780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:32.958282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.958858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:32.961028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:32.961563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.042143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:33.049614 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca655364-a1bf-4451-8172-807b039afa53 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.173700 Apr 02 21:01:33.050226 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1633/2963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:32 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:33.240209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:33.240846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:33.246586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.247040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.247804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.248245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.365896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:33.377905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a2b84f98-921a-4a55-b4a9-d92b8476839e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.430970 Apr 02 21:01:33.378729 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1331/2964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:32 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:33.422608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:33.433596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:33.435936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:33.438002 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5617f0a6-3891-4633-bf05-2fbda236da1f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1809 microversion: 2.20 time: 0.201208 Apr 02 21:01:33.450084 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1634/2965] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:33 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:33.485783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:33.486405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:33.492880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.493824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.494620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.495074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.575053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:33.575663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:33.582483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.583118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.584135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.585154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.617616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:33.642710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc5b5ca3-9839-417b-8e52-5a394733cf7b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.161319 Apr 02 21:01:33.643694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1332/2966] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:33 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:33.649451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0c2020ba-1b33-4a8d-931a-e09dcc04df9f req-4bbaff50-f499-4154-b7ee-b68ad35f52d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9962e223-2c12-4549-830d-3602ca472347", "tag": "596cda8a-b6fa-4ada-99bd-6436067f8c77"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:33.659935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0c2020ba-1b33-4a8d-931a-e09dcc04df9f req-4bbaff50-f499-4154-b7ee-b68ad35f52d0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.673989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0c2020ba-1b33-4a8d-931a-e09dcc04df9f req-4bbaff50-f499-4154-b7ee-b68ad35f52d0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.699470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0c2020ba-1b33-4a8d-931a-e09dcc04df9f req-4bbaff50-f499-4154-b7ee-b68ad35f52d0 service nova] Creating event network-changed:596cda8a-b6fa-4ada-99bd-6436067f8c77 for instance 9962e223-2c12-4549-830d-3602ca472347 on nch2-master-1 Apr 02 21:01:33.706079 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0c2020ba-1b33-4a8d-931a-e09dcc04df9f req-4bbaff50-f499-4154-b7ee-b68ad35f52d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060384 Apr 02 21:01:33.707889 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1333/2967] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:33.747667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:33.760576 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-63669f3c-b102-4c85-ab84-3a6458da4850 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.188933 Apr 02 21:01:33.761539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1635/2968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:33 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:33.891279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:33.892146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:33.899801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.900382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:33.901334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:33.901869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.066033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:34.066777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:34.073852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.074387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.075238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.075755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.261074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:34.268378 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef5f7369-bb1f-415a-8d41-cec0def19269 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.206820 Apr 02 21:01:34.277385 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1636/2969] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:34 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:34.302858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:34.310492 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca33e00a-2110-4966-81cc-b2b2141ed8b1 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.424252 Apr 02 21:01:34.320572 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1334/2970] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:33 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:34.395178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:34.395801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:34.402238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.402633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.403427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.403871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.460684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:34.461478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:34.469066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.469749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.470717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.471893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.546205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:34.554472 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-538e0502-f9e3-4226-b874-869346230760 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.163227 Apr 02 21:01:34.555183 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1637/2971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:34 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:34.662993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:34.663846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:34.669906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.670443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.671232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.672301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.748955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:34.767963 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-270e2712-e6a0-45d4-aabf-c3ce0ce77960 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.108593 Apr 02 21:01:34.781366 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1638/2972] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:34 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:34.786235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:34.786885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:34.793143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.793608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.794388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.794828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.854512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:34.876999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:34.878725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:34.879918 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09ff3dff-9e31-4392-a3ba-1534ae718b1e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1796 microversion: 2.20 time: 0.424025 Apr 02 21:01:34.907039 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1335/2973] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:34 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1796 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:34.913320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-55f6a8b9-065a-4588-bcfa-cc83f2396717 req-9dfd9690-1836-4a07-bbe1-5b2e62618b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131b7001-ae40-4b02-b3f4-be3e6c25dbef", "name": "network-vif-plugged", "status": "completed", "tag": "fb18d231-9f39-41dd-b0ec-34aeb8c41f47"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:34.926512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-55f6a8b9-065a-4588-bcfa-cc83f2396717 req-9dfd9690-1836-4a07-bbe1-5b2e62618b45 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:34.928539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-55f6a8b9-065a-4588-bcfa-cc83f2396717 req-9dfd9690-1836-4a07-bbe1-5b2e62618b45 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:34.965514 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-55f6a8b9-065a-4588-bcfa-cc83f2396717 req-9dfd9690-1836-4a07-bbe1-5b2e62618b45 service nova] Creating event network-vif-plugged:fb18d231-9f39-41dd-b0ec-34aeb8c41f47 for instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef on nch1-master-1 Apr 02 21:01:34.975059 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-55f6a8b9-065a-4588-bcfa-cc83f2396717 req-9dfd9690-1836-4a07-bbe1-5b2e62618b45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066714 Apr 02 21:01:34.976705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1336/2974] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:35.007567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:35.024144 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afbb4fe6-def2-4b8c-88b8-5f6b4b951985 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.233751 Apr 02 21:01:35.025077 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1639/2975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:34 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:35.287355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:35.288139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:35.294406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.294869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.295651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.296089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.328398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:35.328997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:35.338109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.338589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.339368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.339807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.489181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:35.496588 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a67cc89-4c6e-4374-85eb-b84e863a31a6 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.172595 Apr 02 21:01:35.497163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1640/2976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:35 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:35.571422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:35.572049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:35.578621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.579085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.579868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.580314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.691405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:35.699336 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e211a946-2657-4cfe-8581-f0b1f7a57b1b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.417637 Apr 02 21:01:35.699920 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1337/2977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:35 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:35.723511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:35.731129 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-882454ec-5d0a-40e8-82c4-366ac7b914f9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1315 microversion: 2.1 time: 0.163912 Apr 02 21:01:35.731709 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1641/2978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:35 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:35.743379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0f3d5229-b7a5-4921-a032-907f699c972f req-5ee5b207-f268-415a-92dc-886e451fa703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d1423d-d3ce-4abb-8754-c597a900f156", "tag": "bce4bd35-6728-4999-b4a7-5345c52c70e7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:35.752816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f3d5229-b7a5-4921-a032-907f699c972f req-5ee5b207-f268-415a-92dc-886e451fa703 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.753264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f3d5229-b7a5-4921-a032-907f699c972f req-5ee5b207-f268-415a-92dc-886e451fa703 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.765824 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0f3d5229-b7a5-4921-a032-907f699c972f req-5ee5b207-f268-415a-92dc-886e451fa703 service nova] Creating event network-changed:bce4bd35-6728-4999-b4a7-5345c52c70e7 for instance e2d1423d-d3ce-4abb-8754-c597a900f156 on nch2-master-1 Apr 02 21:01:35.770527 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0f3d5229-b7a5-4921-a032-907f699c972f req-5ee5b207-f268-415a-92dc-886e451fa703 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031097 Apr 02 21:01:35.771181 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1338/2979] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:35.787833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:35.788518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:35.794614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.795070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.795850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:35.796292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:35.873184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:35.889706 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7dcd3dbe-5e92-4d26-85f7-373d2155df94 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.105616 Apr 02 21:01:35.902245 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1642/2980] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:35 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:36.043221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:36.044173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:36.050833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.051289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.052075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.052559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.291356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:36.299014 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81f58ccd-bd12-416b-aaa5-671f7b251322 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.260592 Apr 02 21:01:36.299608 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1339/2981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:36 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:36.513526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:36.514190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:36.521000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.521456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.522226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.522671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.658293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:36.666966 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d9b0eb4b-7e77-4ba6-8449-d62db3c44611 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.157358 Apr 02 21:01:36.667546 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1643/2982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:36 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:36.716645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:36.717270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:36.723306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.723768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.724568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.725018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.747033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:36.747634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:36.754302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.754761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.755542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.755991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.859690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:36.867976 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a20c8ef1-e17b-4cd3-a0bf-39ee6ff70db5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.155159 Apr 02 21:01:36.868581 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1340/2983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:36 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:36.894046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:36.901440 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6fc233e2-9fcf-4658-91ac-819198837a86 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1504 microversion: 2.1 time: 0.158356 Apr 02 21:01:36.902005 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1644/2984] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:36 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:36.910247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:36.910868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:36.917279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.917743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.918226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1911121866"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:36.918520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.918878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:36.918969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.925283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.925735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.926497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:36.926931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:36.990132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:37.006761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a145d5e2-7254-425c-a66b-092b1fc7efc3 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.100760 Apr 02 21:01:37.007562 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1341/2985] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:36 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:37.011968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-7d70d47c-3c2e-4aa5-ad2a-bb33cedb19c0 req-b059cc1d-8281-49f8-b6fb-b43cde302111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf6ba71-9588-4ab5-ba8b-068b074706da", "name": "network-vif-plugged", "status": "completed", "tag": "1cf9c0d2-1588-40b8-b842-d029691bdb18"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:37.019832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7d70d47c-3c2e-4aa5-ad2a-bb33cedb19c0 req-b059cc1d-8281-49f8-b6fb-b43cde302111 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.020290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7d70d47c-3c2e-4aa5-ad2a-bb33cedb19c0 req-b059cc1d-8281-49f8-b6fb-b43cde302111 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.030766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-7d70d47c-3c2e-4aa5-ad2a-bb33cedb19c0 req-b059cc1d-8281-49f8-b6fb-b43cde302111 service nova] Creating event network-vif-plugged:1cf9c0d2-1588-40b8-b842-d029691bdb18 for instance 2bf6ba71-9588-4ab5-ba8b-068b074706da on nch1-master-1 Apr 02 21:01:37.036562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-7d70d47c-3c2e-4aa5-ad2a-bb33cedb19c0 req-b059cc1d-8281-49f8-b6fb-b43cde302111 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027955 Apr 02 21:01:37.037155 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1342/2986] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:37.056850 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.network.security_group_api [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Adding security group c13f0570-327b-4120-8ed5-2f86d24be6fe to port fb18d231-9f39-41dd-b0ec-34aeb8c41f47 Apr 02 21:01:37.316248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:37.317163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:37.323537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.323992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.324801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.325251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.468259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:37.477372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d3a6c7c-0bee-47d4-b425-13b5cc4b19f8 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef/action" status: 202 len: 0 microversion: 2.1 time: 0.562190 Apr 02 21:01:37.477628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e885b22-dd72-48be-a873-27178ade07ba tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.165451 Apr 02 21:01:37.483121 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1645/2987] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:36 2022] POST /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:37.486554 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1343/2988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:37 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:37.490155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-66fa0021-08b4-4902-bb60-72b9dd8df609 req-d64aa01d-a17c-4ae1-9d4c-48571b0a37b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131b7001-ae40-4b02-b3f4-be3e6c25dbef", "tag": "fb18d231-9f39-41dd-b0ec-34aeb8c41f47"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:37.491369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-490939418"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:37.491919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:37.498152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.498796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.499752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.500342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.502664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-66fa0021-08b4-4902-bb60-72b9dd8df609 req-d64aa01d-a17c-4ae1-9d4c-48571b0a37b1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.503381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-66fa0021-08b4-4902-bb60-72b9dd8df609 req-d64aa01d-a17c-4ae1-9d4c-48571b0a37b1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.515557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-66fa0021-08b4-4902-bb60-72b9dd8df609 req-d64aa01d-a17c-4ae1-9d4c-48571b0a37b1 service nova] Creating event network-changed:fb18d231-9f39-41dd-b0ec-34aeb8c41f47 for instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef on nch1-master-1 Apr 02 21:01:37.522251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-66fa0021-08b4-4902-bb60-72b9dd8df609 req-d64aa01d-a17c-4ae1-9d4c-48571b0a37b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037613 Apr 02 21:01:37.523242 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1646/2989] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:37.649823 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.network.security_group_api [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Adding security group 6523b211-2954-4b11-9a65-3f3c84efe927 to port fb18d231-9f39-41dd-b0ec-34aeb8c41f47 Apr 02 21:01:37.685128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:37.687036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:37.695246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.695922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.696901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:37.697531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:37.967343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:37.982713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1197fd49-59c7-437b-8a21-68c0a722b704 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1314 microversion: 2.1 time: 0.301866 Apr 02 21:01:37.983474 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1647/2990] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:37 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:37.996859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:37.997676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:38.010907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.011369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.012153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.012628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.051721 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-22dfdcf6-4433-431e-bca0-28790c7068b4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef/action" status: 202 len: 0 microversion: 2.1 time: 0.564009 Apr 02 21:01:38.052556 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1344/2991] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:37 2022] POST /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:38.057886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:38.058701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:38.071955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.073290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.074079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.074519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.162439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:38.181905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46492e18-10e3-43c8-a76f-9eb5f0d7ae06 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.128120 Apr 02 21:01:38.182936 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1345/2992] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:38 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:38.187679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:38.188869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:38.195151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.195681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.196615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.197099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.262670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:38.270906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-412f97e5-12cf-4489-800d-e6b7a7b07865 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.286314 Apr 02 21:01:38.271497 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1648/2993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:37 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:38.277481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f9d37e74-1f8a-4c81-a35f-712d3606c208 req-afa55975-7cf9-4391-bff4-0cb5b9f764e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131b7001-ae40-4b02-b3f4-be3e6c25dbef", "tag": "fb18d231-9f39-41dd-b0ec-34aeb8c41f47"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:38.286649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f9d37e74-1f8a-4c81-a35f-712d3606c208 req-afa55975-7cf9-4391-bff4-0cb5b9f764e8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.287097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f9d37e74-1f8a-4c81-a35f-712d3606c208 req-afa55975-7cf9-4391-bff4-0cb5b9f764e8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.300274 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f9d37e74-1f8a-4c81-a35f-712d3606c208 req-afa55975-7cf9-4391-bff4-0cb5b9f764e8 service nova] Creating event network-changed:fb18d231-9f39-41dd-b0ec-34aeb8c41f47 for instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef on nch1-master-1 Apr 02 21:01:38.305251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f9d37e74-1f8a-4c81-a35f-712d3606c208 req-afa55975-7cf9-4391-bff4-0cb5b9f764e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031592 Apr 02 21:01:38.311750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1649/2994] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:38.381691 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecaedbdf-bc04-48de-858b-a6e57487f410 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.197833 Apr 02 21:01:38.382715 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1346/2995] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:01:38 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef/os-security-groups => generated 1158 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:38.397420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2dcd1157-7370-4d26-bc6e-017093cda9c5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54c7e73280>, body: {"security_group": {"name": " tempest-securitygroup -1062346568 ", "description": "tempest-description-1690234362"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:38.494499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:38.495285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:38.504126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.504916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.505823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:38.506377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:38.698918 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2dcd1157-7370-4d26-bc6e-017093cda9c5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.305880 Apr 02 21:01:38.700806 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1650/2996] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:38 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:38.712425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8e1faf9-374e-4f3f-af77-919406c1b3d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54d47d84c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:38.780022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:38.797315 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-206519d9-ec5d-49b6-842c-f60ddd26eb83 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.307055 Apr 02 21:01:38.798576 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1347/2997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:38 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:38.837686 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8e1faf9-374e-4f3f-af77-919406c1b3d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4" status: 200 len: 224 microversion: 2.1 time: 0.130260 Apr 02 21:01:38.844756 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1651/2998] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:01:38 2022] GET /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4 => generated 224 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:38.849931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6ae34eae-3fd6-48f6-aca0-ae3c9094e9bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54d40a5820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:38.999702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.001012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:39.008941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.009405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.010194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.010772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.028269 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6ae34eae-3fd6-48f6-aca0-ae3c9094e9bd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4" status: 202 len: 0 microversion: 2.1 time: 0.182213 Apr 02 21:01:39.029151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1348/2999] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:38 2022] DELETE /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:39.044955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fc44062-5753-4209-b605-cf8e4994beae tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54d40a5940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.068583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-2fc44062-5753-4209-b605-cf8e4994beae tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:39.069991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-2fc44062-5753-4209-b605-cf8e4994beae tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:01:39.070588 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-2fc44062-5753-4209-b605-cf8e4994beae tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 does not exist Apr 02 21:01:39.070588 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-78db40bc-3832-4698-99b4-38a9247f918c'] Apr 02 21:01:39.071389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fc44062-5753-4209-b605-cf8e4994beae tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 does not exist Apr 02 21:01:39.071389 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-78db40bc-3832-4698-99b4-38a9247f918c'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:39.072358 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fc44062-5753-4209-b605-cf8e4994beae tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4" status: 404 len: 194 microversion: 2.1 time: 0.039367 Apr 02 21:01:39.073340 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1349/3000] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4 => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:01:39.083668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9300de63-85ea-49b7-88e3-d1cb0c540a50 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54d409daf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-799734308", "description": "tempest-description-205330027"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:39.158798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:39.166906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9ac88a2-d05e-4ad1-bba5-7c385dbd6886 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1463 microversion: 2.1 time: 0.171078 Apr 02 21:01:39.167518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1652/3001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:38 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:39.226025 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9300de63-85ea-49b7-88e3-d1cb0c540a50 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.146011 Apr 02 21:01:39.226894 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1350/3002] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:39 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:39.238477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.239365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:39.245752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.246211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.246983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.247423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.291079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b6c5dd3-1a04-4028-915e-3b3abca6182b tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Calling method '.version_select at 0x7f54d48f3040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.300739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b6c5dd3-1a04-4028-915e-3b3abca6182b tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.301195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b6c5dd3-1a04-4028-915e-3b3abca6182b tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.317267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b6c5dd3-1a04-4028-915e-3b3abca6182b tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.317671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:39.317779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b6c5dd3-1a04-4028-915e-3b3abca6182b tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.335485 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b6c5dd3-1a04-4028-915e-3b3abca6182b tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/de63710973d349dea7a070116eeb6d33?start=2022-04-01T21%3A01%3A39.176579&end=2022-04-03T21%3A01%3A39.176579" status: 200 len: 700 microversion: 2.1 time: 0.155339 Apr 02 21:01:39.335660 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eee571d9-eede-41c8-92f1-9b0787de8091 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.100555 Apr 02 21:01:39.336505 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1653/3004] 10.222.0.18 () {58 vars in 1411 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/os-simple-tenant-usage/de63710973d349dea7a070116eeb6d33?start=2022-04-01T21%3A01%3A39.176579&end=2022-04-03T21%3A01%3A39.176579 => generated 700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:01:39.336617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1351/3004] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:39.340560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.341166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:39.343537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d0f86d8-70b4-418a-a734-1b53af27bb24 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54c7e49f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-264733051", "description": "tempest-description-1688930910"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:39.346882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.347336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.348171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.348666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.481574 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d0f86d8-70b4-418a-a734-1b53af27bb24 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.141608 Apr 02 21:01:39.482738 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1654/3005] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:39.488375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:39.488762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31959785-3586-4bc9-91a3-c1f52e5a61e7 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '.version_select at 0x7f54d47dbca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.497775 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e746bef3-2e00-4721-936b-2ee85480d9ab tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.160346 Apr 02 21:01:39.498561 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1352/3006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:39.503176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a26a70af-5750-4e31-8068-5b3f8f43ed84 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54d504c160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1488141446", "description": "tempest-description-1413737984"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:39.507369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31959785-3586-4bc9-91a3-c1f52e5a61e7 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.507939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31959785-3586-4bc9-91a3-c1f52e5a61e7 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.518042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31959785-3586-4bc9-91a3-c1f52e5a61e7 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.518563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31959785-3586-4bc9-91a3-c1f52e5a61e7 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.530415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31959785-3586-4bc9-91a3-c1f52e5a61e7 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/de63710973d349dea7a070116eeb6d33?start=2022-04-01T21%3A01%3A39.176579&end=2022-04-03T21%3A01%3A39.176579" status: 200 len: 695 microversion: 2.1 time: 0.046575 Apr 02 21:01:39.531101 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1655/3007] 10.222.0.18 () {58 vars in 1411 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/os-simple-tenant-usage/de63710973d349dea7a070116eeb6d33?start=2022-04-01T21%3A01%3A39.176579&end=2022-04-03T21%3A01%3A39.176579 => generated 695 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:39.544621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5912b869-0d83-4b0b-84e5-25d9f9b095d8 tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Calling method '.version_select at 0x7f54da25c0d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.553138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5912b869-0d83-4b0b-84e5-25d9f9b095d8 tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.553661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5912b869-0d83-4b0b-84e5-25d9f9b095d8 tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.569070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5912b869-0d83-4b0b-84e5-25d9f9b095d8 tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.569785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5912b869-0d83-4b0b-84e5-25d9f9b095d8 tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.637550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a26a70af-5750-4e31-8068-5b3f8f43ed84 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.137616 Apr 02 21:01:39.638555 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1353/3008] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:39 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:39.649589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-035e0fb0-5451-4897-83c7-01a7ddce0696 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7fd15e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.688867 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5912b869-0d83-4b0b-84e5-25d9f9b095d8 tempest-TenantUsagesTestJSON-294539642 tempest-TenantUsagesTestJSON-294539642-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-01T21%3A01%3A39.176579&end=2022-04-03T21%3A01%3A39.176579&detailed=1" status: 200 len: 33464 microversion: 2.1 time: 0.148204 Apr 02 21:01:39.689493 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1656/3009] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-01T21%3A01%3A39.176579&end=2022-04-03T21%3A01%3A39.176579&detailed=1 => generated 33464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:01:39.722851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.723476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:39.729737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.730197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.730955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.732288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.757814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:01:39.838089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9581bf28-a717-4ecf-b6cd-b5ce9759937c tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 204 len: 0 microversion: 2.1 time: 0.119411 Apr 02 21:01:39.839024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1657/3010] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:01:39 2022] DELETE /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:39.842989 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-035e0fb0-5451-4897-83c7-01a7ddce0696 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.197048 Apr 02 21:01:39.843881 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1354/3011] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:39.848660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.849371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:39.853988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:39.854615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:39.855359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.855818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.856624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.857077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.864692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.865219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:39.866386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:39.866950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.016115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:40.023998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:40.024202 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb377673-4613-4a8f-b2f0-c7ccec03305c tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.183850 Apr 02 21:01:40.024899 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1658/3012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:40.029084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e08b216e-a05e-4f80-b98e-64bddaf217e7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54d47dbca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.041424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-458d0cc5-4964-4024-beca-7c787dab7d70 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1469 microversion: 2.1 time: 0.196370 Apr 02 21:01:40.046960 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1355/3013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:39 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:40.202776 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e08b216e-a05e-4f80-b98e-64bddaf217e7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3d08f432-5cdc-4982-8b42-0913079455f9" status: 202 len: 0 microversion: 2.1 time: 0.176977 Apr 02 21:01:40.209377 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1659/3014] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:40 2022] DELETE /compute/v2.1/os-security-groups/3d08f432-5cdc-4982-8b42-0913079455f9 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:40.221242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-19b5a4dc-00a7-469b-bc38-02cf3c122e7b req-63755d79-3b07-47a9-9920-8d89a2b0f14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9962e223-2c12-4549-830d-3602ca472347", "name": "network-vif-plugged", "status": "completed", "tag": "596cda8a-b6fa-4ada-99bd-6436067f8c77"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:40.224730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b03d55af-9f80-448c-b58a-744a47150007 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54da25c430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.232324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-19b5a4dc-00a7-469b-bc38-02cf3c122e7b req-63755d79-3b07-47a9-9920-8d89a2b0f14a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.232810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-19b5a4dc-00a7-469b-bc38-02cf3c122e7b req-63755d79-3b07-47a9-9920-8d89a2b0f14a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.247085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-19b5a4dc-00a7-469b-bc38-02cf3c122e7b req-63755d79-3b07-47a9-9920-8d89a2b0f14a service nova] Creating event network-vif-plugged:596cda8a-b6fa-4ada-99bd-6436067f8c77 for instance 9962e223-2c12-4549-830d-3602ca472347 on nch2-master-1 Apr 02 21:01:40.252601 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-19b5a4dc-00a7-469b-bc38-02cf3c122e7b req-63755d79-3b07-47a9-9920-8d89a2b0f14a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046267 Apr 02 21:01:40.253543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1356/3015] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:40.255537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-b03d55af-9f80-448c-b58a-744a47150007 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3d08f432-5cdc-4982-8b42-0913079455f9 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:40.256136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-b03d55af-9f80-448c-b58a-744a47150007 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 3d08f432-5cdc-4982-8b42-0913079455f9 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:01:40.256717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b03d55af-9f80-448c-b58a-744a47150007 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 3d08f432-5cdc-4982-8b42-0913079455f9 does not exist Apr 02 21:01:40.256717 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-3676eacd-ccd3-4f22-9f94-d5af15b55e46'] Apr 02 21:01:40.257328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b03d55af-9f80-448c-b58a-744a47150007 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 3d08f432-5cdc-4982-8b42-0913079455f9 does not exist Apr 02 21:01:40.257328 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-3676eacd-ccd3-4f22-9f94-d5af15b55e46'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:40.258383 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b03d55af-9f80-448c-b58a-744a47150007 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/3d08f432-5cdc-4982-8b42-0913079455f9" status: 404 len: 194 microversion: 2.1 time: 0.047883 Apr 02 21:01:40.258923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1660/3016] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:01:40 2022] GET /compute/v2.1/os-security-groups/3d08f432-5cdc-4982-8b42-0913079455f9 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:40.268899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96c32bd3-1dd7-4c5d-ae96-64265942a0b6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7feddc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.355805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.356421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:40.365424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.366145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.367121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.367565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.500361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:40.518825 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1e28b90-c9c8-4062-9356-d3f71a188b0e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.167599 Apr 02 21:01:40.519509 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1661/3017] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:40 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:40.528470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-96c32bd3-1dd7-4c5d-ae96-64265942a0b6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97" status: 202 len: 0 microversion: 2.1 time: 0.264844 Apr 02 21:01:40.529157 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1357/3018] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:40 2022] DELETE /compute/v2.1/os-security-groups/dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:01:40.539067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.539967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:40.541306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85d38c00-dd1a-4289-ab0e-b2e2276bc644 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54d4aff1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.548852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.549326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.550186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.550598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.570969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-85d38c00-dd1a-4289-ab0e-b2e2276bc644 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 does not exist", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:40.571654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.security_group_api [None req-85d38c00-dd1a-4289-ab0e-b2e2276bc644 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 not found {{(pid=136517) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:01:40.572258 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-85d38c00-dd1a-4289-ab0e-b2e2276bc644 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 does not exist Apr 02 21:01:40.572258 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-df8df7a5-73b5-4094-9423-24b78bbd6ca4'] Apr 02 21:01:40.573180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85d38c00-dd1a-4289-ab0e-b2e2276bc644 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 does not exist Apr 02 21:01:40.573180 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-df8df7a5-73b5-4094-9423-24b78bbd6ca4'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:40.574440 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85d38c00-dd1a-4289-ab0e-b2e2276bc644 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97" status: 404 len: 194 microversion: 2.1 time: 0.038912 Apr 02 21:01:40.575082 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1358/3019] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:01:40 2022] GET /compute/v2.1/os-security-groups/dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:40.586746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-841750d6-7062-4aca-b8d4-b1bd5d496afe tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7fd4940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.695522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:40.702875 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad60a6b4-f7a3-4d21-8d7a-a7de96f8c8d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1315 microversion: 2.1 time: 0.168967 Apr 02 21:01:40.703449 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1662/3020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:40 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:40.765297 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-841750d6-7062-4aca-b8d4-b1bd5d496afe tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/83a34da8-bd0b-4d14-8446-c45adbac4380" status: 202 len: 0 microversion: 2.1 time: 0.185159 Apr 02 21:01:40.765891 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1359/3021] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:40 2022] DELETE /compute/v2.1/os-security-groups/83a34da8-bd0b-4d14-8446-c45adbac4380 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:01:40.775931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b07f950c-c7d4-451c-abce-a99150283edc tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7e2e790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.797244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-b07f950c-c7d4-451c-abce-a99150283edc tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83a34da8-bd0b-4d14-8446-c45adbac4380 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:40.797866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-b07f950c-c7d4-451c-abce-a99150283edc tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 83a34da8-bd0b-4d14-8446-c45adbac4380 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:01:40.798382 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b07f950c-c7d4-451c-abce-a99150283edc tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 83a34da8-bd0b-4d14-8446-c45adbac4380 does not exist Apr 02 21:01:40.798382 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-027819ad-8e54-49db-b922-294df4620600'] Apr 02 21:01:40.799003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b07f950c-c7d4-451c-abce-a99150283edc tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 83a34da8-bd0b-4d14-8446-c45adbac4380 does not exist Apr 02 21:01:40.799003 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-027819ad-8e54-49db-b922-294df4620600'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:40.799832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b07f950c-c7d4-451c-abce-a99150283edc tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/83a34da8-bd0b-4d14-8446-c45adbac4380" status: 404 len: 194 microversion: 2.1 time: 0.029134 Apr 02 21:01:40.800422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1663/3022] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:01:40 2022] GET /compute/v2.1/os-security-groups/83a34da8-bd0b-4d14-8446-c45adbac4380 => generated 194 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:40.809201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b4cf0b0-af3e-42ba-9b68-82c16fc520a3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7fd4af0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.830405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:40.830920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:40.837942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.838445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.839233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:40.839738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:40.930091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lazy-loading 'services' on Instance uuid 259abe5f-f848-4966-b186-a747835eab18 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:40.976408 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b4cf0b0-af3e-42ba-9b68-82c16fc520a3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.171422 Apr 02 21:01:40.977148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1360/3023] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 21:01:40 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:40.991289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c30e7825-7064-49a1-b372-6a020580f80d tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54d49eb430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-270351546", "description": "tempest-description-1302612029"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:41.002653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-44bfc711-bf9e-42f0-a11e-b011e33a1305 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-volume_attachments/edb42d4f-4c36-43fc-9b81-4680a8054cf5" status: 202 len: 0 microversion: 2.1 time: 0.176593 Apr 02 21:01:41.006298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1664/3024] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:01:40 2022] DELETE /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-volume_attachments/edb42d4f-4c36-43fc-9b81-4680a8054cf5 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:01:41.046880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:41.048309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:41.061227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.061695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.062503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.063002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.150458 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c30e7825-7064-49a1-b372-6a020580f80d tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.163303 Apr 02 21:01:41.151708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1361/3025] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:41.165089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:41.165967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:41.173682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.174215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.175056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.175569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.211720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:41.220160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2fc83bd2-1a81-45be-91f2-873b209c7430 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.179363 Apr 02 21:01:41.221101 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1665/3026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:41 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:41.227101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd1071ff-b2c1-4df1-baea-ddeec7389bf1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54c7e48b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1001253703", "description": "tempest-description-956213401"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:41.317135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:41.325427 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61f61668-7633-499c-aa71-ea2995802240 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1469 microversion: 2.1 time: 0.164242 Apr 02 21:01:41.326118 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1362/3027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:41 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:41.367390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd1071ff-b2c1-4df1-baea-ddeec7389bf1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.145124 Apr 02 21:01:41.368196 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1666/3028] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:01:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:41.415857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1094265609", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "66aaa886-49ae-4a46-8667-522d2a887f2a"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:41.467319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] validate_networks() for [('66aaa886-49ae-4a46-8667-522d2a887f2a', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:41.538774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:41.539386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:41.546111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.546570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.547429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.548527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.639655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:41.669128 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-997f972f-dc95-422c-9f2d-f7e3d89b31ce tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.133714 Apr 02 21:01:41.669673 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1667/3029] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:41 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:41.720959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:41.721574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:41.727550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.728009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.728881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.729318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.872709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:41.873183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:41.874923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:41.875696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:41.876215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:41.888231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.888729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.889538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:41.889983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:41.913038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Getting quotas for project 23ceefc39a5247ae86277ab79385c021. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:41.920439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Getting quotas for user ad3cf44a90a54b1eb08ba969847862e5 and project 23ceefc39a5247ae86277ab79385c021. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:41.946377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:41.949364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:41.960231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:41.974200 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f0aadb9-82e6-4b7e-afe9-700f0a147478 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1503 microversion: 2.1 time: 0.257588 Apr 02 21:01:41.975513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1668/3030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:41 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:41.992892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:41.993560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.002430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.003468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.004495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.005295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.022547 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6db95307-0470-4301-85b1-a9782529c9ad tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610445 Apr 02 21:01:42.025420 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1363/3031] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:42.036864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0a855828-c7bb-4a59-a2ef-2e2631781ea1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:42.037664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0a855828-c7bb-4a59-a2ef-2e2631781ea1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.130480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0a855828-c7bb-4a59-a2ef-2e2631781ea1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:42.138384 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0a855828-c7bb-4a59-a2ef-2e2631781ea1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1216 microversion: 2.1 time: 0.107052 Apr 02 21:01:42.148508 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1364/3032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:42 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:42.148750 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-165c2c48-9d06-4641-abd2-85af5e9d0722 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347/action" status: 202 len: 0 microversion: 2.1 time: 0.158470 Apr 02 21:01:42.148750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1669/3033] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:41 2022] POST /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:01:42.158700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:42.159597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.166830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.167526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.168647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.169208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.192901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d01a2240-8403-428d-afaf-f2d937463e9f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:42.200590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d01a2240-8403-428d-afaf-f2d937463e9f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.201215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d01a2240-8403-428d-afaf-f2d937463e9f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.277878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d01a2240-8403-428d-afaf-f2d937463e9f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Going to try to stop instance {{(pid=136518) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:01:42.378445 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d01a2240-8403-428d-afaf-f2d937463e9f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action" status: 202 len: 0 microversion: 2.1 time: 0.190051 Apr 02 21:01:42.379430 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1670/3034] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:42 2022] POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:01:42.395627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:42.396319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.404914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.405441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.406587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.408759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.451368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:42.462069 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1129d46-5958-4edb-ae2e-ec11e1ed7f58 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1508 microversion: 2.1 time: 0.308078 Apr 02 21:01:42.474222 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1365/3035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:42 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:42.482002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-7e575d92-eb1e-40b4-a315-94bc90fcf6fc req-71485bef-d7df-41d0-87a6-7885c9ea5162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d1423d-d3ce-4abb-8754-c597a900f156", "name": "network-vif-plugged", "status": "completed", "tag": "bce4bd35-6728-4999-b4a7-5345c52c70e7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:42.495934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7e575d92-eb1e-40b4-a315-94bc90fcf6fc req-71485bef-d7df-41d0-87a6-7885c9ea5162 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.496400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7e575d92-eb1e-40b4-a315-94bc90fcf6fc req-71485bef-d7df-41d0-87a6-7885c9ea5162 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.525803 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-7e575d92-eb1e-40b4-a315-94bc90fcf6fc req-71485bef-d7df-41d0-87a6-7885c9ea5162 service nova] Creating event network-vif-plugged:bce4bd35-6728-4999-b4a7-5345c52c70e7 for instance e2d1423d-d3ce-4abb-8754-c597a900f156 on nch2-master-1 Apr 02 21:01:42.534817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-7e575d92-eb1e-40b4-a315-94bc90fcf6fc req-71485bef-d7df-41d0-87a6-7885c9ea5162 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058477 Apr 02 21:01:42.536479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1366/3036] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:42.557049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5a524aa5-58bb-4622-bbae-2dfd354a2280 req-0874ca9a-59e0-4b15-8ffe-22606bf2f24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf6ba71-9588-4ab5-ba8b-068b074706da", "name": "network-vif-deleted", "tag": "1cf9c0d2-1588-40b8-b842-d029691bdb18"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:42.584860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5a524aa5-58bb-4622-bbae-2dfd354a2280 req-0874ca9a-59e0-4b15-8ffe-22606bf2f24e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.585320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5a524aa5-58bb-4622-bbae-2dfd354a2280 req-0874ca9a-59e0-4b15-8ffe-22606bf2f24e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.626987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5a524aa5-58bb-4622-bbae-2dfd354a2280 req-0874ca9a-59e0-4b15-8ffe-22606bf2f24e service nova] Creating event network-vif-deleted:1cf9c0d2-1588-40b8-b842-d029691bdb18 for instance 2bf6ba71-9588-4ab5-ba8b-068b074706da on nch1-master-1 Apr 02 21:01:42.633502 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5a524aa5-58bb-4622-bbae-2dfd354a2280 req-0874ca9a-59e0-4b15-8ffe-22606bf2f24e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095550 Apr 02 21:01:42.634494 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1367/3037] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:42.639800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:42.640731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.647689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.648077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.649003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.649497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.660262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:42.674532 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d369dfac-3328-4f5f-9bcb-3460f68baa92 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.293724 Apr 02 21:01:42.681793 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1671/3038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:42 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:42.688954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:42.690276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.695699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.696162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.696659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lazy-loading 'fault' on Instance uuid 2bf6ba71-9588-4ab5-ba8b-068b074706da {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:42.697728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.698192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.698997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.699436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.763413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a3cb2d2505e446ba9cc6b429f07e9f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de63710973d349dea7a070116eeb6d33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:42.772089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4773a2a2-2979-49bc-bee0-8c0e44b432f4 tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 200 len: 1304 microversion: 2.1 time: 0.136290 Apr 02 21:01:42.773619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1368/3039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:42 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:42.778869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:42.779495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:42.785981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.786436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.787303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:42.787654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:42.850061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:42.858856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a96b6dd-b018-4a12-8d00-46434c5ef9d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.174929 Apr 02 21:01:42.859437 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1672/3040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:42 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:42.868443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:42.886539 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df3ad2d9-40f3-415e-ac1a-f197132e75eb tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.111110 Apr 02 21:01:42.887064 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1369/3041] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:42 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:43.160177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.160831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.167215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.167664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.168421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.168889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.228133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:43.235884 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-426838d9-2aaf-4163-968d-d48bd123b050 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1268 microversion: 2.1 time: 0.079561 Apr 02 21:01:43.236447 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1673/3042] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:43 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1268 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:43.483834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.485568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.493069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.493531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.494338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.494976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.691158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.691766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.698446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.698897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.699662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.700099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.747962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:43.755436 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-33468be6-3077-4e1a-839e-3642893c1563 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1488 microversion: 2.1 time: 0.275991 Apr 02 21:01:43.756384 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1370/3043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:43 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1488 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:43.771934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.772438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.778723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.779180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.780053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.780694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.807021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:01:43.851555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:43.867956 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afc12e6e-159c-46c1-b668-4c8e3527617a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1325 microversion: 2.1 time: 0.179869 Apr 02 21:01:43.868592 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1674/3044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:43 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:43.875845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.876703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] [instance: 2bf6ba71-9588-4ab5-ba8b-068b074706da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.886004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.886459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.887420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.888016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.895574 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5fbf5ab0-f5c1-4b2e-97c9-a9ea010cd29a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 204 len: 0 microversion: 2.1 time: 0.127171 Apr 02 21:01:43.899433 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1371/3045] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:01:43 2022] DELETE /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:01:43.901464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.902287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.909294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.909751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.910531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.910971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.911151 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] HTTP exception thrown: Instance 2bf6ba71-9588-4ab5-ba8b-068b074706da could not be found. Apr 02 21:01:43.912495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] Returning 404 to user: Instance 2bf6ba71-9588-4ab5-ba8b-068b074706da could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:43.912948 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87ccb53e-ff87-40c4-8fd3-728952bbee2f tempest-TenantUsagesTestJSON-21707483 tempest-TenantUsagesTestJSON-21707483-project] 10.222.0.18 "GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da" status: 404 len: 111 microversion: 2.1 time: 0.043172 Apr 02 21:01:43.916926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1675/3046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:43 2022] GET /compute/v2.1/servers/2bf6ba71-9588-4ab5-ba8b-068b074706da => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:43.920582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:43.922005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:43.929208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.929208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:43.930333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:43.930884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:44.106467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:44.114303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98557c2e-c781-4d4e-969c-ef31cb0be410 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1494 microversion: 2.1 time: 0.199337 Apr 02 21:01:44.115061 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1676/3047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:43 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1494 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:44.119452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:44.120203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:44.130538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:44.131320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:44.132624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:44.133207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:44.196986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:44.207683 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d557a0d-d17b-4c41-980a-21ecd46b51a7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.310244 Apr 02 21:01:44.217325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:44.218238 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1372/3048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:43 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:44.238888 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e5cd278-e6f5-40b5-b247-bc7203ea8753 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.122927 Apr 02 21:01:44.239888 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1677/3049] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:44 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:44.257091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:44.260119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:44.269906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:44.270365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:44.271152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:44.271593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:44.557104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:44.566850 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fa3e5f3-9dab-4bf0-b861-7ed5a0abdc37 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.318264 Apr 02 21:01:44.567678 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1373/3050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:44 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:44.886103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:44.886952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:44.893756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:44.894507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:44.895450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:44.896049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.134016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:45.139197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:45.139825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:45.143349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8239b5fb-8037-4f94-99cf-7db3db8ee713 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1521 microversion: 2.1 time: 0.260701 Apr 02 21:01:45.143609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1678/3051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:44 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:45.162885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:45.163501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:45.167420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.167876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.168689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.169135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.177374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.177859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.178615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.179051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.367723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:45.375316 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92394412-135f-48b8-b29d-9f1a1d4769f6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1521 microversion: 2.1 time: 0.216154 Apr 02 21:01:45.376432 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1679/3052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:45 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:45.381395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:45.382199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:45.388682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.389352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.390147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.390601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.487430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:45.495135 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-789d1243-7dac-4f09-ba4b-8bd8de125807 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1494 microversion: 2.1 time: 0.367246 Apr 02 21:01:45.496232 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1374/3053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:45 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1494 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:45.500834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:45.501629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:45.512251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.512725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.513662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.514250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.566379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:45.575149 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-308b260d-f120-45d7-addf-4979c73d589f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.197515 Apr 02 21:01:45.576116 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1680/3054] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:45 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:45.584618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1886145119"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:45.586180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:45.596401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.597413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.598922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.599870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.629967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:45.654832 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb84152e-9639-43c3-9052-d7ae3c00828e tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.157372 Apr 02 21:01:45.656887 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1375/3055] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:45 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:45.666172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:45.667327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:45.680878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.681309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.682127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.682576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.934694 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e213d2b-9a3f-46fb-a0cc-6f5d91fe141a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156/action" status: 202 len: 0 microversion: 2.1 time: 0.357076 Apr 02 21:01:45.935616 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1681/3056] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:45 2022] POST /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:01:45.951247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ffc068e0-2fb5-4198-a9be-c4c575650949 req-a600fe4e-f242-424f-a4da-eb3f46021fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06c68f0-17c8-4c02-9391-5bb99ff207f5", "tag": "7314cd1f-0e61-41b2-8632-1f4218505681"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:45.960226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ffc068e0-2fb5-4198-a9be-c4c575650949 req-a600fe4e-f242-424f-a4da-eb3f46021fc1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:45.960781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ffc068e0-2fb5-4198-a9be-c4c575650949 req-a600fe4e-f242-424f-a4da-eb3f46021fc1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:45.981438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ffc068e0-2fb5-4198-a9be-c4c575650949 req-a600fe4e-f242-424f-a4da-eb3f46021fc1 service nova] Creating event network-changed:7314cd1f-0e61-41b2-8632-1f4218505681 for instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 on nch2-master-1 Apr 02 21:01:45.986733 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ffc068e0-2fb5-4198-a9be-c4c575650949 req-a600fe4e-f242-424f-a4da-eb3f46021fc1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039521 Apr 02 21:01:45.987866 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1682/3057] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:45.993456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-91b4f565-0b2e-473d-9ad4-f7a5a350758b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '.version_select at 0x7f54c7e17940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:46.068868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:46.087362 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc7e3f2a-47fc-4e7b-ad58-198da0793f3e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.429205 Apr 02 21:01:46.097654 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1376/3058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:45 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:46.148393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-91b4f565-0b2e-473d-9ad4-f7a5a350758b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/images/7186e05b-c1fc-40c9-9f9a-b97049f34b0e" status: 204 len: 0 microversion: 2.1 time: 0.158869 Apr 02 21:01:46.149168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1683/3059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:45 2022] DELETE /compute/v2.1/images/7186e05b-c1fc-40c9-9f9a-b97049f34b0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:46.158272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17609e19-989f-4e62-b9a0-22dc8f416608 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '.version_select at 0x7f54d407f9d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:46.180741 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-17609e19-989f-4e62-b9a0-22dc8f416608 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Image not found. Apr 02 21:01:46.181556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17609e19-989f-4e62-b9a0-22dc8f416608 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:46.182818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17609e19-989f-4e62-b9a0-22dc8f416608 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/images/7186e05b-c1fc-40c9-9f9a-b97049f34b0e" status: 404 len: 62 microversion: 2.1 time: 0.029599 Apr 02 21:01:46.184200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1377/3060] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:46 2022] GET /compute/v2.1/images/7186e05b-c1fc-40c9-9f9a-b97049f34b0e => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 21:01:46.193979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:46.195301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:46.201683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.202224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.203177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.204362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.362455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:46.370657 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba5849a1-d548-4bba-ab0a-367da065e667 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1533 microversion: 2.1 time: 0.182029 Apr 02 21:01:46.372013 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1684/3061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:46 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1533 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:46.513062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:46.514659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:46.521954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.522416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.523251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.523696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.594115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:46.594736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:46.599527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:46.601627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.602335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.603904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.604388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.607640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5e6e119-70c7-44d1-bf1a-676d73de2892 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 200 len: 1452 microversion: 2.1 time: 0.098894 Apr 02 21:01:46.608760 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1378/3062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:46 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:46.675357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:46.676132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:46.683049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.683593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.684540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:46.685053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:46.756967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:46.764682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afefaead-4c30-4960-b3bc-48fcf37a7ff5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.174483 Apr 02 21:01:46.765260 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1685/3063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:46 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:46.795052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:46.811259 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a731fdd-a1a1-40ce-82c6-75b72f8de6fd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.139694 Apr 02 21:01:46.811929 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1379/3064] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:46 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:47.104440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:47.105697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:47.113385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.113829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.114818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.115625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.252318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:47.259642 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c9aed5d-9e7f-41b5-a856-947dcd427b5f tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.159161 Apr 02 21:01:47.260210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1686/3065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:47 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:47.388829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:47.389448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:47.395725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.396180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.396970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.397414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.545573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:47.555488 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad657363-214a-4577-9447-8b66ba344372 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1539 microversion: 2.1 time: 0.170414 Apr 02 21:01:47.556022 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1380/3066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:47 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1539 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:47.624546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:47.625162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:47.630910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.631367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.632129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.632601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.647033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 9962e223-2c12-4549-830d-3602ca472347 could not be found. Apr 02 21:01:47.647965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 9962e223-2c12-4549-830d-3602ca472347 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:47.649011 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb86518d-cbb5-463e-bc46-341ee5a1b6c5 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 404 len: 111 microversion: 2.1 time: 0.028227 Apr 02 21:01:47.649576 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1687/3067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:47 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:01:47.750388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1325573907", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:47.783700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:47.783700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:47.787594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.788054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.788848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.789285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.808268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:47.921375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:47.929740 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f8f3a3b-7640-4dab-8def-80aec3f9fe10 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.152223 Apr 02 21:01:47.930388 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1688/3068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:47 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:47.934810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f049e8e-c856-4b5b-9b8d-478e904d5019 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e2e940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:47.974954 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f049e8e-c856-4b5b-9b8d-478e904d5019 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/d96dddb2-c538-4a44-bf6f-192947a316a8" status: 200 len: 662 microversion: 2.1 time: 0.043453 Apr 02 21:01:47.975531 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1689/3069] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:47 2022] GET /compute/v2.1/images/d96dddb2-c538-4a44-bf6f-192947a316a8 => generated 662 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:47.980347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:47.981006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:47.987449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.987931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:47.988745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:47.989186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.064317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:48.081681 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-754368a0-0fe2-41d0-a556-78489bfe37ee tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.105148 Apr 02 21:01:48.082257 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1690/3070] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:47 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:48.086614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be6c2332-94fd-454a-bf72-db78016f269a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e48550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:48.127638 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be6c2332-94fd-454a-bf72-db78016f269a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/d96dddb2-c538-4a44-bf6f-192947a316a8" status: 200 len: 662 microversion: 2.1 time: 0.044342 Apr 02 21:01:48.134661 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1691/3071] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:48 2022] GET /compute/v2.1/images/d96dddb2-c538-4a44-bf6f-192947a316a8 => generated 662 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:48.141175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-fe804370-90bf-4a55-88e0-b1ddbd505321 req-bb22666e-582d-4613-83f6-adc9d1ee4592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9962e223-2c12-4549-830d-3602ca472347", "name": "network-vif-deleted", "tag": "596cda8a-b6fa-4ada-99bd-6436067f8c77"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:48.149322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fe804370-90bf-4a55-88e0-b1ddbd505321 req-bb22666e-582d-4613-83f6-adc9d1ee4592 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.149768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fe804370-90bf-4a55-88e0-b1ddbd505321 req-bb22666e-582d-4613-83f6-adc9d1ee4592 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.163530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:48.163727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-fe804370-90bf-4a55-88e0-b1ddbd505321 req-bb22666e-582d-4613-83f6-adc9d1ee4592 service nova] Creating event network-vif-deleted:596cda8a-b6fa-4ada-99bd-6436067f8c77 for instance 9962e223-2c12-4549-830d-3602ca472347 on nch2-master-1 Apr 02 21:01:48.164019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:48.164925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:48.165291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:48.165693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:48.169193 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-fe804370-90bf-4a55-88e0-b1ddbd505321 req-bb22666e-582d-4613-83f6-adc9d1ee4592 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039350 Apr 02 21:01:48.173147 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1692/3072] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:48.177261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.178556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.179363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.179803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.196767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:48.201911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:48.214326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:48.216571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:48.260756 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-078fb241-dee4-4b7e-98cc-cdcbe33be112 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514181 Apr 02 21:01:48.261438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1381/3073] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:48.272426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da1ae8c5-b2ce-4dcd-bbfd-e7b83c556e68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:48.273145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da1ae8c5-b2ce-4dcd-bbfd-e7b83c556e68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:48.276648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:48.277314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:48.284657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.284741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.285585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.286036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.327378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-da1ae8c5-b2ce-4dcd-bbfd-e7b83c556e68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:48.335352 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da1ae8c5-b2ce-4dcd-bbfd-e7b83c556e68 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1215 microversion: 2.1 time: 0.067576 Apr 02 21:01:48.336253 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1693/3074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:48 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:48.428276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:48.435640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c2123c05-ced1-4db1-9b77-9c84cd65374a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.163296 Apr 02 21:01:48.436196 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1382/3075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:48 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:48.574318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:48.575050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:48.582230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.582670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.583488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.583950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.718858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:48.726295 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3098747a-6b55-4af5-a525-c8e59c1e3d2f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1539 microversion: 2.1 time: 0.157290 Apr 02 21:01:48.726866 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1694/3076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:48 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1539 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:48.946531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:48.947174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:48.954000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.954453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:48.955222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:48.955662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.089417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:49.097414 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e69a8178-ca69-438a-b127-b97e1ed53b06 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.154950 Apr 02 21:01:49.098144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1383/3077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:48 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:49.101779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.102399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:49.108700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.109160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.110640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.111107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.181977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:49.199398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d503f3a0-8a65-4451-a1a6-7f33f3e3702d tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.101859 Apr 02 21:01:49.200443 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1695/3078] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:49 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:49.352807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.353427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:49.359741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.360300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.361624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.362008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.430916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:49.439039 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e3d3da4f-d240-46b3-9727-b4e6802a35cc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1285 microversion: 2.1 time: 0.090065 Apr 02 21:01:49.440164 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1384/3079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:49 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:49.454167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.454881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:49.461789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.462256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.463038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.463895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.508790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2135b52e-fa2b-4fd0-8837-aa387b2d3aeb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d409d0d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.558631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2135b52e-fa2b-4fd0-8837-aa387b2d3aeb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/e06a8a05-cb7b-4012-92d1-4c0db8e95841" status: 200 len: 661 microversion: 2.1 time: 0.053755 Apr 02 21:01:49.570807 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1385/3080] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:49 2022] GET /compute/v2.1/images/e06a8a05-cb7b-4012-92d1-4c0db8e95841 => generated 661 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:49.576275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13c4a76b-fe4d-48a2-a388-b6d409a477d9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7fed160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.614966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:49.619134 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13c4a76b-fe4d-48a2-a388-b6d409a477d9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/e06a8a05-cb7b-4012-92d1-4c0db8e95841" status: 200 len: 661 microversion: 2.1 time: 0.047024 Apr 02 21:01:49.622802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05611100-b05b-4fd3-aaba-8982c5636c97 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.173393 Apr 02 21:01:49.623372 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1696/3081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:49 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:49.624890 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1386/3082] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:49 2022] GET /compute/v2.1/images/e06a8a05-cb7b-4012-92d1-4c0db8e95841 => generated 661 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:49.743120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.743742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:49.749742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.750246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.751204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.751655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.885953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:49.896772 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4596bd58-6447-4021-ae75-cd19425bbf33 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1521 microversion: 2.1 time: 0.157394 Apr 02 21:01:49.897359 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1697/3083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:49 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:49.912918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:49.913418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:49.920119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.920610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.921397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:49.921839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:49.949473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:01:50.036009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-03dbb5ad-d8a8-4b53-9ad3-958261ffd9ef tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 204 len: 0 microversion: 2.1 time: 0.126812 Apr 02 21:01:50.037021 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1387/3084] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:01:49 2022] DELETE /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:01:50.045652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:50.046919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:50.053843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.054287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.055088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.055533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.118378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:50.119441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:50.128569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.129414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.130639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.131100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.209074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:50.227271 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6eea8099-2e40-4bb5-99d4-61673381c215 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1527 microversion: 2.1 time: 0.185832 Apr 02 21:01:50.228068 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1698/3085] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:50 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1527 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:50.237976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:50.238857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:50.245065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.245641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.246881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.247433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.335174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:50.352897 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc094f31-54f7-4cb6-9b91-4e4651c07f83 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.123423 Apr 02 21:01:50.353493 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1699/3086] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:50 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:50.409480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:50.417461 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-287c6edf-6da1-4249-9568-73a8f0d69f8e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.306155 Apr 02 21:01:50.418364 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1388/3087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:50 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:50.457396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:50.458215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:50.465246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.465954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.466746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.467196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.615549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:50.623925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f2aeda76-a216-4930-b5ec-0dac47af8618 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1315 microversion: 2.1 time: 0.171177 Apr 02 21:01:50.635531 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1700/3088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:50 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:50.640348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:50.642123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:50.649331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.649906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.650865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.651474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.865355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-359378ba-5cae-4bc1-b959-3ba954a8b386 req-7c521d7f-1181-4cee-a7fc-af48f0639929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549c4297-08a2-4e85-8c9f-e1b9c081b452", "tag": "5de1a212-3d81-4136-b0b8-531ca93bc340"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:50.879502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-359378ba-5cae-4bc1-b959-3ba954a8b386 req-7c521d7f-1181-4cee-a7fc-af48f0639929 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:50.879987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-359378ba-5cae-4bc1-b959-3ba954a8b386 req-7c521d7f-1181-4cee-a7fc-af48f0639929 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:50.895341 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-359378ba-5cae-4bc1-b959-3ba954a8b386 req-7c521d7f-1181-4cee-a7fc-af48f0639929 service nova] Creating event network-changed:5de1a212-3d81-4136-b0b8-531ca93bc340 for instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 on nch2-master-1 Apr 02 21:01:50.901049 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-359378ba-5cae-4bc1-b959-3ba954a8b386 req-7c521d7f-1181-4cee-a7fc-af48f0639929 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040847 Apr 02 21:01:50.902441 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1701/3089] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:50.938601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ab4a345-f7cb-4b6f-b611-a50f58bd1a9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7dfa1f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:50.946842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:50.957022 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-30daf190-93af-482f-a727-28437a27bddf tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.321168 Apr 02 21:01:50.957611 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1389/3090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:50 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:50.995705 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ab4a345-f7cb-4b6f-b611-a50f58bd1a9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/0ccd78fb-63d8-4efe-94a4-c138d12e835e" status: 200 len: 661 microversion: 2.1 time: 0.061646 Apr 02 21:01:50.996289 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1702/3091] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:50 2022] GET /compute/v2.1/images/0ccd78fb-63d8-4efe-94a4-c138d12e835e => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:01:51.008304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8974de1a-7ad9-4b0e-b337-27bd26df6ff4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d42760d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:51.049053 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8974de1a-7ad9-4b0e-b337-27bd26df6ff4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/0ccd78fb-63d8-4efe-94a4-c138d12e835e" status: 200 len: 661 microversion: 2.1 time: 0.044487 Apr 02 21:01:51.049635 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1390/3092] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:01:51 2022] GET /compute/v2.1/images/0ccd78fb-63d8-4efe-94a4-c138d12e835e => generated 661 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:51.100111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1091331014", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:51.150403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:51.245196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:51.246092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:51.252679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.253205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.253990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.254436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.355940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:51.356379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:51.357034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:51.357454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:51.357883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:51.367490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.368195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.369043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.369492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.388241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Getting quotas for project 434a8950c15b4a96a46ed0f64c87c417. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:51.394322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Getting quotas for user 4e687099ccfe4d6fbeca88231424699a and project 434a8950c15b4a96a46ed0f64c87c417. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:51.407197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:51.409642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:51.454153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b736667b-f94c-4de8-b5cc-bc51a9c9fdec tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.357808 Apr 02 21:01:51.455078 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1703/3093] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:51.475968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:51.476193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:51.476983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:51.485948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.486567 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-92c60f70-0aef-4cc4-8d6e-2bcb7da012e2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1527 microversion: 2.1 time: 0.245208 Apr 02 21:01:51.486700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.487364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.492776 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1391/3094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:51 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1527 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:51.493098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.493193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:51.493412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:51.519920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.520717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.521865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.522325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.571214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:51.593168 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-931885aa-8e1b-4c0a-8a03-183bf1717309 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.136680 Apr 02 21:01:51.593781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1704/3095] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:51 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:51.599930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1901335961", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:51.666651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:51.887275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:51.888606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:51.889154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:51.889629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:51.890232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:51.914396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.914849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.921835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:51.922915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:51.944890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Getting quotas for project 434a8950c15b4a96a46ed0f64c87c417. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:51.950529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Getting quotas for user 4e687099ccfe4d6fbeca88231424699a and project 434a8950c15b4a96a46ed0f64c87c417. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:51.963350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:51.965768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:52.022210 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5fa51c15-c070-472c-b9ae-38107ed88120 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.427048 Apr 02 21:01:52.028088 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1705/3096] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:52.035470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:52.036790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:52.044500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.045172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.046129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.046712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.173529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:52.193614 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb3d292e-3c46-421d-a21c-3d2e09341cd5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.704734 Apr 02 21:01:52.194973 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1392/3097] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:51 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:52.208592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:52.215249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:52.225880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.236999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.238586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.239052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.313034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:52.340001 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f86853ae-2cba-4277-b596-cc54a57a4bf4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1315 microversion: 2.1 time: 0.306122 Apr 02 21:01:52.340670 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1706/3098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:52 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:52.361016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4869ba3-96d3-407d-80f3-bf667b0be297 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:52.361883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f4869ba3-96d3-407d-80f3-bf667b0be297 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:52.427926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f4869ba3-96d3-407d-80f3-bf667b0be297 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:52.439304 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4869ba3-96d3-407d-80f3-bf667b0be297 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1218 microversion: 2.1 time: 0.083235 Apr 02 21:01:52.440413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1707/3099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:52 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:52.455008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-04c2356e-87c4-40de-b70c-ba84e48f8267 req-fc962af9-d928-484c-9af5-40aca915e60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06c68f0-17c8-4c02-9391-5bb99ff207f5", "name": "network-vif-plugged", "status": "completed", "tag": "7314cd1f-0e61-41b2-8632-1f4218505681"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:52.475571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-04c2356e-87c4-40de-b70c-ba84e48f8267 req-fc962af9-d928-484c-9af5-40aca915e60a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.476359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-04c2356e-87c4-40de-b70c-ba84e48f8267 req-fc962af9-d928-484c-9af5-40aca915e60a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.493808 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-04c2356e-87c4-40de-b70c-ba84e48f8267 req-fc962af9-d928-484c-9af5-40aca915e60a service nova] Creating event network-vif-plugged:7314cd1f-0e61-41b2-8632-1f4218505681 for instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 on nch2-master-1 Apr 02 21:01:52.499433 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-04c2356e-87c4-40de-b70c-ba84e48f8267 req-fc962af9-d928-484c-9af5-40aca915e60a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057570 Apr 02 21:01:52.500039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1708/3100] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:52.507246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:52.509007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:52.527310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.528762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.530250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.530893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.662570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:52.677723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc543a31-c163-4f63-bff2-1a58fbe44c61 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.479984 Apr 02 21:01:52.678321 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1393/3101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:52 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:52.682949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:52.693491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:52.699705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.700374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.701194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.701644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.702800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:52.713343 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-532a1ed1-e8f8-4bc9-b31f-77c5bd12ebe1 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 200 len: 1527 microversion: 2.1 time: 0.210795 Apr 02 21:01:52.735438 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1709/3102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:52 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 1527 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:52.829921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:52.868709 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6791c5aa-1254-4367-b454-a453316de056 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.189115 Apr 02 21:01:52.869992 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1394/3103] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:52 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:52.955752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1218ea7c-a2a0-4c04-aa62-3f373f61d22d req-d3f811f5-2e9b-470a-b17c-51594ed03cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d1423d-d3ce-4abb-8754-c597a900f156", "name": "network-vif-deleted", "tag": "bce4bd35-6728-4999-b4a7-5345c52c70e7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:52.965080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1218ea7c-a2a0-4c04-aa62-3f373f61d22d req-d3f811f5-2e9b-470a-b17c-51594ed03cb4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:52.965521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1218ea7c-a2a0-4c04-aa62-3f373f61d22d req-d3f811f5-2e9b-470a-b17c-51594ed03cb4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:52.978113 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1218ea7c-a2a0-4c04-aa62-3f373f61d22d req-d3f811f5-2e9b-470a-b17c-51594ed03cb4 service nova] Creating event network-vif-deleted:bce4bd35-6728-4999-b4a7-5345c52c70e7 for instance e2d1423d-d3ce-4abb-8754-c597a900f156 on nch2-master-1 Apr 02 21:01:52.983134 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1218ea7c-a2a0-4c04-aa62-3f373f61d22d req-d3f811f5-2e9b-470a-b17c-51594ed03cb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032379 Apr 02 21:01:52.984135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1710/3104] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:53.212150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:53.212849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:53.220689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.221144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.221918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.222358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.360561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:53.361291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:53.366020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:53.370766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.371222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.372063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.372648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.377664 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-038872c4-5a2a-42b2-b6a9-0d81b1e1ca88 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.168853 Apr 02 21:01:53.379029 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1395/3105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:53 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:53.459645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:53.460589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:53.468546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.469061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.470151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.471356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.566136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:53.577761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0821219-72ec-4662-a7c8-a15e3b94df44 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1278 microversion: 2.1 time: 0.124351 Apr 02 21:01:53.579584 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1396/3106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:53 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:53.645066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:53.655974 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-985d170b-d393-4f06-9bbb-9500dd813ab6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1315 microversion: 2.1 time: 0.300922 Apr 02 21:01:53.657472 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1711/3107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:53 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:53.700433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:53.701364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:53.713338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.713945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.714874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.715316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.731652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:53.732309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:53.745192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.745984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.746810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.747265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.777778 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance e2d1423d-d3ce-4abb-8754-c597a900f156 could not be found. Apr 02 21:01:53.778709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance e2d1423d-d3ce-4abb-8754-c597a900f156 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:53.779499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-debe831c-5012-469a-ad9c-842e76e2b4ea tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 404 len: 111 microversion: 2.1 time: 0.051973 Apr 02 21:01:53.780072 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1712/3108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:53 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:01:53.895752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:53.897143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:53.908482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.918719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:53.921061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:53.921520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.037544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:54.049701 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-586b4c48-852e-4475-a0fe-727bad0c78a7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1316 microversion: 2.1 time: 0.354382 Apr 02 21:01:54.050816 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1397/3109] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:53 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:54.064468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1013779750", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:54.083211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:54.125714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e87b2b9-50f9-4d40-8eca-959ed794bf99 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.237293 Apr 02 21:01:54.130150 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1713/3110] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:53 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:54.165490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] validate_networks() for [('2127fd39-f5aa-452a-9beb-bdc4f201d2d4', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:01:54.395662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:54.396382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:54.403054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.403593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.404531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.405043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.551826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:54.560580 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bae643d1-9a33-4e35-b357-75e2ed7dc55e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.168710 Apr 02 21:01:54.561742 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1714/3111] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:54 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:54.597290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:54.598638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:54.607215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.608283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.609333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.610020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.759126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:01:54.759634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:01:54.760008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:01:54.762713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:01:54.763171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:01:54.776056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.776762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.777886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.778192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.800246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for project 46605b214f8144ebbbd2aab432bb7633. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:01:54.806532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Getting quotas for user de9e0b13df3b487cb16732fcf86746b3 and project 46605b214f8144ebbbd2aab432bb7633. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:01:54.825743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:01:54.831182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:01:54.885541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:54.894434 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fef6fa57-896b-47f4-91fc-c66789842771 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.302471 Apr 02 21:01:54.899867 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1715/3112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:54 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:54.912026 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09b966ca-dc95-421a-bb10-9a9db68a4899 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.859308 Apr 02 21:01:54.912609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:54.912728 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1398/3113] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:01:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:01:54.913413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:54.922988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6eaf185-d17d-432d-8ca8-71dc285460a8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:54.923608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6eaf185-d17d-432d-8ca8-71dc285460a8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:54.925436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.926130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:54.926895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:54.927502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.064721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6eaf185-d17d-432d-8ca8-71dc285460a8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:55.073705 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6eaf185-d17d-432d-8ca8-71dc285460a8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1225 microversion: 2.1 time: 0.154515 Apr 02 21:01:55.086891 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1399/3114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:54 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1225 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:55.094282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:55.095204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:55.107382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.108305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.109776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.110378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.412863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:55.426257 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-63288ac1-895a-473d-adce-250914278f2e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1504 microversion: 2.1 time: 0.337247 Apr 02 21:01:55.434594 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1400/3115] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:55 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:55.466580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:55.468157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:55.480340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.481898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.483294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.485790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.629499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:55.678810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-048b69fe-667e-472c-833f-9b1b672d2bdd tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.241925 Apr 02 21:01:55.679593 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1401/3116] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:55 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:55.685307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-270351546"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:55.686153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:55.697949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.698570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.699523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.700092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.742543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:55.750249 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10c6e55b-61c4-4233-9866-b1af154fb851 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1315 microversion: 2.1 time: 0.849163 Apr 02 21:01:55.751361 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1716/3117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:54 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:55.764371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:55.765225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:55.774561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.775024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:55.775825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:55.776273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.070034 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.network.security_group_api [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Adding security group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b to port 7314cd1f-0e61-41b2-8632-1f4218505681 Apr 02 21:01:56.161326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:56.175339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09502183-491e-4983-b38e-4111db3c74d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.422546 Apr 02 21:01:56.189585 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1717/3118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:55 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:56.373229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-96480dec-50f7-4334-9dde-eab954ea7fcd req-f76dd24f-3c72-41a8-91d4-b117ed00cc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec52e0fc-98cb-4059-b291-a5a9e5987b70", "tag": "6899260a-714f-44f5-b030-a483cf54a670"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:56.385542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96480dec-50f7-4334-9dde-eab954ea7fcd req-f76dd24f-3c72-41a8-91d4-b117ed00cc0e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.386390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96480dec-50f7-4334-9dde-eab954ea7fcd req-f76dd24f-3c72-41a8-91d4-b117ed00cc0e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.403011 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-96480dec-50f7-4334-9dde-eab954ea7fcd req-f76dd24f-3c72-41a8-91d4-b117ed00cc0e service nova] Creating event network-changed:6899260a-714f-44f5-b030-a483cf54a670 for instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 on nch1-master-1 Apr 02 21:01:56.416836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-96480dec-50f7-4334-9dde-eab954ea7fcd req-f76dd24f-3c72-41a8-91d4-b117ed00cc0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222561 Apr 02 21:01:56.419392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1718/3119] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:56.426954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9cbbab04-6308-407d-b9ff-afffc974cb25 req-d60c30a8-b11d-47a6-8435-683996d1759a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:56.440036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9cbbab04-6308-407d-b9ff-afffc974cb25 req-d60c30a8-b11d-47a6-8435-683996d1759a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.440923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9cbbab04-6308-407d-b9ff-afffc974cb25 req-d60c30a8-b11d-47a6-8435-683996d1759a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.472316 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9cbbab04-6308-407d-b9ff-afffc974cb25 req-d60c30a8-b11d-47a6-8435-683996d1759a service nova] Creating event network-changed:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:01:56.479559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9cbbab04-6308-407d-b9ff-afffc974cb25 req-d60c30a8-b11d-47a6-8435-683996d1759a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058059 Apr 02 21:01:56.481253 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1719/3120] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:56.486892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:56.487913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:56.499390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.500765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.501791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.502470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.706448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:56.715018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c91a4a55-72bc-4cae-aaba-7a80c904762d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.232300 Apr 02 21:01:56.715613 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1720/3121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:56 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:56.721993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:56.722862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:56.729757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.730507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.731472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.732083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.833669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:56.842531 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-643f2192-8044-4721-b27b-ac6e8dbc11d8 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1283 microversion: 2.1 time: 0.125457 Apr 02 21:01:56.843122 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1721/3122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:56 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1283 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:56.848145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4c6accb9-e19a-4035-97eb-552365382bad req-cb558116-3e07-43d8-b9ad-8f9461f348b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549c4297-08a2-4e85-8c9f-e1b9c081b452", "name": "network-vif-plugged", "status": "completed", "tag": "5de1a212-3d81-4136-b0b8-531ca93bc340"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:56.856801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4c6accb9-e19a-4035-97eb-552365382bad req-cb558116-3e07-43d8-b9ad-8f9461f348b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.857331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4c6accb9-e19a-4035-97eb-552365382bad req-cb558116-3e07-43d8-b9ad-8f9461f348b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.869734 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4c6accb9-e19a-4035-97eb-552365382bad req-cb558116-3e07-43d8-b9ad-8f9461f348b5 service nova] Creating event network-vif-plugged:5de1a212-3d81-4136-b0b8-531ca93bc340 for instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 on nch2-master-1 Apr 02 21:01:56.874579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4c6accb9-e19a-4035-97eb-552365382bad req-cb558116-3e07-43d8-b9ad-8f9461f348b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Apr 02 21:01:56.879080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1722/3123] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:56.884493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:56.885422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:56.893371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.894067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.895036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:56.895629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:56.987426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:57.015162 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26d0eb9e-8ed7-48ec-bc09-104d6762880a tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.134630 Apr 02 21:01:57.016925 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1723/3124] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:56 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:57.021654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:57.022444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:57.028925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.029605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.030555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.031005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.306263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:57.317929 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8fa37390-2b9a-403d-8ac2-6e25b28f6207 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1315 microversion: 2.1 time: 0.299746 Apr 02 21:01:57.318845 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1724/3125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:57 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:57.330351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:57.331272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:57.350780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.352089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.353632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.354668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.387080 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-262855e1-25bd-4bd7-9c0a-587ef31e5bf3 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5/action" status: 202 len: 0 microversion: 2.1 time: 1.705892 Apr 02 21:01:57.388741 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1402/3126] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:55 2022] POST /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5/action => generated 0 bytes in 1708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:57.403543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c27f5bc8-a0ee-490c-b9a1-7c0d86d42d73 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7f9e160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:57.546137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:57.554633 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c837719-adcc-4711-9bac-71e892c07234 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.233513 Apr 02 21:01:57.555525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1725/3127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:57 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:57.733247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:57.733901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:57.740917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.741766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.742623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.743170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.744774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-c27f5bc8-a0ee-490c-b9a1-7c0d86d42d73 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b in use.", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:01:57.745687 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c27f5bc8-a0ee-490c-b9a1-7c0d86d42d73 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security Group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b in use. Apr 02 21:01:57.745687 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-6bcacc05-0f45-4fc8-aa99-1a67f7429b5e'] Apr 02 21:01:57.746554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c27f5bc8-a0ee-490c-b9a1-7c0d86d42d73 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 400 to user: Security Group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b in use. Apr 02 21:01:57.746554 ncdv-master-1 devstack@n-api.service[136517]: Neutron server returns request_ids: ['req-6bcacc05-0f45-4fc8-aa99-1a67f7429b5e'] {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:01:57.747771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c27f5bc8-a0ee-490c-b9a1-7c0d86d42d73 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8c6ecfd9-a637-4585-bc5f-4fca06655b3b" status: 400 len: 185 microversion: 2.1 time: 0.354208 Apr 02 21:01:57.753980 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1403/3128] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:01:57 2022] DELETE /compute/v2.1/os-security-groups/8c6ecfd9-a637-4585-bc5f-4fca06655b3b => generated 185 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:01:57.759339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:57.761732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:57.770717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.771438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.772710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.773357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.870580 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ea14afdd-4a5c-4f95-84ed-cc136e3ff0d2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5/action" status: 202 len: 0 microversion: 2.1 time: 0.115039 Apr 02 21:01:57.874508 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1404/3129] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:57 2022] POST /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:01:57.884874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:57.885518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:57.892872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.893401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.894225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.894665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.930331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:57.944635 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b865380-7fbf-4c40-889c-32304d8a3424 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.216034 Apr 02 21:01:57.946341 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1726/3130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:57 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:57.951153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:57.951754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:57.959103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.959560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.960337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:57.960801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:57.991957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:57.999765 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-69c5d764-1436-4935-8a8d-3ca65a3f3fce tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1283 microversion: 2.1 time: 0.127127 Apr 02 21:01:58.001099 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1405/3131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:57 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1283 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:58.035354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:58.036060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:58.042197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.043245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.044047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.044518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.117503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:58.125532 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1ff89392-e393-4671-87d7-b7c48650d918 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1574 microversion: 2.1 time: 0.177660 Apr 02 21:01:58.126165 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1727/3132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:57 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:58.141996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:58.158853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efae91fa-b6c5-4fcf-89a2-2a7ff1d4f809 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.127440 Apr 02 21:01:58.164087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1406/3133] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:58 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:01:58.335394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:58.336017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:58.341998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.342472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.343254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.343716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.443967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-dd46dae8-3540-4710-b0be-2568ba556702 req-f6e81174-514b-4e6f-9037-ae38dec2e404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06c68f0-17c8-4c02-9391-5bb99ff207f5", "tag": "7314cd1f-0e61-41b2-8632-1f4218505681"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:58.460321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dd46dae8-3540-4710-b0be-2568ba556702 req-f6e81174-514b-4e6f-9037-ae38dec2e404 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.463983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dd46dae8-3540-4710-b0be-2568ba556702 req-f6e81174-514b-4e6f-9037-ae38dec2e404 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.476245 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-dd46dae8-3540-4710-b0be-2568ba556702 req-f6e81174-514b-4e6f-9037-ae38dec2e404 service nova] Creating event network-changed:7314cd1f-0e61-41b2-8632-1f4218505681 for instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 on nch2-master-1 Apr 02 21:01:58.482327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-dd46dae8-3540-4710-b0be-2568ba556702 req-f6e81174-514b-4e6f-9037-ae38dec2e404 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042130 Apr 02 21:01:58.485373 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1407/3134] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:01:58.519694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:58.529188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d50d4784-9f14-45ec-8ab2-70d5a1434234 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1315 microversion: 2.1 time: 0.197772 Apr 02 21:01:58.530016 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1728/3135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:58 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:58.573477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:58.574437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:58.583295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.587121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.587993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.588477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.962130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:58.962822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:58.969566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.970020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:58.970796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:58.971236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.018276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:59.025841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-570739bd-f3e0-4cbe-9c44-44d70bc2e1b2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.457344 Apr 02 21:01:59.026422 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1408/3136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:58 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:59.039623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:59.040595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:59.047089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.047743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.048723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.049340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.131379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:59.139092 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7077d85c-3a56-43cd-9093-01c45627560b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.180799 Apr 02 21:01:59.149199 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1729/3137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:58 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:59.154385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:59.155204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:59.162237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.162699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.163536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.163980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.327812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:59.336608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d303479d-2c86-4de9-95bd-eec6e55b92ea tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1574 microversion: 2.1 time: 0.185901 Apr 02 21:01:59.337213 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1730/3138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:59 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:59.341915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:59.342541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:59.349067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.349540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.350341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.350824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.426613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:01:59.460898 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed406959-52ca-418f-97b1-6d6aded40a6b tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.122461 Apr 02 21:01:59.461589 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1731/3139] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:01:59 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:01:59.546573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:01:59.547265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:59.553802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.554353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.555222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.555731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.688244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:59.696412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:01:59.699091 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d32a9e52-7708-4d7c-a2b9-aee0e5d15aa3 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.671363 Apr 02 21:01:59.699963 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1409/3140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:59 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:01:59.710727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d9852cc8-8765-4416-92b9-8e7cb3c349f2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1503 microversion: 2.1 time: 0.168122 Apr 02 21:01:59.711483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1732/3141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:01:59 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:01:59.727260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:01:59.727815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:01:59.735419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.735878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.736692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:01:59.737132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:01:59.762674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lazy-loading 'flavor' on Instance uuid 549c4297-08a2-4e85-8c9f-e1b9c081b452 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:00.022878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ebae076-6aa3-42da-b3e5-840c1d9366de tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452/action" status: 202 len: 0 microversion: 2.1 time: 0.299646 Apr 02 21:02:00.023607 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1410/3142] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:01:59 2022] POST /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:00.033163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:00.033769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.040283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.040768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.042594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.043339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.045617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:00.046290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.056130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.056376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.057254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.058243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.202869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:00.212125 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4bd07296-f14a-450a-8dd9-010225e56795 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.184078 Apr 02 21:02:00.212994 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1733/3143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:00 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:00.237251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:00.237881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.244002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.244528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.245322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.245773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.391257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:00.398995 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fff4f6eb-4fd8-4b06-ae9a-e7b253ee80bc tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.176802 Apr 02 21:02:00.399618 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1734/3144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:00 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:00.404112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:00.404876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.412187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:00.413085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.413547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.414325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.414771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.419596 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-747f2378-80a6-4065-b386-d2930af6a854 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.379087 Apr 02 21:02:00.420180 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1411/3145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:00 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:00.480988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:00.481702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.488755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.489332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.490198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.490746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.565387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:00.573611 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00694310-8943-4440-83ca-6cd10b8d3c21 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1572 microversion: 2.1 time: 0.172984 Apr 02 21:02:00.574228 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1735/3146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:00 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:00.579330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2954f547-a82f-4bab-892c-a78e6040dd4c req-34491305-a6f8-4187-afe2-5de3a271eb42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5bfc3a-a0c8-43df-b545-28d13b55296b", "tag": "ea75b601-e0d3-4e9e-b79c-a92bba35bfb0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:00.587500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2954f547-a82f-4bab-892c-a78e6040dd4c req-34491305-a6f8-4187-afe2-5de3a271eb42 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.587958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2954f547-a82f-4bab-892c-a78e6040dd4c req-34491305-a6f8-4187-afe2-5de3a271eb42 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.590018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:00.600886 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2954f547-a82f-4bab-892c-a78e6040dd4c req-34491305-a6f8-4187-afe2-5de3a271eb42 service nova] Creating event network-changed:ea75b601-e0d3-4e9e-b79c-a92bba35bfb0 for instance 2d5bfc3a-a0c8-43df-b545-28d13b55296b on nch2-master-1 Apr 02 21:02:00.605460 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2954f547-a82f-4bab-892c-a78e6040dd4c req-34491305-a6f8-4187-afe2-5de3a271eb42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029817 Apr 02 21:02:00.606174 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1736/3147] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:00.609447 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1fe1cd0-7eed-4275-8e04-ccd8d2d18c8f tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.132145 Apr 02 21:02:00.616381 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1412/3148] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:00 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:02:00.616554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1001253703"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:00.616554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.618114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.618986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.619359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.619806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.716485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:00.717162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:00.723611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.724247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.725073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:00.725523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:00.759294 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.network.security_group_api [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Adding security group a70f57f3-c644-44f0-816b-65c3c747ec1a to port 7314cd1f-0e61-41b2-8632-1f4218505681 Apr 02 21:02:00.964665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:00.978122 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60a64a1b-e929-4fc4-ae6d-f6789f1368e6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.264702 Apr 02 21:02:00.979221 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1413/3149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:00 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:01.181481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cbe1d5dd-bdc5-4fef-9498-9778a864acbd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5/action" status: 202 len: 0 microversion: 2.1 time: 0.574116 Apr 02 21:02:01.183544 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1737/3150] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:00 2022] POST /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:01.192088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-441869cf-b1eb-476d-aede-df3809af3909 req-86cbd9c5-5b01-4ca7-b92b-f6c097ef8433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c06c68f0-17c8-4c02-9391-5bb99ff207f5", "tag": "7314cd1f-0e61-41b2-8632-1f4218505681"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:01.195224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ae12246-b0cc-4b48-8211-9740e62a5b9c tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7db8040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.204811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-441869cf-b1eb-476d-aede-df3809af3909 req-86cbd9c5-5b01-4ca7-b92b-f6c097ef8433 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.205270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-441869cf-b1eb-476d-aede-df3809af3909 req-86cbd9c5-5b01-4ca7-b92b-f6c097ef8433 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.225196 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-441869cf-b1eb-476d-aede-df3809af3909 req-86cbd9c5-5b01-4ca7-b92b-f6c097ef8433 service nova] Creating event network-changed:7314cd1f-0e61-41b2-8632-1f4218505681 for instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 on nch2-master-1 Apr 02 21:02:01.236328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-441869cf-b1eb-476d-aede-df3809af3909 req-86cbd9c5-5b01-4ca7-b92b-f6c097ef8433 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046525 Apr 02 21:02:01.239485 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1414/3151] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:01.254510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.257138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:01.269499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.270432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.272058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.273022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.350768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-4ae12246-b0cc-4b48-8211-9740e62a5b9c tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a70f57f3-c644-44f0-816b-65c3c747ec1a in use.", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:01.351467 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4ae12246-b0cc-4b48-8211-9740e62a5b9c tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security Group a70f57f3-c644-44f0-816b-65c3c747ec1a in use. Apr 02 21:02:01.351467 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-5d7d09fe-ae7f-48c8-8e2e-5e0bbd47f029'] Apr 02 21:02:01.352074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ae12246-b0cc-4b48-8211-9740e62a5b9c tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 400 to user: Security Group a70f57f3-c644-44f0-816b-65c3c747ec1a in use. Apr 02 21:02:01.352074 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-5d7d09fe-ae7f-48c8-8e2e-5e0bbd47f029'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:01.352966 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ae12246-b0cc-4b48-8211-9740e62a5b9c tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a70f57f3-c644-44f0-816b-65c3c747ec1a" status: 400 len: 185 microversion: 2.1 time: 0.165360 Apr 02 21:02:01.353845 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1738/3152] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:01 2022] DELETE /compute/v2.1/os-security-groups/a70f57f3-c644-44f0-816b-65c3c747ec1a => generated 185 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:02:01.364522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.365344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:01.373453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.373920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.375705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.376158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.406870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:01.499487 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68ebc802-52dd-40be-9952-ec5ca8c887b7 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 204 len: 0 microversion: 2.1 time: 0.140756 Apr 02 21:02:01.501124 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1739/3153] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:01 2022] DELETE /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:02:01.507235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.508004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:01.514615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.515282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.516187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.516848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.631434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:01.639011 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-548340c9-a253-40a9-a48e-9fedcac38a26 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.397768 Apr 02 21:02:01.639817 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1415/3154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:01 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:01.646549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.649187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:01.657223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.657784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.659235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.659781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.698479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:01.706490 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b588254-3932-43e1-909e-d2fca128a6f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.204035 Apr 02 21:02:01.707084 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1740/3155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:01 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:01.718545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.720252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:01.729421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.730279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.731237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.731979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.909832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:01.913264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:01.921417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4978ebf5-e3a1-4360-982d-30b0720287f6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1677 microversion: 2.1 time: 0.279775 Apr 02 21:02:01.923189 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-824504ec-5771-4099-a18b-bd1810b65509 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1647 microversion: 2.1 time: 0.210479 Apr 02 21:02:01.924349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1741/3156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:01 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1647 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:01.933151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1416/3157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:01 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1677 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:01.935975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.936767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:01.943647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.944110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.945372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:01.945910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:01.997804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:01.998690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:02.010727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.012070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.013438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.014558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.025923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:02.045429 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-259fc53b-b788-49cc-b986-fce75c828095 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1927 microversion: 2.75 time: 0.119846 Apr 02 21:02:02.046266 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1742/3158] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:01 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1927 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:02.181000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:02.188562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fde58615-7d45-4eb1-beb1-8c06f87048eb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.196923 Apr 02 21:02:02.189253 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1417/3159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:01 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:02.656685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:02.657308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:02.664030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.664528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.665308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.665776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.723368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:02.723990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:02.730423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.730877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.731679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.732120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.814020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:02.821824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07992015-2ffb-4cee-bc26-166583da42e7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.169108 Apr 02 21:02:02.822405 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1743/3160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:02 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:02.878991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:02.886400 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1be0dcef-e7a4-44f5-a2f8-91c3f6d5a189 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.167109 Apr 02 21:02:02.886982 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1418/3161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:02 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:02.939827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:02.940447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:02.940601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:02.941207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:02.946754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.947219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.947996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.948105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.948479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.948593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:02.949357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:02.949820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.089579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:03.097693 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-433f75ad-3281-4220-afbf-703fc8f80c0a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1654 microversion: 2.1 time: 0.162388 Apr 02 21:02:03.098539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1744/3162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:02 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:03.102786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:03.103429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:03.110278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.110749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.111534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.111988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.152017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:03.162493 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-75fa9864-04f9-4707-8474-f9039493e655 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1647 microversion: 2.1 time: 0.225904 Apr 02 21:02:03.164176 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1419/3163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:02 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1647 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:03.169350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a91309de-736b-41a7-be9b-c757be857af1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:03.178670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a91309de-736b-41a7-be9b-c757be857af1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.179380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a91309de-736b-41a7-be9b-c757be857af1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.184424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:03.203587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a91309de-736b-41a7-be9b-c757be857af1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Going to try to start instance {{(pid=136517) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:02:03.203926 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5dc93afe-b57a-4536-8394-3eaa404af220 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1933 microversion: 2.75 time: 0.104425 Apr 02 21:02:03.210670 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1745/3164] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:03 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1933 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:03.210670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:03.210670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:03.216610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.217138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.217984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.218497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.251453 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a91309de-736b-41a7-be9b-c757be857af1 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action" status: 202 len: 0 microversion: 2.1 time: 0.085850 Apr 02 21:02:03.252100 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1420/3165] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:03 2022] POST /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:03.260317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:03.261138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:03.267447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.267997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.269057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.269664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.373765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:03.381178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76fd84a1-2a68-44a1-b039-106d9dc1a917 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.175504 Apr 02 21:02:03.381766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1746/3166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:03 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:03.621974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:03.629373 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c08d75a3-e272-49b5-8784-883d5d148eb2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1663 microversion: 2.1 time: 0.373096 Apr 02 21:02:03.630165 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1421/3167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:03 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1663 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:03.839482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:03.840144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:03.847463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.847920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.848720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.849157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.905190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:03.906241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:03.916934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.917698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:03.918953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:03.920059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.049385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:04.057186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f1bd063-a129-466d-b6f5-627ec65128e1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.221968 Apr 02 21:02:04.058266 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1747/3168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:03 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:04.063413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7f7be2ee-c780-4cd9-bf17-91d297895f90 req-5c1b4a05-e39d-4694-8e5e-2379317fc447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c06c68f0-17c8-4c02-9391-5bb99ff207f5", "name": "network-vif-deleted", "tag": "7314cd1f-0e61-41b2-8632-1f4218505681"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:04.072069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7f7be2ee-c780-4cd9-bf17-91d297895f90 req-5c1b4a05-e39d-4694-8e5e-2379317fc447 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.072547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7f7be2ee-c780-4cd9-bf17-91d297895f90 req-5c1b4a05-e39d-4694-8e5e-2379317fc447 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.086567 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7f7be2ee-c780-4cd9-bf17-91d297895f90 req-5c1b4a05-e39d-4694-8e5e-2379317fc447 service nova] Creating event network-vif-deleted:7314cd1f-0e61-41b2-8632-1f4218505681 for instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 on nch2-master-1 Apr 02 21:02:04.093602 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7f7be2ee-c780-4cd9-bf17-91d297895f90 req-5c1b4a05-e39d-4694-8e5e-2379317fc447 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032757 Apr 02 21:02:04.095163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1748/3169] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:04.182051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:04.182926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:04.189970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.190736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.191620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.192162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.228153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.229018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.229696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lazy-loading 'fault' on Instance uuid c06c68f0-17c8-4c02-9391-5bb99ff207f5 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:04.272891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:04.281360 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-099e5a37-26a5-4eb5-a7a4-04a4ba821247 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 200 len: 1306 microversion: 2.1 time: 0.103812 Apr 02 21:02:04.282151 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1749/3170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:04 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:04.286742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:04.287604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:04.293982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.294527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.295482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.296010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.376213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:04.397275 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d15ee093-c0d7-4c94-a0b9-394d69f8bafe tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1933 microversion: 2.75 time: 0.113944 Apr 02 21:02:04.407140 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1750/3171] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:04 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1933 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:04.414272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:04.414926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:04.421668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.422666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.423459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.423904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.529475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:04.542273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c1a465e-728c-457e-b4b5-cd061a03dc65 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.641814 Apr 02 21:02:04.542903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1422/3172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:03 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:04.594685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:04.602202 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d573c6f-7c09-4aae-ba4f-642201d3dc76 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.193872 Apr 02 21:02:04.602788 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1751/3173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:04 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:04.646338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:04.646955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:04.652953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.653352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.654121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:04.654561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:04.784887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:04.792187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1156f9fc-1906-4246-9483-55858b21c85c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1663 microversion: 2.1 time: 0.149656 Apr 02 21:02:04.792787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1423/3174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:04 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:05.011291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5811e07b-0b82-4812-bd1f-6268150aed5a req-ab32f37f-1738-4565-b752-d77aeb432765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "name": "network-vif-plugged", "status": "completed", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:05.023265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5811e07b-0b82-4812-bd1f-6268150aed5a req-ab32f37f-1738-4565-b752-d77aeb432765 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.023265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5811e07b-0b82-4812-bd1f-6268150aed5a req-ab32f37f-1738-4565-b752-d77aeb432765 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.040203 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5811e07b-0b82-4812-bd1f-6268150aed5a req-ab32f37f-1738-4565-b752-d77aeb432765 service nova] Creating event network-vif-plugged:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:02:05.048253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5811e07b-0b82-4812-bd1f-6268150aed5a req-ab32f37f-1738-4565-b752-d77aeb432765 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040747 Apr 02 21:02:05.049023 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1752/3175] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:05.075844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.076740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:05.088231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.088724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.089531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.089972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.301106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.302060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:05.308310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.308801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.309880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.310319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.323757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:05.331922 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-77e5e6e5-9aa2-4852-a515-29561bfd4bbb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.260417 Apr 02 21:02:05.332602 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1424/3176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:05 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:05.338132 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 could not be found. Apr 02 21:02:05.338748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:05.339630 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32606982-af7e-4e20-ac81-3318c34029e4 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 404 len: 111 microversion: 2.1 time: 0.044004 Apr 02 21:02:05.340185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1753/3177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:05 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:05.348104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a18a4ee-b547-476b-84e9-5841f18c02e1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54d42760d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.422538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.423168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:05.429174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.429631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.430429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.430872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.500983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:05.518565 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eea00f11-1a72-4dbd-be2f-aa9242b93866 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1933 microversion: 2.75 time: 0.099914 Apr 02 21:02:05.519162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1754/3178] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:05 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1933 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:02:05.532986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a18a4ee-b547-476b-84e9-5841f18c02e1 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8c6ecfd9-a637-4585-bc5f-4fca06655b3b" status: 202 len: 0 microversion: 2.1 time: 0.188410 Apr 02 21:02:05.533830 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1425/3179] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:05 2022] DELETE /compute/v2.1/os-security-groups/8c6ecfd9-a637-4585-bc5f-4fca06655b3b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:05.541719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a859049-9688-4c4d-afd3-1726284265ba tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7d419d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.558951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.559592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:05.566440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.566897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.567706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.568150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.706077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:05.713495 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-410c76e3-7803-4db7-8347-8e6820b51062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.158394 Apr 02 21:02:05.722815 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1426/3180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:05 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:05.723092 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a859049-9688-4c4d-afd3-1726284265ba tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a70f57f3-c644-44f0-816b-65c3c747ec1a" status: 202 len: 0 microversion: 2.1 time: 0.178908 Apr 02 21:02:05.723092 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1755/3181] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:05 2022] DELETE /compute/v2.1/os-security-groups/a70f57f3-c644-44f0-816b-65c3c747ec1a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:05.723279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.723279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:05.729000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.729455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.730234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.730678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.731503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d9b88e95-d1a0-4b38-af31-e273b7796085 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'create', calling method: .version_select at 0x7f54c7d411f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1952978962", "description": "tempest-description-266935411"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:05.867066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:05.870503 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d9b88e95-d1a0-4b38-af31-e273b7796085 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.143868 Apr 02 21:02:05.871496 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1756/3182] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:02:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:05.876432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:05.877041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:05.887740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.888194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.889016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:05.889440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:05.898047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-775fe6fb-ec4c-4dd0-91f0-f86676ed0fe5 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.182584 Apr 02 21:02:05.899350 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1427/3183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:05 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:05.903220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-53e88300-6701-41d1-991d-f5b27f04b630 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Action: 'update', calling method: .version_select at 0x7f54c7f9e1f0>, body: {"security_group": {"name": "tempest-sg-hth-606560479", "description": "tempest-description-hth-1343625471"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:06.033889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:06.041375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc99a6e2-6b40-4c6b-8c13-6649762cf15f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1667 microversion: 2.1 time: 0.169085 Apr 02 21:02:06.041950 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1757/3184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:05 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:06.071775 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-53e88300-6701-41d1-991d-f5b27f04b630 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/57bd2695-1b93-4f41-9243-bad329708b73" status: 200 len: 217 microversion: 2.1 time: 0.172025 Apr 02 21:02:06.072486 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1428/3185] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Apr 2 21:02:05 2022] PUT /compute/v2.1/os-security-groups/57bd2695-1b93-4f41-9243-bad329708b73 => generated 217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:06.084080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a9be708-dba1-4b33-b0d8-0885b6a61553 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7d93550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.137648 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a9be708-dba1-4b33-b0d8-0885b6a61553 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/57bd2695-1b93-4f41-9243-bad329708b73" status: 200 len: 217 microversion: 2.1 time: 0.058030 Apr 02 21:02:06.138479 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1758/3186] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/os-security-groups/57bd2695-1b93-4f41-9243-bad329708b73 => generated 217 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:06.151569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a0683b47-7b27-4afc-ac8f-ae1581c61a2a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7faa550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.321384 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a0683b47-7b27-4afc-ac8f-ae1581c61a2a tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/57bd2695-1b93-4f41-9243-bad329708b73" status: 202 len: 0 microversion: 2.1 time: 0.174403 Apr 02 21:02:06.322100 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1429/3187] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/57bd2695-1b93-4f41-9243-bad329708b73 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:06.330895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.331404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.337959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.338599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.339379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.339821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.348570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.349281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.353712 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 could not be found. Apr 02 21:02:06.354318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.355255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8fbefcb1-b019-4fb3-9ac8-3868c952bb60 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 404 len: 111 microversion: 2.1 time: 0.028891 Apr 02 21:02:06.355811 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1759/3188] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:06.357122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.357586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.358361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.358804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.363606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.364285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: c06c68f0-17c8-4c02-9391-5bb99ff207f5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.370120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.370576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.371346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.371793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.386938 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 could not be found. Apr 02 21:02:06.387755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Instance c06c68f0-17c8-4c02-9391-5bb99ff207f5 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.388616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-068ea54f-ee66-4c8e-8c07-da851533b4d5 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5" status: 404 len: 111 microversion: 2.1 time: 0.028692 Apr 02 21:02:06.389160 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1760/3189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/servers/c06c68f0-17c8-4c02-9391-5bb99ff207f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:06.398864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd2aca72-e497-4d13-b83c-7bb8beddfbb0 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7d905e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.425021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-cd2aca72-e497-4d13-b83c-7bb8beddfbb0 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a70f57f3-c644-44f0-816b-65c3c747ec1a does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:06.425825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-cd2aca72-e497-4d13-b83c-7bb8beddfbb0 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group a70f57f3-c644-44f0-816b-65c3c747ec1a not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:02:06.426517 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-cd2aca72-e497-4d13-b83c-7bb8beddfbb0 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group a70f57f3-c644-44f0-816b-65c3c747ec1a does not exist Apr 02 21:02:06.426517 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-4474535a-8c88-496c-bf4f-e83b7304e076'] Apr 02 21:02:06.427116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd2aca72-e497-4d13-b83c-7bb8beddfbb0 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group a70f57f3-c644-44f0-816b-65c3c747ec1a does not exist Apr 02 21:02:06.427116 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-4474535a-8c88-496c-bf4f-e83b7304e076'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.427950 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd2aca72-e497-4d13-b83c-7bb8beddfbb0 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a70f57f3-c644-44f0-816b-65c3c747ec1a" status: 404 len: 194 microversion: 2.1 time: 0.034241 Apr 02 21:02:06.428717 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1761/3190] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/a70f57f3-c644-44f0-816b-65c3c747ec1a => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:06.436499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d969dd6d-7d49-4f17-ae13-2d4d4893d114 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7db5d30>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.468247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-d969dd6d-7d49-4f17-ae13-2d4d4893d114 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:06.468995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-d969dd6d-7d49-4f17-ae13-2d4d4893d114 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:02:06.469596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d969dd6d-7d49-4f17-ae13-2d4d4893d114 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b does not exist Apr 02 21:02:06.469596 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-aab5e953-1a19-4344-bedb-a0de862cd086'] Apr 02 21:02:06.470336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d969dd6d-7d49-4f17-ae13-2d4d4893d114 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 8c6ecfd9-a637-4585-bc5f-4fca06655b3b does not exist Apr 02 21:02:06.470336 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-aab5e953-1a19-4344-bedb-a0de862cd086'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.471442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d969dd6d-7d49-4f17-ae13-2d4d4893d114 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8c6ecfd9-a637-4585-bc5f-4fca06655b3b" status: 404 len: 194 microversion: 2.1 time: 0.038677 Apr 02 21:02:06.472080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1762/3191] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/8c6ecfd9-a637-4585-bc5f-4fca06655b3b => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:06.480144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95b94d97-a566-4ee4-a5ce-d34a3fb36ea2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7dae550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.502357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-95b94d97-a566-4ee4-a5ce-d34a3fb36ea2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83a34da8-bd0b-4d14-8446-c45adbac4380 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:06.502959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-95b94d97-a566-4ee4-a5ce-d34a3fb36ea2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 83a34da8-bd0b-4d14-8446-c45adbac4380 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:02:06.503477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-95b94d97-a566-4ee4-a5ce-d34a3fb36ea2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 83a34da8-bd0b-4d14-8446-c45adbac4380 does not exist Apr 02 21:02:06.503477 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-1269e7a2-f0d7-49b4-851b-0ac04e368033'] Apr 02 21:02:06.504070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95b94d97-a566-4ee4-a5ce-d34a3fb36ea2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 83a34da8-bd0b-4d14-8446-c45adbac4380 does not exist Apr 02 21:02:06.504070 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-1269e7a2-f0d7-49b4-851b-0ac04e368033'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.504944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95b94d97-a566-4ee4-a5ce-d34a3fb36ea2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/83a34da8-bd0b-4d14-8446-c45adbac4380" status: 404 len: 194 microversion: 2.1 time: 0.028855 Apr 02 21:02:06.505501 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1763/3192] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/83a34da8-bd0b-4d14-8446-c45adbac4380 => generated 194 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:06.507227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:06.513158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-582ee599-a51f-45aa-bab1-43cb193a5bf2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7db5040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.515063 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0d76642-deb1-42e5-b511-f9a7090e6ad7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.170614 Apr 02 21:02:06.515751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1430/3193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:06.534574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-582ee599-a51f-45aa-bab1-43cb193a5bf2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:06.535857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-582ee599-a51f-45aa-bab1-43cb193a5bf2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:02:06.536380 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-582ee599-a51f-45aa-bab1-43cb193a5bf2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 does not exist Apr 02 21:02:06.536380 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-f061fb07-8b82-43cc-9ea5-2f057242f37e'] Apr 02 21:02:06.537007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-582ee599-a51f-45aa-bab1-43cb193a5bf2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 does not exist Apr 02 21:02:06.537007 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-f061fb07-8b82-43cc-9ea5-2f057242f37e'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.537839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-582ee599-a51f-45aa-bab1-43cb193a5bf2 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97" status: 404 len: 194 microversion: 2.1 time: 0.028362 Apr 02 21:02:06.538307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.538804 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1764/3194] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/dde459d7-2bd4-4db9-8ecc-e8fd57ed1c97 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:06.539064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.545231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.545688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.545955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ffbc798c-3539-405d-a04f-d1d044c60b15 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7dae430>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.546455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.547450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.568173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-ffbc798c-3539-405d-a04f-d1d044c60b15 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3d08f432-5cdc-4982-8b42-0913079455f9 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:06.568807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-ffbc798c-3539-405d-a04f-d1d044c60b15 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 3d08f432-5cdc-4982-8b42-0913079455f9 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:02:06.569591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ffbc798c-3539-405d-a04f-d1d044c60b15 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 3d08f432-5cdc-4982-8b42-0913079455f9 does not exist Apr 02 21:02:06.569591 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-d073d5c0-288e-45a3-80eb-ec1370b2c004'] Apr 02 21:02:06.570184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ffbc798c-3539-405d-a04f-d1d044c60b15 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 3d08f432-5cdc-4982-8b42-0913079455f9 does not exist Apr 02 21:02:06.570184 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-d073d5c0-288e-45a3-80eb-ec1370b2c004'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.571024 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ffbc798c-3539-405d-a04f-d1d044c60b15 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3d08f432-5cdc-4982-8b42-0913079455f9" status: 404 len: 194 microversion: 2.1 time: 0.028640 Apr 02 21:02:06.574644 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1765/3195] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/3d08f432-5cdc-4982-8b42-0913079455f9 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:06.579345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-add596be-1815-467b-8956-e2ec84a8567e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7db50d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.600959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG neutronclient.v2_0.client [None req-add596be-1815-467b-8956-e2ec84a8567e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 does not exist", "detail": ""}} {{(pid=136518) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:02:06.601560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.security_group_api [None req-add596be-1815-467b-8956-e2ec84a8567e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Neutron security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 not found {{(pid=136518) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 02 21:02:06.602074 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-add596be-1815-467b-8956-e2ec84a8567e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 does not exist Apr 02 21:02:06.602074 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-42f7e780-8fd2-4604-9b0d-c50a789e8033'] Apr 02 21:02:06.602660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-add596be-1815-467b-8956-e2ec84a8567e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Security group 84479b89-cee0-4cd6-b5ef-e788bbcca7a4 does not exist Apr 02 21:02:06.602660 ncdv-master-1 devstack@n-api.service[136518]: Neutron server returns request_ids: ['req-42f7e780-8fd2-4604-9b0d-c50a789e8033'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:06.603507 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-add596be-1815-467b-8956-e2ec84a8567e tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4" status: 404 len: 194 microversion: 2.1 time: 0.027882 Apr 02 21:02:06.604043 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1766/3196] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/os-security-groups/84479b89-cee0-4cd6-b5ef-e788bbcca7a4 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:06.612315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.612915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.618918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.619137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:06.619376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.620151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.620623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.635979 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57b820da-0027-424a-985b-8eb157a37ca6 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1933 microversion: 2.75 time: 0.101297 Apr 02 21:02:06.636590 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1431/3197] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1933 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:02:06.645620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:06.719585 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11ee84dc-892b-486f-8f0d-fd178a3db407 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 204 len: 0 microversion: 2.1 time: 0.111247 Apr 02 21:02:06.720422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1767/3198] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:06 2022] DELETE /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:02:06.728804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.729365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.733749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.735319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.736193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.736703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.737490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.737943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.742871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.742871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.742871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.743231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.898934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:06.903103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:06.907413 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6181d048-bea9-40ef-b44e-9fc605590fe1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.180834 Apr 02 21:02:06.907994 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1768/3199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:06.914858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:06.915611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:06.920072 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5a890b6d-00b5-44e0-95d6-ae5a984f8349 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1647 microversion: 2.1 time: 0.195533 Apr 02 21:02:06.924521 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1432/3200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1647 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:06.924659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.924659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:06.924659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:06.924659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.062497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:07.070367 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b834701e-92fe-4d86-8b6b-cf257ce9698e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.159240 Apr 02 21:02:07.070935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1769/3201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:06 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:07.078212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5db0f80e-9175-4d75-971b-748534ecdafb req-26dbd227-106c-4b60-8700-72a8658029b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec52e0fc-98cb-4059-b291-a5a9e5987b70", "name": "network-vif-plugged", "status": "completed", "tag": "6899260a-714f-44f5-b030-a483cf54a670"}, {"server_uuid": "2d5bfc3a-a0c8-43df-b545-28d13b55296b", "name": "network-vif-plugged", "status": "completed", "tag": "ea75b601-e0d3-4e9e-b79c-a92bba35bfb0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:07.087064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5db0f80e-9175-4d75-971b-748534ecdafb req-26dbd227-106c-4b60-8700-72a8658029b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.087513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5db0f80e-9175-4d75-971b-748534ecdafb req-26dbd227-106c-4b60-8700-72a8658029b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.100043 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5db0f80e-9175-4d75-971b-748534ecdafb req-26dbd227-106c-4b60-8700-72a8658029b9 service nova] Creating event network-vif-plugged:6899260a-714f-44f5-b030-a483cf54a670 for instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 on nch1-master-1 Apr 02 21:02:07.100589 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5db0f80e-9175-4d75-971b-748534ecdafb req-26dbd227-106c-4b60-8700-72a8658029b9 service nova] Creating event network-vif-plugged:ea75b601-e0d3-4e9e-b79c-a92bba35bfb0 for instance 2d5bfc3a-a0c8-43df-b545-28d13b55296b on nch2-master-1 Apr 02 21:02:07.110160 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5db0f80e-9175-4d75-971b-748534ecdafb req-26dbd227-106c-4b60-8700-72a8658029b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035151 Apr 02 21:02:07.111094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1433/3202] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:07.532425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:07.533059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:07.538995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.539446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.540207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.540670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.656967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:07.657782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:07.665392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.665845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.666631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.667068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.672622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:07.681123 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c62c5a21-4e28-43df-afd1-47a8dfa1e79a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.152663 Apr 02 21:02:07.681707 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1770/3203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:07 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:07.744142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] Lazy-loading 'services' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:07.761209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-088bf86c-bb26-4470-949f-0e71057a11d7 tempest-ServersAdmin275Test-1295857528 tempest-ServersAdmin275Test-1295857528-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1918 microversion: 2.75 time: 0.108554 Apr 02 21:02:07.761789 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1434/3204] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:07 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1918 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:02:07.795061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:07.795568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:07.801629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.802086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.802857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.803306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.827307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:07.902235 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-746b438a-d306-45f6-bc75-83b646bf908e tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 204 len: 0 microversion: 2.75 time: 0.110656 Apr 02 21:02:07.903218 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1771/3205] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:02:07 2022] DELETE /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:02:07.911069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:07.911685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:07.917707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.918165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.918935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.919381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.925198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:07.926028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:07.932174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.933117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:07.933594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:07.934041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.011825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.020312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.021947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.027310 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b8320dc-9845-46bc-b97e-2474765610c8 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1443 microversion: 2.75 time: 0.120067 Apr 02 21:02:08.028312 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1435/3206] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:07 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1443 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:08.033162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:08.033781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:08.039682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:08.040151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.041345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:08.041463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.088476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.096005 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2bb1143-a2c2-480c-a73e-55154eb6e448 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1318 microversion: 2.1 time: 0.175481 Apr 02 21:02:08.096828 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1772/3207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:07 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:08.106255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:08.106981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:08.113484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:08.114013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.114852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:08.115369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.244613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.253507 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e994b042-d704-4a7a-86ce-157f28ad4ad9 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1647 microversion: 2.1 time: 0.224052 Apr 02 21:02:08.262892 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1436/3208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:08 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1647 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:08.263269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.270549 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ea265e6-5376-4340-a606-83fe37bc2da6 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1325 microversion: 2.1 time: 0.169055 Apr 02 21:02:08.271111 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1773/3209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:08 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:08.698479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:08.699100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:08.706573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:08.706977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.707779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:08.708225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:08.844396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:08.852673 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d0588f0-33e8-4632-9506-042b8137eb11 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.158103 Apr 02 21:02:08.853666 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1437/3210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:08 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:09.047206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.047734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.054546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.055001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.055771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.056214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.117426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.119455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.129077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.135619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.141543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.142872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.143433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.145636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.147287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.152759 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a563eaa7-b761-48af-aee4-3e1b22984421 tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1443 microversion: 2.75 time: 0.109442 Apr 02 21:02:09.153471 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1774/3211] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:09 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:09.271177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.271861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.277803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.278266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.279044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.279488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.435810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3cf44a90a54b1eb08ba969847862e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ceefc39a5247ae86277ab79385c021', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.444562 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-65b1eb54-f677-48e8-9593-576416574bdb tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 200 len: 1647 microversion: 2.1 time: 0.176964 Apr 02 21:02:09.454268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1775/3212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:09 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 1647 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:09.454268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.454268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.456199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.456685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.457455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.457894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.464255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.471808 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-16398740-e97c-45ec-a292-a20ada678bee tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1467 microversion: 2.1 time: 0.359696 Apr 02 21:02:09.479264 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1438/3213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:09 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1467 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:09.489451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.490078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.496180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.496688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.497464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.497934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.603881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.612387 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebadcf38-bc34-455e-88ac-1c6d8309a9cb tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1522 microversion: 2.1 time: 0.166197 Apr 02 21:02:09.613002 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1776/3214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:09 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:09.641222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.642117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.648479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.648938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.649711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.650201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.677828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:09.722974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.731669 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8118995e-3631-4b8f-a518-4e9e548ff630 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 1468 microversion: 2.1 time: 0.247645 Apr 02 21:02:09.744119 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1439/3215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:09 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:09.761385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2015923175"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:09.764236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.784339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70a52df2-8748-4119-8cd7-db699d3ff987 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 204 len: 0 microversion: 2.1 time: 0.148548 Apr 02 21:02:09.786064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.786200 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1777/3216] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:09 2022] DELETE /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:02:09.786593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.787906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.788366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.795454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:09.796373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:09.803480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.804178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.805152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:09.805757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:09.983609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:09.993129 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2ae1f4e-8035-4477-a007-6d7b0d7f928e tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1528 microversion: 2.1 time: 0.201979 Apr 02 21:02:09.995705 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1778/3217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:09 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1528 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:10.001387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3339af44-6f73-440a-a7e6-7ff4accdcc05 req-9226bf63-8104-46d5-b09c-0328bc38a317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131b7001-ae40-4b02-b3f4-be3e6c25dbef", "name": "network-vif-deleted", "tag": "fb18d231-9f39-41dd-b0ec-34aeb8c41f47"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:10.010147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3339af44-6f73-440a-a7e6-7ff4accdcc05 req-9226bf63-8104-46d5-b09c-0328bc38a317 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.010602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3339af44-6f73-440a-a7e6-7ff4accdcc05 req-9226bf63-8104-46d5-b09c-0328bc38a317 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.027230 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3339af44-6f73-440a-a7e6-7ff4accdcc05 req-9226bf63-8104-46d5-b09c-0328bc38a317 service nova] Creating event network-vif-deleted:fb18d231-9f39-41dd-b0ec-34aeb8c41f47 for instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef on nch1-master-1 Apr 02 21:02:10.032662 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3339af44-6f73-440a-a7e6-7ff4accdcc05 req-9226bf63-8104-46d5-b09c-0328bc38a317 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035642 Apr 02 21:02:10.033456 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1779/3218] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:10.039067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:10.039207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:10.045326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.045783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.047229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.047685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.084923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-30474b11-b124-4290-838f-8f70277e6f73 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "POST /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4/action" status: 202 len: 0 microversion: 2.1 time: 0.338976 Apr 02 21:02:10.085844 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1440/3219] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:09 2022] POST /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:02:10.100033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c72d5d6-ba13-49b6-907e-2686a84a643a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7faa160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:10.148330 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c72d5d6-ba13-49b6-907e-2686a84a643a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.056113 Apr 02 21:02:10.148746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1441/3220] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:10 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:10.171852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:10.172540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:10.179107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.179687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.180580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.181111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.204993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:10.212568 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07dc1fc1-4abf-4c14-b3e1-c20856056253 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.177938 Apr 02 21:02:10.213156 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1780/3221] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:10 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:10.215481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.215946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.216405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lazy-loading 'fault' on Instance uuid ef57da98-ea97-41a8-b8d6-2fb124aa38e7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:10.263480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:10.272999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:10.274582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41359fff35654f228021d168daf5f8d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e9312a463f0419ca125b1155492d2c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:10.279935 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e91c6c66-4658-45e8-a711-f897c902a3db tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 200 len: 1448 microversion: 2.75 time: 0.112108 Apr 02 21:02:10.280637 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1442/3222] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:10 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 1448 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:02:10.462964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:10.463677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] [instance: 131b7001-ae40-4b02-b3f4-be3e6c25dbef] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:10.469754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.470217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.471002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:10.471474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:10.492251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] HTTP exception thrown: Instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef could not be found. Apr 02 21:02:10.493242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Returning 404 to user: Instance 131b7001-ae40-4b02-b3f4-be3e6c25dbef could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:10.494575 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6bb30971-f6d8-4665-8809-d469dfce84d6 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef" status: 404 len: 111 microversion: 2.1 time: 0.036088 Apr 02 21:02:10.495457 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1781/3223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:10 2022] GET /compute/v2.1/servers/131b7001-ae40-4b02-b3f4-be3e6c25dbef => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:10.508486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c77b313b-734b-4f00-8320-4a9bcf346062 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7faa550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:10.686062 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c77b313b-734b-4f00-8320-4a9bcf346062 tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/6523b211-2954-4b11-9a65-3f3c84efe927" status: 202 len: 0 microversion: 2.1 time: 0.185042 Apr 02 21:02:10.686851 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1443/3224] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:10 2022] DELETE /compute/v2.1/os-security-groups/6523b211-2954-4b11-9a65-3f3c84efe927 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:10.695040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e0f587f-1a8d-4579-bc3c-664a03de31dd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] Calling method '.version_select at 0x7f54c7d905e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:10.865717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e0f587f-1a8d-4579-bc3c-664a03de31dd tempest-SecurityGroupsTestJSON-1808290117 tempest-SecurityGroupsTestJSON-1808290117-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/c13f0570-327b-4120-8ed5-2f86d24be6fe" status: 202 len: 0 microversion: 2.1 time: 0.174841 Apr 02 21:02:10.866306 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1782/3225] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:02:10 2022] DELETE /compute/v2.1/os-security-groups/c13f0570-327b-4120-8ed5-2f86d24be6fe => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:11.012280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:11.013194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:11.019997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:11.020476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:11.021286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:11.021734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:11.161422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e36c97d-e7eb-4255-befb-e7043cc73e64 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d70f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:11.198979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:11.206625 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e1fda68-28ea-47bb-aff5-e449eae7de43 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1528 microversion: 2.1 time: 0.199252 Apr 02 21:02:11.213932 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1444/3226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:11 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1528 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:11.215375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e36c97d-e7eb-4255-befb-e7043cc73e64 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.057693 Apr 02 21:02:11.216489 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1783/3227] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:11 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:11.230384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:11.231003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:11.237883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:11.238349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:11.239135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:11.239581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:11.302074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:11.302749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] [instance: ef57da98-ea97-41a8-b8d6-2fb124aa38e7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:11.311025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:11.311776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:11.312933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:11.313177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:11.327376 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] HTTP exception thrown: Instance ef57da98-ea97-41a8-b8d6-2fb124aa38e7 could not be found. Apr 02 21:02:11.329847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] Returning 404 to user: Instance ef57da98-ea97-41a8-b8d6-2fb124aa38e7 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:11.330756 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0fcf35eb-872d-4a33-abea-d03f20b5dc7f tempest-ServersAdmin275Test-595148351 tempest-ServersAdmin275Test-595148351-project] 10.222.0.18 "GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7" status: 404 len: 111 microversion: 2.75 time: 0.033985 Apr 02 21:02:11.331494 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1784/3228] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:11 2022] GET /compute/v2.1/servers/ef57da98-ea97-41a8-b8d6-2fb124aa38e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:02:11.485950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:11.495879 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f60a3d16-4391-4fff-8597-4ddf2979668c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.268559 Apr 02 21:02:11.506164 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1445/3229] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:11 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:12.049253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ab9defe2-84f8-4d28-a083-6b40d2249d27 req-4b3bc092-42c1-436b-9c9d-7818fca358b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5bfc3a-a0c8-43df-b545-28d13b55296b", "name": "network-vif-deleted", "tag": "ea75b601-e0d3-4e9e-b79c-a92bba35bfb0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:12.060430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ab9defe2-84f8-4d28-a083-6b40d2249d27 req-4b3bc092-42c1-436b-9c9d-7818fca358b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:12.060430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ab9defe2-84f8-4d28-a083-6b40d2249d27 req-4b3bc092-42c1-436b-9c9d-7818fca358b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:12.071647 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ab9defe2-84f8-4d28-a083-6b40d2249d27 req-4b3bc092-42c1-436b-9c9d-7818fca358b5 service nova] Creating event network-vif-deleted:ea75b601-e0d3-4e9e-b79c-a92bba35bfb0 for instance 2d5bfc3a-a0c8-43df-b545-28d13b55296b on nch2-master-1 Apr 02 21:02:12.092572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ab9defe2-84f8-4d28-a083-6b40d2249d27 req-4b3bc092-42c1-436b-9c9d-7818fca358b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048482 Apr 02 21:02:12.094766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1785/3230] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:12.238449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c73d526f-7dee-45fa-b7d4-ed64ef4d0d84 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d70280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:12.244184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:12.244767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:12.260619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:12.261088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:12.261889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:12.262337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:12.325155 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c73d526f-7dee-45fa-b7d4-ed64ef4d0d84 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.096097 Apr 02 21:02:12.326281 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1786/3231] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:12 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:12.338702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:12.339171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:12.339640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lazy-loading 'fault' on Instance uuid 2d5bfc3a-a0c8-43df-b545-28d13b55296b {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:12.385590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9e0b13df3b487cb16732fcf86746b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46605b214f8144ebbbd2aab432bb7633', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:12.397095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6af2c056-34f5-4da6-9708-5a8fef3354b0 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 200 len: 1315 microversion: 2.1 time: 0.177261 Apr 02 21:02:12.397827 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1446/3232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:12 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:12.513652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:12.514379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:12.522530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:12.523174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:12.524249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:12.524893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:12.716968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:12.726663 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-769b0acc-5b39-41e6-9476-89052ba99325 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.217148 Apr 02 21:02:12.727741 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1787/3233] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:12 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:13.341547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4879ab4-8c28-4c64-a819-ebed0f117faa tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f0caf0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.393390 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4879ab4-8c28-4c64-a819-ebed0f117faa tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.058463 Apr 02 21:02:13.394609 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1447/3234] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:13 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:13.414227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.415610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 2d5bfc3a-a0c8-43df-b545-28d13b55296b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:13.423066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.423529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.424527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.425148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.454665 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance 2d5bfc3a-a0c8-43df-b545-28d13b55296b could not be found. Apr 02 21:02:13.457332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance 2d5bfc3a-a0c8-43df-b545-28d13b55296b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:13.458182 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f34f4d56-29fc-4e0c-b6ee-c2d679e1e283 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b" status: 404 len: 111 microversion: 2.1 time: 0.047977 Apr 02 21:02:13.458752 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1788/3235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:13 2022] GET /compute/v2.1/servers/2d5bfc3a-a0c8-43df-b545-28d13b55296b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:13.469389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56c193c2-e9bd-4a87-8c22-65c65cfc228b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '.version_select at 0x7f54c7f7a700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.493687 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-56c193c2-e9bd-4a87-8c22-65c65cfc228b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Image not found. Apr 02 21:02:13.494305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56c193c2-e9bd-4a87-8c22-65c65cfc228b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:13.495207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56c193c2-e9bd-4a87-8c22-65c65cfc228b tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/images/7186e05b-c1fc-40c9-9f9a-b97049f34b0e" status: 404 len: 62 microversion: 2.1 time: 0.032223 Apr 02 21:02:13.496144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1448/3236] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:13 2022] DELETE /compute/v2.1/images/7186e05b-c1fc-40c9-9f9a-b97049f34b0e => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:02:13.504978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.505411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:13.511300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.511754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.512551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.512991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.528968 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance e2d1423d-d3ce-4abb-8754-c597a900f156 could not be found. Apr 02 21:02:13.529796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance e2d1423d-d3ce-4abb-8754-c597a900f156 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:13.530796 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0a4bc97-374a-45b8-b6cf-d27d7a6adc8a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 404 len: 111 microversion: 2.1 time: 0.029727 Apr 02 21:02:13.531880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1789/3237] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:13 2022] DELETE /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:13.541253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.541992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: e2d1423d-d3ce-4abb-8754-c597a900f156] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:13.549204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.550046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.550846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.551352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.571107 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance e2d1423d-d3ce-4abb-8754-c597a900f156 could not be found. Apr 02 21:02:13.571728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance e2d1423d-d3ce-4abb-8754-c597a900f156 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:13.572626 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-121e8197-5086-4d20-ad52-a2f435f7655f tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156" status: 404 len: 111 microversion: 2.1 time: 0.036539 Apr 02 21:02:13.573289 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1449/3238] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:13 2022] GET /compute/v2.1/servers/e2d1423d-d3ce-4abb-8754-c597a900f156 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:13.582348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-639dd005-dfff-479c-9512-359cf098edbd tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '.version_select at 0x7f54c7d42940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.605401 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-639dd005-dfff-479c-9512-359cf098edbd tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028769559" status: 202 len: 0 microversion: 2.1 time: 0.027480 Apr 02 21:02:13.608495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1790/3239] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2028769559 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:13.748907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:13.753798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:13.764282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.765046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:13.766301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:13.767242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:14.031910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:14.041164 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c79fa633-39c7-4de0-a645-430fa327d737 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.301884 Apr 02 21:02:14.042012 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1450/3240] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:13 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:14.406738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3d9cc73b-36da-47c4-a24a-0d77da9c404b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d70a60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:14.430315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52bd5d41-b040-4cac-83c9-ba7bded47e06 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '.version_select at 0x7f54c7f7c820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:14.462067 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3d9cc73b-36da-47c4-a24a-0d77da9c404b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.059115 Apr 02 21:02:14.464054 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1791/3241] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:14 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:14.470510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-52bd5d41-b040-4cac-83c9-ba7bded47e06 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Image not found. Apr 02 21:02:14.471323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52bd5d41-b040-4cac-83c9-ba7bded47e06 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Image not found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:14.472176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52bd5d41-b040-4cac-83c9-ba7bded47e06 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/images/495f9ca9-ce09-4cab-b06d-f372334378cd" status: 404 len: 62 microversion: 2.1 time: 0.046859 Apr 02 21:02:14.473425 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1451/3242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:14 2022] DELETE /compute/v2.1/images/495f9ca9-ce09-4cab-b06d-f372334378cd => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 21:02:14.486119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:14.486618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:14.493233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:14.493820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:14.494627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:14.495237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:14.514821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance 12ed6253-6272-447a-b897-496efb357d2c could not be found. Apr 02 21:02:14.516497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance 12ed6253-6272-447a-b897-496efb357d2c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:14.518187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d01d3575-5a9e-4af7-a1ba-70f44652f0d2 tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "DELETE /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 404 len: 111 microversion: 2.1 time: 0.035560 Apr 02 21:02:14.518779 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1792/3243] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:14 2022] DELETE /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:14.533490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:14.534177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] [instance: 12ed6253-6272-447a-b897-496efb357d2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:14.540049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:14.540546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:14.541333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:14.541782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:14.555936 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] HTTP exception thrown: Instance 12ed6253-6272-447a-b897-496efb357d2c could not be found. Apr 02 21:02:14.557305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] Returning 404 to user: Instance 12ed6253-6272-447a-b897-496efb357d2c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:14.558339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-476cf521-014c-4292-966e-b261e11c2e4a tempest-ImagesOneServerNegativeTestJSON-1059092782 tempest-ImagesOneServerNegativeTestJSON-1059092782-project] 10.222.0.18 "GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c" status: 404 len: 111 microversion: 2.1 time: 0.033516 Apr 02 21:02:14.559368 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1793/3244] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:14 2022] GET /compute/v2.1/servers/12ed6253-6272-447a-b897-496efb357d2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:14.632486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1144699610", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:14.684924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:02:15.058391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:15.059387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:15.066349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:15.067096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:15.068142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:15.068837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:15.244724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:15.254585 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5e4a34ca-b218-417d-b1be-5040f90e8e2d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.199938 Apr 02 21:02:15.264151 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1794/3245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:15 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:15.344157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:02:15.344619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:02:15.345094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:02:15.345578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:02:15.345892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:02:15.356925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:15.357494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:15.358520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:15.359734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:15.379074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Getting quotas for project 6285976ac47c4791acbf3573297ab5a6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:15.389163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Getting quotas for user 8bed37cfaf3c460fa0a378aba8953078 and project 6285976ac47c4791acbf3573297ab5a6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:15.407316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:02:15.410103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:02:15.462717 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61fb6184-d434-4630-9aea-70c98c732dba tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980057 Apr 02 21:02:15.463366 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1452/3246] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:02:15.476602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2a001c3-4842-4ea3-bf83-a34482699cb3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f7c160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:15.476881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b96fc224-0bb3-4973-8869-7523f50a8052 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:15.477577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b96fc224-0bb3-4973-8869-7523f50a8052 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:15.529860 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2a001c3-4842-4ea3-bf83-a34482699cb3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.057001 Apr 02 21:02:15.530732 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1453/3247] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:15 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:15.565315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b96fc224-0bb3-4973-8869-7523f50a8052 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:15.575521 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b96fc224-0bb3-4973-8869-7523f50a8052 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1222 microversion: 2.1 time: 0.104213 Apr 02 21:02:15.576181 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1795/3248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:15 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:16.271836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:16.272540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:16.280663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:16.282671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:16.283539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:16.283997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:16.498412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:16.509891 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7aca868c-93b2-43ed-a332-0eb95adc844a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.242093 Apr 02 21:02:16.512680 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1454/3249] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:16 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:16.545409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-33b00fda-d41e-4c0a-bdb3-39549a0eb7d1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d40a55e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:16.598621 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-33b00fda-d41e-4c0a-bdb3-39549a0eb7d1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.059340 Apr 02 21:02:16.599812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1455/3250] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:16 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:16.604860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:16.605730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:16.623913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:16.625437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:16.626564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:16.627392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:16.699364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f45f849a-e0fd-4a44-8dd8-9a366de822b0 tempest-ListImagesTestJSON-992075712 tempest-ListImagesTestJSON-992075712-project] Calling method '.version_select at 0x7f54c7d7a5e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:16.714995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:16.723326 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37c3554b-d8eb-4acf-80c2-014802257b67 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1274 microversion: 2.1 time: 0.122127 Apr 02 21:02:16.728502 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1456/3251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:16 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:16.792925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f45f849a-e0fd-4a44-8dd8-9a366de822b0 tempest-ListImagesTestJSON-992075712 tempest-ListImagesTestJSON-992075712-project] 10.222.0.18 "GET /compute/v2.1/images/9e007d99-9b87-492c-9398-c1bd6aff27cb" status: 200 len: 784 microversion: 2.1 time: 0.266789 Apr 02 21:02:16.805370 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1796/3252] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:16 2022] GET /compute/v2.1/images/9e007d99-9b87-492c-9398-c1bd6aff27cb => generated 784 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:16.808341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-913bc62d-f94f-41b2-bfe9-e319d2954d35 tempest-ListImagesTestJSON-992075712 tempest-ListImagesTestJSON-992075712-project] Calling method '.version_select at 0x7f54c7f0c0d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:16.974569 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-913bc62d-f94f-41b2-bfe9-e319d2954d35 tempest-ListImagesTestJSON-992075712 tempest-ListImagesTestJSON-992075712-project] 10.222.0.18 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.171497 Apr 02 21:02:16.975164 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1457/3253] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:16 2022] GET /compute/v2.1/images => generated 445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:17.003930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06f29163-67bd-4079-946e-dabf93cc291e tempest-ListImagesTestJSON-992075712 tempest-ListImagesTestJSON-992075712-project] Calling method '.version_select at 0x7f54c7d905e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:17.127565 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06f29163-67bd-4079-946e-dabf93cc291e tempest-ListImagesTestJSON-992075712 tempest-ListImagesTestJSON-992075712-project] 10.222.0.18 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.137604 Apr 02 21:02:17.136030 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1797/3254] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 21:02:16 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:17.489074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6fe2b48c-0404-4717-80cf-edaf3fda7144 req-fd455275-8ffc-46aa-9607-977dfe93ebdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "name": "network-vif-plugged", "status": "completed", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:17.510424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6fe2b48c-0404-4717-80cf-edaf3fda7144 req-fd455275-8ffc-46aa-9607-977dfe93ebdf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:17.511040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6fe2b48c-0404-4717-80cf-edaf3fda7144 req-fd455275-8ffc-46aa-9607-977dfe93ebdf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:17.529413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6fe2b48c-0404-4717-80cf-edaf3fda7144 req-fd455275-8ffc-46aa-9607-977dfe93ebdf service nova] Creating event network-vif-plugged:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:02:17.537899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:17.539924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:17.541236 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6fe2b48c-0404-4717-80cf-edaf3fda7144 req-fd455275-8ffc-46aa-9607-977dfe93ebdf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054882 Apr 02 21:02:17.541881 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1458/3255] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:17.558990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:17.560474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:17.561877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:17.562609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:17.614871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ef4ae29-7c19-4a48-a082-290cb897cd9b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f0c700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:17.689968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ef4ae29-7c19-4a48-a082-290cb897cd9b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.081177 Apr 02 21:02:17.692133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1459/3256] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:17 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:17.746693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:17.749393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:17.763087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:17.763560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:17.764363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:17.771502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:17.925418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:17.947007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8a620c4-f636-4afd-af67-2e08f4932cc1 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1280 microversion: 2.1 time: 0.208345 Apr 02 21:02:17.960550 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1460/3257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:17 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:18.122128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:18.153293 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0aa162d-f7b5-490c-a314-9874471ef3d9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.627636 Apr 02 21:02:18.157587 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1798/3258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:17 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:18.711796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8dee37bf-c145-4d36-a092-42bb99bb7cc9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f483a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:18.826143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8dee37bf-c145-4d36-a092-42bb99bb7cc9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.125153 Apr 02 21:02:18.827395 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1461/3259] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:18 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:18.972991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:18.974227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:18.987914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:18.988687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:18.989739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:18.990483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:19.373559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-274310591", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:19.471025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] validate_networks() for [('15393407-38b0-412f-b2fb-6464d85ff0fe', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:02:19.477250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:19.485276 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86d24093-bea1-437a-bd5f-9b8853a1d3a3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 0.522813 Apr 02 21:02:19.485938 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1462/3260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:18 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:19.501646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:19.508996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:19.524146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:19.528414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:19.529466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:19.535410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.174552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:20.192400 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6fe6650b-124e-4ad4-b6bd-d44af3e9e075 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.698921 Apr 02 21:02:20.193096 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1463/3261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:19 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:20.211143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-509c2bac-8ae0-4f7f-aa81-2b945351bffd tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7faa700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:20.293935 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-509c2bac-8ae0-4f7f-aa81-2b945351bffd tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.099525 Apr 02 21:02:20.300240 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1464/3262] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:20 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:20.338834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:02:20.339361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:02:20.339970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:02:20.341141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:02:20.341661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:02:20.361778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.362437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.364081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.367302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.410881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Getting quotas for project ff8ea67a27f74237963a177abd07cc45. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:20.424642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Getting quotas for user f15cc4e52d554c3e9ab441d22453fffd and project ff8ea67a27f74237963a177abd07cc45. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:20.461326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:02:20.463998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:02:20.554815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-118f9d1f-ac57-4ef9-9006-ed421f89b105 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Calling method '.version_select at 0x7f54c7f6b5e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:20.577809 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f70d4fd0-32de-45b4-8eb3-40d353c7e385 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.731610 Apr 02 21:02:20.578474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f9d1f-ac57-4ef9-9006-ed421f89b105 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.579124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f9d1f-ac57-4ef9-9006-ed421f89b105 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.580303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f9d1f-ac57-4ef9-9006-ed421f89b105 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.583973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f9d1f-ac57-4ef9-9006-ed421f89b105 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.595127 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1799/3263] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:02:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:02:20.601503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a03d6b96-2788-40ea-b186-4c1f3f26f052 req-407b0177-987c-4c75-a888-664f12d2d42e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b99f2dd-ce26-44e6-ba16-847db4006038", "tag": "c0e0f613-eb38-41f0-a061-c28be2758291"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:20.621853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a03d6b96-2788-40ea-b186-4c1f3f26f052 req-407b0177-987c-4c75-a888-664f12d2d42e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.623992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a03d6b96-2788-40ea-b186-4c1f3f26f052 req-407b0177-987c-4c75-a888-664f12d2d42e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.642542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-118f9d1f-ac57-4ef9-9006-ed421f89b105 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.346425 Apr 02 21:02:20.649214 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1465/3264] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:02:20 2022] GET /compute/v2.1/limits => generated 511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:20.654224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:20.655079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:20.680196 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a03d6b96-2788-40ea-b186-4c1f3f26f052 req-407b0177-987c-4c75-a888-664f12d2d42e service nova] Creating event network-changed:c0e0f613-eb38-41f0-a061-c28be2758291 for instance 2b99f2dd-ce26-44e6-ba16-847db4006038 on nch2-master-1 Apr 02 21:02:20.681391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.682026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.683030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:20.683708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:20.723063 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a03d6b96-2788-40ea-b186-4c1f3f26f052 req-407b0177-987c-4c75-a888-664f12d2d42e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126327 Apr 02 21:02:20.726914 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1800/3265] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:20.748444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-090a606a-35f6-48b0-93d6-49f500ac8bab tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:20.749175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-090a606a-35f6-48b0-93d6-49f500ac8bab tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:20.848778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-090a606a-35f6-48b0-93d6-49f500ac8bab tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:20.857179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-090a606a-35f6-48b0-93d6-49f500ac8bab tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1213 microversion: 2.1 time: 0.124757 Apr 02 21:02:20.858513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1801/3266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:20 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:20.863822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-739264084", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:20.956272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:02:21.051769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:21.062813 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2163bcc4-1ed3-4c76-87c1-fb8a4a54d8ee tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 0.410961 Apr 02 21:02:21.064148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1466/3267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:20 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:21.209412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:21.210743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:21.224417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:21.225061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:21.233504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:21.233995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:21.296710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Getting quotas for project 785cc73963384110988648167b1dc942. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:21.317207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Getting quotas for user 3535257f20f14f6588de00d021bc854b and project 785cc73963384110988648167b1dc942. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:21.341392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Apr 02 21:02:21.345133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:21.350397 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-476a87fb-1079-42a0-a4dd-eb64b4d7cdd0 tempest-AbsoluteLimitsNegativeTestJSON-1088053364 tempest-AbsoluteLimitsNegativeTestJSON-1088053364-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.489535 Apr 02 21:02:21.352321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1802/3268] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Apr 2 21:02:20 2022] POST /compute/v2.1/servers => generated 87 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:02:21.371367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4f4b7b1a-1626-4aea-8dfa-7a8142a49725 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d70e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:21.481626 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4f4b7b1a-1626-4aea-8dfa-7a8142a49725 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.125465 Apr 02 21:02:21.489695 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1803/3269] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:21 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:21.669634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:21.686033 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74fcb278-e3eb-4095-baae-5e62cac56aae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.478903 Apr 02 21:02:21.688146 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1467/3270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:21 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:21.878032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:21.879122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:21.902045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:21.907962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:21.913209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:21.914306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:22.062749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:22.072708 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-af6f91a1-0687-4d7e-b1b4-71b9917a45a1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1265 microversion: 2.1 time: 0.200404 Apr 02 21:02:22.076603 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1804/3271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:21 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:22.080956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:22.081598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:22.098455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:22.098925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:22.107164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:22.107699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:22.497694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6f20e3f-73b6-439d-a030-b2d0d61ff6d9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d03b80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:22.604088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6f20e3f-73b6-439d-a030-b2d0d61ff6d9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.109555 Apr 02 21:02:22.608776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1805/3272] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:22 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:22.709512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:22.710496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:22.728196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:22.729508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:22.730595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:22.731977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:23.003006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:23.017797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:23.028412 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-350872ed-c1ae-42f2-ae2a-276bf634f1cb tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 0.951608 Apr 02 21:02:23.030066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8744aaa-f0cc-4e61-9cc4-07767eff9b5b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.324715 Apr 02 21:02:23.031725 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1468/3273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:22 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:23.032143 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1806/3274] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:22 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:23.090514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:23.091424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:23.101780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:23.102249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:23.103902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:23.106516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:23.210103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:23.217703 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db6ed3db-8c1a-4694-815e-e273e3537e6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1271 microversion: 2.1 time: 0.131162 Apr 02 21:02:23.218326 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1469/3275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:23 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:23.621977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69d5a6bb-5950-428c-a5a3-766e3fd587e5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d02700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:23.694593 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69d5a6bb-5950-428c-a5a3-766e3fd587e5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.076116 Apr 02 21:02:23.700349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1807/3276] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:23 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:24.054799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:24.056008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:24.057179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:24.060472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:24.071082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:24.071640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:24.072335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:24.074437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:24.086885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:24.087362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:24.088173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:24.088654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:24.505444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:24.517301 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cdab0bf1-d920-4d50-a473-d7e1ad5624d3 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.471649 Apr 02 21:02:24.518648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1808/3277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:24 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:24.544048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:24.547127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:24.560577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:24.563583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:24.564622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:24.565892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:24.602562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:24.630923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a4e19f9-4dba-48f2-b387-d61a235ebc5f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 0.584184 Apr 02 21:02:24.632233 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1470/3278] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:24 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:24.714626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d00379e-062a-4b06-8ac4-f0eb5ddbb7c3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f0c670>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:24.791317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d00379e-062a-4b06-8ac4-f0eb5ddbb7c3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.087199 Apr 02 21:02:24.795689 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1471/3279] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:24 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:25.196795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:25.215503 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b7b7091-0579-4eb2-8078-3c8f10730e9d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.681699 Apr 02 21:02:25.221552 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1809/3280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:24 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:25.536104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:25.536961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:25.546487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:25.550892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:25.551984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:25.554742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:25.644804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a5152617-5e99-4116-93d4-5cb27555e052 req-d6092013-75a9-47a4-bf6a-e51446ce4b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29437825-e42a-4c34-8d70-199c8bf119d4", "tag": "14bbc9b5-7e6e-44d2-855e-651eac54cff7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:25.657533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a5152617-5e99-4116-93d4-5cb27555e052 req-d6092013-75a9-47a4-bf6a-e51446ce4b15 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:25.665497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a5152617-5e99-4116-93d4-5cb27555e052 req-d6092013-75a9-47a4-bf6a-e51446ce4b15 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:25.695101 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a5152617-5e99-4116-93d4-5cb27555e052 req-d6092013-75a9-47a4-bf6a-e51446ce4b15 service nova] Creating event network-changed:14bbc9b5-7e6e-44d2-855e-651eac54cff7 for instance 29437825-e42a-4c34-8d70-199c8bf119d4 on nch2-master-1 Apr 02 21:02:25.705920 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a5152617-5e99-4116-93d4-5cb27555e052 req-d6092013-75a9-47a4-bf6a-e51446ce4b15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065218 Apr 02 21:02:25.709506 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1810/3281] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:25.725277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:25.733428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:25.746637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:25.750824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:25.755520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:25.756270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:26.082379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:26.090458 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aef100a7-3a6a-4c48-9c5d-860509341384 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 0.377992 Apr 02 21:02:26.094224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1811/3282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:25 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:26.099724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:26.106785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25dad6c2-6747-4e3d-94a4-1b77735f46d9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54da1dfca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:26.114305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-239d92b6-ad86-46ac-a154-6ba47441edae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.582900 Apr 02 21:02:26.117747 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1472/3283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:25 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:26.190226 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25dad6c2-6747-4e3d-94a4-1b77735f46d9 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.094892 Apr 02 21:02:26.191606 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1812/3284] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:26 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:26.238226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:26.238853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:26.250985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:26.251501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:26.252976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:26.253621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:26.693675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:26.705144 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a19641f4-9907-44aa-b36b-e011ae23ae9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.470843 Apr 02 21:02:26.705764 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1473/3285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:26 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:27.112191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:27.113036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:27.123569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.128688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.129872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.131237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.182389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8b739755-6409-43e8-bcac-e6ecbd686a00 req-fa68c4c7-450c-4a43-8077-ce8aec658cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b99f2dd-ce26-44e6-ba16-847db4006038", "name": "network-vif-plugged", "status": "completed", "tag": "c0e0f613-eb38-41f0-a061-c28be2758291"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:27.194603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8b739755-6409-43e8-bcac-e6ecbd686a00 req-fa68c4c7-450c-4a43-8077-ce8aec658cb3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.197253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8b739755-6409-43e8-bcac-e6ecbd686a00 req-fa68c4c7-450c-4a43-8077-ce8aec658cb3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.211715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8b739755-6409-43e8-bcac-e6ecbd686a00 req-fa68c4c7-450c-4a43-8077-ce8aec658cb3 service nova] Creating event network-vif-plugged:c0e0f613-eb38-41f0-a061-c28be2758291 for instance 2b99f2dd-ce26-44e6-ba16-847db4006038 on nch2-master-1 Apr 02 21:02:27.223906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8b739755-6409-43e8-bcac-e6ecbd686a00 req-fa68c4c7-450c-4a43-8077-ce8aec658cb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.385005 Apr 02 21:02:27.229694 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1813/3286] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:27.238681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:27.241279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:27.248262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.249916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.251227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.251758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.664679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:27.687566 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b5d68b8-6862-4510-9693-bb46cd7f4df0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 0.577920 Apr 02 21:02:27.700705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1474/3287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:27 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:27.708989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c8b98de-ac88-4e4a-8748-298c402ca11f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f194c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:27.783718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c8b98de-ac88-4e4a-8748-298c402ca11f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.081074 Apr 02 21:02:27.784879 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1475/3288] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:27 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:27.800338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:27.801340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:27.808338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.809079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.810271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:27.810939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:27.825497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:27.835408 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-400395ee-5740-4273-b86c-4b116f88d208 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.604006 Apr 02 21:02:27.838296 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1814/3289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:27 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:28.016617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:28.032592 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c2430974-4284-48bf-abd4-ca4b3332c6bb tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.241110 Apr 02 21:02:28.035346 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1476/3290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:27 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:28.708017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:28.709367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:28.720800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:28.726209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:28.727264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:28.727865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:28.802589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b554c65-a925-4b72-8c78-5df38e8a1d20 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f7ca60>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:28.872004 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b554c65-a925-4b72-8c78-5df38e8a1d20 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.077080 Apr 02 21:02:28.878888 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1477/3291] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:28 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:28.887636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:28.893444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:28.912280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:28.913639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:28.915636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:28.920725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:29.174673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:29.183570 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-adb2be6d-2a88-4f0d-b4fd-84dd4666f933 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.303197 Apr 02 21:02:29.185066 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1478/3292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:28 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:29.191051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:29.191677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:29.198893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:29.199355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:29.200199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:29.200691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:29.464124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:29.474404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f825982-df6b-4c07-863a-4af640a20241 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.288251 Apr 02 21:02:29.482912 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1479/3293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:29 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:29.807268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:29.821519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-804988e6-ac88-410b-b198-3ace70e70776 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1322 microversion: 2.1 time: 1.118216 Apr 02 21:02:29.833932 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1815/3294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:28 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1322 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:29.892742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cad9bf51-7824-4b09-8026-14bf1cdc7b2e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f48700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:30.001629 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cad9bf51-7824-4b09-8026-14bf1cdc7b2e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.114357 Apr 02 21:02:30.004801 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1480/3295] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:29 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:30.203231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:30.204017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:30.213235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:30.215794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:30.219252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:30.219844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:30.497622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:30.498490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:30.508011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:30.509705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:30.511375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:30.512016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:30.700594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:30.708086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6681d37f-8c64-47f9-8ea2-7198010abf91 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1509 microversion: 2.1 time: 0.509478 Apr 02 21:02:30.712204 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1816/3296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:30 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1509 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:30.740359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:30.751364 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55fe0bdd-9d58-4374-860c-d1e5942a1211 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.257522 Apr 02 21:02:30.753406 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1481/3297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:30 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:30.840261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:30.840895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:30.870733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:30.873565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:30.876728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:30.878832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:31.017377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c901777-e298-4381-8cb8-756748aa9331 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f19d30>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:31.075682 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c901777-e298-4381-8cb8-756748aa9331 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.062198 Apr 02 21:02:31.076872 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1482/3298] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:31 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:31.194646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:31.203953 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-435e78fc-7c72-48a4-8f88-396799f841bc tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1471 microversion: 2.1 time: 0.368217 Apr 02 21:02:31.206431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1817/3299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:30 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:31.515638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-282d89be-fc15-414a-b434-f0999e094d79 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:31.516364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-282d89be-fc15-414a-b434-f0999e094d79 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] [instance: 1b9acdee-f0c4-4118-b0b7-0cd2541b3df0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:31.523651 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-282d89be-fc15-414a-b434-f0999e094d79 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] HTTP exception thrown: Instance 1b9acdee-f0c4-4118-b0b7-0cd2541b3df0 could not be found. Apr 02 21:02:31.524594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-282d89be-fc15-414a-b434-f0999e094d79 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Returning 404 to user: Instance 1b9acdee-f0c4-4118-b0b7-0cd2541b3df0 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:31.525790 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-282d89be-fc15-414a-b434-f0999e094d79 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/1b9acdee-f0c4-4118-b0b7-0cd2541b3df0/action" status: 404 len: 111 microversion: 2.1 time: 0.307565 Apr 02 21:02:31.542076 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1483/3300] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:31 2022] POST /compute/v2.1/servers/1b9acdee-f0c4-4118-b0b7-0cd2541b3df0/action => generated 111 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:31.728560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:31.729194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:31.743417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-336009758", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:31.761874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:31.762366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:31.763196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:31.763643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:31.882122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:02:32.195850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:32.221879 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-140dba9a-8736-4767-8393-9dd021c6d88e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1530 microversion: 2.1 time: 0.486120 Apr 02 21:02:32.224154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1818/3301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:31 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1530 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:32.261020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:32.261858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:32.274851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:32.275708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:32.284904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:32.288608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:32.412565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:02:32.414631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:02:32.415534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:02:32.416253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:02:32.416908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:02:32.429419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:32.430109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:32.431215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:32.431914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:32.481147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Getting quotas for project 6285976ac47c4791acbf3573297ab5a6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:32.493991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Getting quotas for user 8bed37cfaf3c460fa0a378aba8953078 and project 6285976ac47c4791acbf3573297ab5a6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:32.532060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:02:32.535904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:02:32.648865 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-80a792b0-d334-4152-810c-45cdf721bb4e tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912591 Apr 02 21:02:32.649550 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1484/3302] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:02:32.658490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1247481-45ee-4b9f-bb82-3157b716f226 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f10940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:32.766441 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1247481-45ee-4b9f-bb82-3157b716f226 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1453 microversion: 2.1 time: 0.115736 Apr 02 21:02:32.767708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1485/3303] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:32 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:32.772734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-894da91c-8996-4bab-8c63-241473d8cfde tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:32.781867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-894da91c-8996-4bab-8c63-241473d8cfde tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:32.887927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-894da91c-8996-4bab-8c63-241473d8cfde tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:32.900327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-894da91c-8996-4bab-8c63-241473d8cfde tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1221 microversion: 2.1 time: 0.131078 Apr 02 21:02:32.901262 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1486/3304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:32 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:33.015978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:33.037481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b004b419-8f3c-435f-a99f-a829ef874778 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.811959 Apr 02 21:02:33.040743 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1819/3305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:32 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:33.248051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:33.250268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:33.264299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:33.267518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:33.270554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:33.271023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:33.302522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b53e75c-2d9f-4be5-bca1-f77c84f77571 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Action: 'create', calling method: .version_select at 0x7f54c7ecde50>, body: {"keypair": {"name": "tempest-keypair-1324145803"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:33.346990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9b53e75c-2d9f-4be5-bca1-f77c84f77571 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for project cf913c65b2ee4d168f38d2ffd7f02585. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:33.365178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9b53e75c-2d9f-4be5-bca1-f77c84f77571 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for user 5bf97b33a7644fd9b2c92af3138f040c and project cf913c65b2ee4d168f38d2ffd7f02585. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:33.621364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:33.625645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9b53e75c-2d9f-4be5-bca1-f77c84f77571 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for project cf913c65b2ee4d168f38d2ffd7f02585. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:33.632688 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de171a85-dc8c-4358-b149-08cee990c0bd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.395688 Apr 02 21:02:33.634643 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1820/3306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:33 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:33.635547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9b53e75c-2d9f-4be5-bca1-f77c84f77571 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for user 5bf97b33a7644fd9b2c92af3138f040c and project cf913c65b2ee4d168f38d2ffd7f02585. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:33.664654 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b53e75c-2d9f-4be5-bca1-f77c84f77571 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.459406 Apr 02 21:02:33.667346 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1487/3307] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:02:33 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:33.782772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0ee9a25-d03e-4eb8-b240-78bc369981eb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d15e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:33.916818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:33.917453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:33.926599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:33.927071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:33.927890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:33.934808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:34.056271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:34.066197 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6ed1fd86-90b0-4a7c-a7a0-fe7233a195b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1273 microversion: 2.1 time: 0.153355 Apr 02 21:02:34.071184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1488/3308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:33 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:34.079322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:34.080367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:34.104145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:34.141186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:34.142440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:34.145052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:34.678805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:34.692275 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0b03160-3216-4a6b-b8c7-05ab4d45208e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.619290 Apr 02 21:02:34.704308 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1489/3309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:34 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:34.713839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6e6f2ec9-c720-4d04-ad99-b5b576bd7d00 req-1c63bb5c-0cd9-41e3-9836-a9a3ae9842b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29437825-e42a-4c34-8d70-199c8bf119d4", "name": "network-vif-plugged", "status": "completed", "tag": "14bbc9b5-7e6e-44d2-855e-651eac54cff7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:34.729940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6e6f2ec9-c720-4d04-ad99-b5b576bd7d00 req-1c63bb5c-0cd9-41e3-9836-a9a3ae9842b1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:34.730669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6e6f2ec9-c720-4d04-ad99-b5b576bd7d00 req-1c63bb5c-0cd9-41e3-9836-a9a3ae9842b1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:34.767105 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6e6f2ec9-c720-4d04-ad99-b5b576bd7d00 req-1c63bb5c-0cd9-41e3-9836-a9a3ae9842b1 service nova] Creating event network-vif-plugged:14bbc9b5-7e6e-44d2-855e-651eac54cff7 for instance 29437825-e42a-4c34-8d70-199c8bf119d4 on nch2-master-1 Apr 02 21:02:34.785825 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6e6f2ec9-c720-4d04-ad99-b5b576bd7d00 req-1c63bb5c-0cd9-41e3-9836-a9a3ae9842b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079864 Apr 02 21:02:34.789545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1490/3310] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:34.799549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:34.805657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:34.821675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:34.825360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:34.826444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:34.827071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:35.430406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:35.440680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a2d61d9-160c-46ed-b288-44de0fe535d4 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.649574 Apr 02 21:02:35.446212 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1491/3311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:34 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:35.466824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:35.467941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:35.481781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:35.486437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:35.487497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:35.489433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:35.599304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:35.611346 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65db3d8e-fb48-4f6f-ac93-3f388058ac70 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1279 microversion: 2.1 time: 0.161444 Apr 02 21:02:35.612321 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1492/3312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:35 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:35.712315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:35.713692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:35.741585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:35.742419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:35.743492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:35.744153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:36.016316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:36.026192 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f2c73bac-8db1-4183-ad3d-1e4e8f912d6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1313 microversion: 2.1 time: 0.320104 Apr 02 21:02:36.036928 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1493/3313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:35 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:36.523748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:36.526032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:36.554628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:36.559592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:36.560655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:36.561346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:36.981525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:36.991265 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c57df1a-e9e1-4eb5-b5cc-0a764ee8ef2a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.509142 Apr 02 21:02:36.991940 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1494/3314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:36 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:37.005683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:37.006645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:37.018235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.018707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:37.019530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.019963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:37.413645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:37.427718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b0f8d9b-a291-444a-955f-6294fc9dc361 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.428127 Apr 02 21:02:37.428549 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1495/3315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:36 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:37.459472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-4729a4b8-87d5-48f2-bddd-83418b78f573 req-194806cb-aba5-4b6e-b64a-d16a759d5535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549c4297-08a2-4e85-8c9f-e1b9c081b452", "name": "network-vif-plugged", "status": "completed", "tag": "5de1a212-3d81-4136-b0b8-531ca93bc340"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:37.485192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4729a4b8-87d5-48f2-bddd-83418b78f573 req-194806cb-aba5-4b6e-b64a-d16a759d5535 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.485192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4729a4b8-87d5-48f2-bddd-83418b78f573 req-194806cb-aba5-4b6e-b64a-d16a759d5535 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:37.532990 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4729a4b8-87d5-48f2-bddd-83418b78f573 req-194806cb-aba5-4b6e-b64a-d16a759d5535 service nova] Creating event network-vif-plugged:5de1a212-3d81-4136-b0b8-531ca93bc340 for instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 on nch2-master-1 Apr 02 21:02:37.553097 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-4729a4b8-87d5-48f2-bddd-83418b78f573 req-194806cb-aba5-4b6e-b64a-d16a759d5535 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123383 Apr 02 21:02:37.560755 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1496/3316] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:37.580951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:37.590315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:37.608050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.610158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:37.611667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.621919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:37.929992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:37.940491 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-994c9786-5426-4731-94c1-fcafec6a5596 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1499 microversion: 2.1 time: 0.377457 Apr 02 21:02:37.941136 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1497/3317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:37 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1499 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:37.969155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:37.970751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:37.978997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.979929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:37.981988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:37.984032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:38.029058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lazy-loading 'flavor' on Instance uuid 29437825-e42a-4c34-8d70-199c8bf119d4 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:38.150026 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57ec3ea2-a32b-4867-957a-b408f494bbb1 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "POST /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4/action" status: 200 len: 32 microversion: 2.1 time: 0.183366 Apr 02 21:02:38.173386 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1498/3318] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:37 2022] POST /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:02:38.192183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:38.195206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:38.225212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:38.225893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:38.232784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:38.236223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:38.387590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0ee9a25-d03e-4eb8-b240-78bc369981eb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1462 microversion: 2.1 time: 4.608916 Apr 02 21:02:38.395162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1821/3319] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:33 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1462 bytes in 4612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:38.399560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:38.403496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:38.419620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:38.420523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:38.421767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:38.425890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:38.789325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:38.798875 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56e3fff8-dbd9-44e8-99e0-9ecafa43b716 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.622624 Apr 02 21:02:38.800324 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1499/3320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:38 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:38.805417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df232f1f-aca7-4afc-ba0e-e43e7796cd78 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ecdc10>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:38.889200 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df232f1f-aca7-4afc-ba0e-e43e7796cd78 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 200 len: 1462 microversion: 2.1 time: 0.087467 Apr 02 21:02:38.889971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1500/3321] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:38 2022] GET /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:38.904859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:38.908338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:38.919626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:38.921415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:38.923571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:38.924861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:39.301662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:39.318479 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f088cc37-5cb3-4f7a-917b-91c551e6689c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.928725 Apr 02 21:02:39.321029 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1822/3322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:38 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:39.368064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:39.378508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:39.379878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1518139f-5dd1-43be-9359-516f7a4e2d2c tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.488555 Apr 02 21:02:39.381949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:39.385912 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1501/3323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:38 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:39.401368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:39.403840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:39.404878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:39.414839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:39.640266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-62ea04cc-fc56-4f6f-9749-ea6e52eff046 req-e8d7dff3-7491-43d9-827b-54ce1348e3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec11d324-32d2-402b-9d8c-8b8cbd5d1257", "tag": "e54e9cb8-d03b-4911-b93d-685b77478126"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:39.655784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-62ea04cc-fc56-4f6f-9749-ea6e52eff046 req-e8d7dff3-7491-43d9-827b-54ce1348e3fd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:39.656407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-62ea04cc-fc56-4f6f-9749-ea6e52eff046 req-e8d7dff3-7491-43d9-827b-54ce1348e3fd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:39.702125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-62ea04cc-fc56-4f6f-9749-ea6e52eff046 req-e8d7dff3-7491-43d9-827b-54ce1348e3fd service nova] Creating event network-changed:e54e9cb8-d03b-4911-b93d-685b77478126 for instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 on nch2-master-1 Apr 02 21:02:39.719273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-62ea04cc-fc56-4f6f-9749-ea6e52eff046 req-e8d7dff3-7491-43d9-827b-54ce1348e3fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082910 Apr 02 21:02:39.720411 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1502/3324] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:39.820711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:39.821813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:39.836764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:39.838275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:39.839079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:39.839525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.053830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:40.066926 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8792d2d-9dc0-4be1-8495-cbc44ab74814 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 1468 microversion: 2.1 time: 0.744393 Apr 02 21:02:40.088187 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1823/3325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:39 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 1468 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:40.100317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-748353712"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:40.101485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:40.123553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:40.124065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.130881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:40.133071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.242460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:40.269088 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b421e6f4-40f0-4355-8255-470ab3ead93d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.455172 Apr 02 21:02:40.270551 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1503/3326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:39 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:40.350290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:40.350290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:40.362912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:40.365000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.366849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:40.369697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.689221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:40.699596 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd499109-b9aa-4bec-b6bc-219f6e498c6e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.356401 Apr 02 21:02:40.710217 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1504/3327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:40 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:40.720858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:40.722068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:40.731076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:40.732025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.732840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:40.733988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:40.932192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:40.941139 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e9bee902-f60c-40bb-a3bd-2d7c36e39dbe tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.239398 Apr 02 21:02:40.942346 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1505/3328] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:40 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:41.031208 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8267dc2-a0a2-400e-b30c-e015c2005802 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "POST /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70/action" status: 202 len: 0 microversion: 2.1 time: 0.941394 Apr 02 21:02:41.037688 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1824/3329] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:40 2022] POST /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:02:41.049647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ce41a50b-fae6-4074-a4a2-f9d1632167ed tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ec1430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:41.137862 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ce41a50b-fae6-4074-a4a2-f9d1632167ed tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.099574 Apr 02 21:02:41.139058 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1506/3330] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:41 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:41.290301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:41.291015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:41.305970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:41.313597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:41.314693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:41.315295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:41.609093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:41.619468 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21ee8b0e-39b7-46ff-98a6-1842b05d6ae6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.337150 Apr 02 21:02:41.620191 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1825/3331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:41 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:41.718681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:41.719225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:41.727967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:41.728436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:41.729257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:41.729706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:41.887455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:41.896167 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd86bc57-4e7c-49ff-9dfb-f14feacb7a44 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.181997 Apr 02 21:02:41.896889 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1507/3332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:41 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:41.959104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:41.959710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:41.969180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:41.969572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:41.970371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:41.970820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:42.136840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:42.150342 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dbdb8f0e-0417-4659-b1c5-d8a84130e1ac tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.195141 Apr 02 21:02:42.156794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-828d4612-2270-4f85-8480-bd36b2db95aa tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ec10d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:42.161261 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1826/3333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:41 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:42.220443 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-828d4612-2270-4f85-8480-bd36b2db95aa tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.067396 Apr 02 21:02:42.221344 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1508/3334] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:42 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:42.639807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:42.640437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:42.645330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-998717823", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "87ca88c9-8810-42a9-92c5-1c90d5dfc4ff"}], "security_groups": [{"name": "tempest-securitygroup--140294618"}], "key_name": "tempest-keypair-1324145803", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e994c31e-ad27-4b77-9caa-844e2cd31983", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:42.657311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:42.658059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:42.659007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:42.659608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:42.797430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] validate_networks() for [('87ca88c9-8810-42a9-92c5-1c90d5dfc4ff', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:02:42.840634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:42.853007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bac57ce-c4bf-4d07-8141-6706445750fc tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.219820 Apr 02 21:02:42.853709 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1509/3335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:42 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:42.915223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:42.915882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:42.930194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:42.931202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:42.932089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:42.932644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.133045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:43.142748 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88a458ac-d826-4555-a476-29507ce2e48d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.231376 Apr 02 21:02:43.152757 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1510/3336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:42 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:43.167184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:43.168265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:43.176148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.176995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.178145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.178806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.343617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:43.351812 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57c2927e-7673-4745-b6d0-8336281ba7d5 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.188395 Apr 02 21:02:43.352993 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1511/3337] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:43 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:43.353323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for project cf913c65b2ee4d168f38d2ffd7f02585. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:43.357852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f2425d83-42db-4f6b-a981-78d158e32ee3 req-80c559f5-78d2-42d5-851e-54ed62a90278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "name": "network-vif-unplugged", "status": "completed", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:43.358804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for user 5bf97b33a7644fd9b2c92af3138f040c and project cf913c65b2ee4d168f38d2ffd7f02585. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:43.366185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f2425d83-42db-4f6b-a981-78d158e32ee3 req-80c559f5-78d2-42d5-851e-54ed62a90278 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.366721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f2425d83-42db-4f6b-a981-78d158e32ee3 req-80c559f5-78d2-42d5-851e-54ed62a90278 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.372705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:02:43.373349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:02:43.378061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:02:43.378763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:02:43.379358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:02:43.380628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f2425d83-42db-4f6b-a981-78d158e32ee3 req-80c559f5-78d2-42d5-851e-54ed62a90278 service nova] Creating event network-vif-unplugged:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:02:43.385993 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f2425d83-42db-4f6b-a981-78d158e32ee3 req-80c559f5-78d2-42d5-851e-54ed62a90278 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031761 Apr 02 21:02:43.386906 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1512/3338] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:43.392651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac98c596-2beb-489d-be96-586339693b3e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f0fdc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:43.395246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.395882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.396969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.397703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.420758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for project cf913c65b2ee4d168f38d2ffd7f02585. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:43.429841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Getting quotas for user 5bf97b33a7644fd9b2c92af3138f040c and project cf913c65b2ee4d168f38d2ffd7f02585. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:43.451701 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac98c596-2beb-489d-be96-586339693b3e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.063426 Apr 02 21:02:43.458077 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1513/3339] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:43 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:43.506560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:02:43.509239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e994c31e-ad27-4b77-9caa-844e2cd31983',volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:02:43.652340 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23a35ceb-1886-4653-aef0-65105983386f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.020104 Apr 02 21:02:43.658787 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1827/3340] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:02:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:02:43.664774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9cfb750-c37b-476c-a8b4-d144c7f4b70f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:43.665535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9cfb750-c37b-476c-a8b4-d144c7f4b70f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:43.750047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f9cfb750-c37b-476c-a8b4-d144c7f4b70f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:43.759695 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9cfb750-c37b-476c-a8b4-d144c7f4b70f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1121 microversion: 2.1 time: 0.099831 Apr 02 21:02:43.760297 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1514/3341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:43 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1121 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:43.871166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:43.872084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:43.883980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.884447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:43.885372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:43.885850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.059564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:44.070252 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ceb9ab29-ff29-4fa9-9007-c01444935c2f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.202981 Apr 02 21:02:44.071668 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1828/3342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:43 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:44.161197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:44.162656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:44.169967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:44.171278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.172295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:44.174460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.369496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:44.370780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:44.380160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:44.380794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.383325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:44.384338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.400774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:44.419087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-626b2c38-8657-4f82-940b-e5174a572339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.261992 Apr 02 21:02:44.421356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1515/3343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:44 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:44.466710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c3791f5-f2e3-4778-b644-d86e20f219ba tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f199d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:44.547528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c3791f5-f2e3-4778-b644-d86e20f219ba tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.084879 Apr 02 21:02:44.549901 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1516/3344] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:44 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:44.599729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:44.607401 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-52f346a9-4be6-4b07-8408-9535b35e60a2 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.241972 Apr 02 21:02:44.608939 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1829/3345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:44 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:44.777340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:44.778072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:44.789970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:44.790782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.791806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:44.792484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:44.871229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:44.880639 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c89106c6-3882-41ec-a802-49b357b9823b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1219 microversion: 2.1 time: 0.107327 Apr 02 21:02:44.882428 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1517/3346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:44 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:45.087420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:45.088751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:45.100080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.100586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.103476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.104226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.371057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:45.382126 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a37eb7f-3d71-4d83-807a-ac28e3317999 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.298858 Apr 02 21:02:45.383213 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1830/3347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:45 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:45.437428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:45.437958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:45.444558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.444822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.445600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.446058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.562715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5592f311-9b78-4221-ab5e-caedf7f0ad6c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7d91ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:45.640794 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5592f311-9b78-4221-ab5e-caedf7f0ad6c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.082397 Apr 02 21:02:45.641384 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1831/3348] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:45 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:45.651776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:45.653140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:45.665512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.665987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.666800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.667260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.856707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:45.866618 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b58289ae-0aed-4d8b-b20b-1bd8e3d27108 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.222746 Apr 02 21:02:45.867412 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1832/3349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:45 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:45.906998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:45.907791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:45.915816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.917454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.918273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:45.918835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:45.992504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:46.003462 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0bf1b080-ac12-4d54-8848-d3dcf1b438ea tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1237 microversion: 2.1 time: 0.106454 Apr 02 21:02:46.004379 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1833/3350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:45 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1237 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:46.150280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:46.166937 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c4d86c3-9348-4817-b9fd-e24bf4c43096 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.732732 Apr 02 21:02:46.169301 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1518/3351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:45 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:46.403890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:46.404613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:46.415948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:46.416378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:46.418032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:46.418032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:46.442725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b708d0f6-9287-4df8-bb17-d3f0420a8725 req-fe7f3c99-0ded-484b-a4dd-9bfbe73dc1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec11d324-32d2-402b-9d8c-8b8cbd5d1257", "name": "network-vif-plugged", "status": "completed", "tag": "e54e9cb8-d03b-4911-b93d-685b77478126"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:46.488360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b708d0f6-9287-4df8-bb17-d3f0420a8725 req-fe7f3c99-0ded-484b-a4dd-9bfbe73dc1ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:46.492117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b708d0f6-9287-4df8-bb17-d3f0420a8725 req-fe7f3c99-0ded-484b-a4dd-9bfbe73dc1ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:46.517137 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b708d0f6-9287-4df8-bb17-d3f0420a8725 req-fe7f3c99-0ded-484b-a4dd-9bfbe73dc1ad service nova] Creating event network-vif-plugged:e54e9cb8-d03b-4911-b93d-685b77478126 for instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 on nch2-master-1 Apr 02 21:02:46.522233 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b708d0f6-9287-4df8-bb17-d3f0420a8725 req-fe7f3c99-0ded-484b-a4dd-9bfbe73dc1ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085630 Apr 02 21:02:46.523365 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1519/3352] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:02:46.655253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1aac84b0-eb7e-43dc-93e8-4698175f6feb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f0f790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:46.710354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:46.712317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1aac84b0-eb7e-43dc-93e8-4698175f6feb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.061505 Apr 02 21:02:46.713258 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1520/3353] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:46 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:46.725883 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da4aaa92-66d4-4f79-a6f7-9911e5fd2836 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.325963 Apr 02 21:02:46.751413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1834/3354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:46 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:46.883381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:46.884224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:46.894355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:46.894960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:46.895862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:46.896406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.021876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:47.022957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:47.030675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.031437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.038103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.038917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.203561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:47.215647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39607b2f-d8a5-4613-8274-a01522154e56 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1321 microversion: 2.1 time: 0.334742 Apr 02 21:02:47.219529 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1521/3355] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:46 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:47.229680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:47.230688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:47.247339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.250934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.252052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.253880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.276517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:47.288315 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-64f3d0f7-b780-4f9b-87bd-12a3c2bb3f97 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.271156 Apr 02 21:02:47.293148 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1835/3356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:47 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:47.511587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:47.524375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f1d5f18-970a-4f9b-8589-c04b2604a7e3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.302599 Apr 02 21:02:47.526044 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1522/3357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:47 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:47.552554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-895f2590-172a-4102-8084-88163c704e86 req-631b38f5-9135-402f-be7b-c2af0a62fccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e26eb0-1631-4bb6-a60d-1c2bb65097b3", "tag": "d154e01b-b647-45e1-9f62-4356af6468c4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:47.580274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-895f2590-172a-4102-8084-88163c704e86 req-631b38f5-9135-402f-be7b-c2af0a62fccd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.585560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-895f2590-172a-4102-8084-88163c704e86 req-631b38f5-9135-402f-be7b-c2af0a62fccd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.634350 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-895f2590-172a-4102-8084-88163c704e86 req-631b38f5-9135-402f-be7b-c2af0a62fccd service nova] Creating event network-changed:d154e01b-b647-45e1-9f62-4356af6468c4 for instance 01e26eb0-1631-4bb6-a60d-1c2bb65097b3 on nch1-master-1 Apr 02 21:02:47.641308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-895f2590-172a-4102-8084-88163c704e86 req-631b38f5-9135-402f-be7b-c2af0a62fccd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094007 Apr 02 21:02:47.642561 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1836/3358] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:47.726706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d2d93ee3-a7c4-4ee3-8921-a4e5011e7b72 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f104c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:47.750742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:47.752194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:47.768916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.770098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.771433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:47.773997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:47.822437 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d2d93ee3-a7c4-4ee3-8921-a4e5011e7b72 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.100247 Apr 02 21:02:47.823596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1523/3359] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:47 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:48.021236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:48.029150 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c50b7510-823f-4300-a85d-a420c1d3bea7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1525 microversion: 2.1 time: 0.288314 Apr 02 21:02:48.030310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1837/3360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:47 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:48.233135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:48.233757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:48.239678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.240155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.240951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.241396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.306321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:48.306935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:48.313360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.313819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.314592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.315031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.448025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:48.456323 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-def6ad74-557e-4565-8e76-1564edb72c9f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.153822 Apr 02 21:02:48.457611 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1838/3361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:48 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:48.476433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:48.485945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cbdbf133-c174-4f31-920e-c6ec0d96003f tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1471 microversion: 2.1 time: 0.257260 Apr 02 21:02:48.486540 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1524/3362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:48 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:48.502323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:48.502866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:48.510168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.510630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.511617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.512060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.538476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lazy-loading 'flavor' on Instance uuid ec11d324-32d2-402b-9d8c-8b8cbd5d1257 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:48.543972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:48.544690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:48.551845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.552374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.553266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.554145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.609354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-62bab979-f975-4984-9ad4-4ecf3114cbe1 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257/action" status: 202 len: 0 microversion: 2.1 time: 0.111081 Apr 02 21:02:48.610153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1839/3363] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:48 2022] POST /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:02:48.618670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:48.619377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:48.626259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.626989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.627941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:48.628567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:48.804184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:48.812418 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-631b520e-99ee-41e2-93e7-a2c2544dfa96 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.272604 Apr 02 21:02:48.813429 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1525/3364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:48 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:48.837089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b00bcfb-6117-43aa-ae65-62390a6767f1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ed7430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:48.884787 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6b00bcfb-6117-43aa-ae65-62390a6767f1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.051686 Apr 02 21:02:48.885545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1526/3365] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:48 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:49.044698 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b0617c7-a2f0-4c5f-94d5-ee9e7c8a822a tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1630 microversion: 2.1 time: 0.429570 Apr 02 21:02:49.047542 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1840/3366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:48 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1630 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:49.055536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:49.058286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:49.070292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.071058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.071849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.072290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.238424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:49.245416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e8438302-ff58-4d47-a95e-6cea0ebd9242 req-af49ec5a-9922-4790-9b0b-828b2ea04661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec52e0fc-98cb-4059-b291-a5a9e5987b70", "name": "network-vif-plugged", "status": "completed", "tag": "6899260a-714f-44f5-b030-a483cf54a670"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:49.247221 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5152ed2-b291-4838-b3c5-7fc7f55a8e28 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1507 microversion: 2.1 time: 0.203476 Apr 02 21:02:49.247693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1527/3367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:49 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1507 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:49.259539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8438302-ff58-4d47-a95e-6cea0ebd9242 req-af49ec5a-9922-4790-9b0b-828b2ea04661 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.260003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8438302-ff58-4d47-a95e-6cea0ebd9242 req-af49ec5a-9922-4790-9b0b-828b2ea04661 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.272759 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e8438302-ff58-4d47-a95e-6cea0ebd9242 req-af49ec5a-9922-4790-9b0b-828b2ea04661 service nova] Creating event network-vif-plugged:6899260a-714f-44f5-b030-a483cf54a670 for instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 on nch1-master-1 Apr 02 21:02:49.278400 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e8438302-ff58-4d47-a95e-6cea0ebd9242 req-af49ec5a-9922-4790-9b0b-828b2ea04661 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039212 Apr 02 21:02:49.279610 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1841/3368] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:49.473805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:49.474465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:49.480789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.481280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.482065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.482511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.614581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:49.622202 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b0cddd9-88b5-4444-9c63-8d82b7c6d83d tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.152323 Apr 02 21:02:49.622812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1528/3369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:49 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:49.832274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:49.834106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:49.842999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.843698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.844525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:49.844991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:49.897786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9867b8a3-f345-4a29-8c7b-874455ef3940 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ed7b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:49.941027 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9867b8a3-f345-4a29-8c7b-874455ef3940 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.046894 Apr 02 21:02:49.941778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1529/3370] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:49 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:49.978643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:49.986623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1fb40ebf-918b-4a61-ab14-cd1f2fefaecc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.160295 Apr 02 21:02:49.987185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1842/3371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:49 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:50.063062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:50.063789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:50.070058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.070506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.071303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.071741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.205206 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a8c3fb87-65dc-4217-b297-ca2d7ec8ba08 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1613 microversion: 2.1 time: 0.146435 Apr 02 21:02:50.205778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1530/3372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:50 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:50.222808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:50.223397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:50.229321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.229790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.230575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.231021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.271239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:50.271405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] HTTP exception thrown: Cannot 'migrate' instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 while it is in vm_state suspended Apr 02 21:02:50.272110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Returning 409 to user: Cannot 'migrate' instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 while it is in vm_state suspended {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:50.272532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:50.273123 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0cfa249f-a808-413c-9cce-6c6c38fb4563 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257/action" status: 409 len: 148 microversion: 2.1 time: 0.054288 Apr 02 21:02:50.273947 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1843/3373] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:50 2022] POST /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257/action => generated 148 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:02:50.279516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.280027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.280844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.281387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.286300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-960b40da-96ad-42ac-8f0b-a5f3c9a32230 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:50.287434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-960b40da-96ad-42ac-8f0b-a5f3c9a32230 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:50.288239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-960b40da-96ad-42ac-8f0b-a5f3c9a32230 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038/action" status: 400 len: 144 microversion: 2.1 time: 0.005660 Apr 02 21:02:50.288810 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1844/3374] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:50 2022] POST /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038/action => generated 144 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:02:50.297022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ad456a6-281b-4f0a-8322-f70fcb18c2e4 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:50.298144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ad456a6-281b-4f0a-8322-f70fcb18c2e4 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:50.299073 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ad456a6-281b-4f0a-8322-f70fcb18c2e4 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038/action" status: 400 len: 120 microversion: 2.1 time: 0.005576 Apr 02 21:02:50.300514 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1845/3375] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:02:50 2022] POST /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038/action => generated 120 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:02:50.308682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-75ea9485-402b-4ab0-8655-f5e100a66900 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:50.309625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-75ea9485-402b-4ab0-8655-f5e100a66900 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Failed to fetch instance by id 999 {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 21:02:50.310137 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-75ea9485-402b-4ab0-8655-f5e100a66900 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] HTTP exception thrown: Instance 999 could not be found. Apr 02 21:02:50.310697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-75ea9485-402b-4ab0-8655-f5e100a66900 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:50.312008 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-75ea9485-402b-4ab0-8655-f5e100a66900 tempest-ServersAdminNegativeTestJSON-147764996 tempest-ServersAdminNegativeTestJSON-147764996-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.006410 Apr 02 21:02:50.312726 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1846/3376] 10.222.0.18 () {60 vars in 1178 bytes} [Sat Apr 2 21:02:50 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 02 21:02:50.320924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:50.321417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:50.328193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.328673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.329453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.329893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.354243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:50.421104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:50.428714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88ee3c7b-2310-4985-9461-92b40ae9c4b8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1507 microversion: 2.1 time: 0.161395 Apr 02 21:02:50.429474 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1531/3377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:50 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:50.431622 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e8b1ffd9-a024-4f93-a62c-044d9456e877 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 204 len: 0 microversion: 2.1 time: 0.114271 Apr 02 21:02:50.432218 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1847/3378] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:50 2022] DELETE /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:02:50.441603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:50.442326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:50.449689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.450241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.451315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.452486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.587391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:50.594877 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3e73263-ff9d-4fc0-9335-7bd0a03059b3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1468 microversion: 2.1 time: 0.158615 Apr 02 21:02:50.595542 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1532/3379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:50 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1468 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:50.640423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:50.641216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:50.647333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.647803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.648609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:50.649052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:50.788359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:50.796571 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5e0194dd-5cf2-409b-a447-2af2d8046089 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.161206 Apr 02 21:02:50.797149 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1848/3380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:50 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:50.954477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f413c349-7d70-43a8-9309-5e8a8cf5676f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f199d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.003382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f413c349-7d70-43a8-9309-5e8a8cf5676f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.052509 Apr 02 21:02:51.003983 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1533/3381] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:50 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:51.004904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.005862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:51.013516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.014078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.014877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.015329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.165869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:51.174635 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22138715-85d7-4c79-9191-eb34c22b7205 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.174447 Apr 02 21:02:51.175213 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1849/3382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:50 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:51.447929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.448978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:51.461738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.462285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.463154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.463605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.579611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.580630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:51.587039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.587751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.588738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.589340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.625043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-855f7bbe-0937-48c3-abd2-e60c2abf0f17 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments/35aae13b-58e7-47bc-9a5c-0ca232ff5912" status: 200 len: 194 microversion: 2.20 time: 0.049781 Apr 02 21:02:51.630411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1850/3383] 10.222.0.18 () {60 vars in 1453 bytes} [Sat Apr 2 21:02:51 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments/35aae13b-58e7-47bc-9a5c-0ca232ff5912 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:02:51.631599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.632701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:51.636735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:51.641525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.642098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.643341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.643895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.646296 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60cfe3dd-78be-44ec-9967-e4506efeb10c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 200 len: 1450 microversion: 2.1 time: 0.202406 Apr 02 21:02:51.646296 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1534/3384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:51 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:51.665140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.665140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:51.675123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.675751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.676383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.677368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.731064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:51.743208 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.compute.api [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Working on deleting snapshot b91c029e-aac1-47e7-8c0d-10bd0378ba13 from shelved instance... Apr 02 21:02:51.823839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:51.838451 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-93eed5a5-4921-44a5-8151-51feb27a7193 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1468 microversion: 2.1 time: 0.211227 Apr 02 21:02:51.839211 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1851/3385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:51 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:51.862129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:51.862641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:51.870897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.871094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.871875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:51.872333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:51.986324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lazy-loading 'services' on Instance uuid a9e92f68-549b-4c9e-bbf9-803500a77d9c {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:52.069298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c79822ba-4ea1-4945-b527-f20b73eaedb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments/35aae13b-58e7-47bc-9a5c-0ca232ff5912" status: 202 len: 0 microversion: 2.20 time: 0.215388 Apr 02 21:02:52.073273 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1852/3386] 10.222.0.18 () {60 vars in 1456 bytes} [Sat Apr 2 21:02:51 2022] DELETE /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments/35aae13b-58e7-47bc-9a5c-0ca232ff5912 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:02:52.076569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:52.078217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:52.086290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.087080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.088674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.089332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.414048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:52.425627 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a9c7525-77e7-462a-ad1d-1434c490170b tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.353474 Apr 02 21:02:52.427831 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1853/3387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:52 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:52.438222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-259c1e24-e4d4-4cde-be59-6a30ff824f67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e491f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:52.561499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-259c1e24-e4d4-4cde-be59-6a30ff824f67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.131361 Apr 02 21:02:52.562536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1854/3388] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:52 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:52.573669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:52.574871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:52.583475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.584135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.585162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.585837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.610677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Doing local delete in cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=136517) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 02 21:02:52.611473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.611929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.612837 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.compute.api [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 02 21:02:52.621092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] deallocate_for_instance() {{(pid=136517) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 02 21:02:52.628636 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb2a41c3-7a23-4c2b-85de-44386c0be175 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059813 Apr 02 21:02:52.629557 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1855/3389] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:02:52 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:02:52.635082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:52.635777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:52.645641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.646110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.646912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.647366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:52.938901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:52.950437 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b532a7e4-6c5c-4c63-b181-9ef5e318aa62 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.316870 Apr 02 21:02:52.961176 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1856/3390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:52 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:52.961176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9540a4d5-eac7-47e8-af44-ec6c0583fd8f req-9df5664d-1688-45f7-af2e-43f235b77745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549c4297-08a2-4e85-8c9f-e1b9c081b452", "name": "network-vif-unplugged", "status": "completed", "tag": "5de1a212-3d81-4136-b0b8-531ca93bc340"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:52.990721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9540a4d5-eac7-47e8-af44-ec6c0583fd8f req-9df5664d-1688-45f7-af2e-43f235b77745 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:52.991065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9540a4d5-eac7-47e8-af44-ec6c0583fd8f req-9df5664d-1688-45f7-af2e-43f235b77745 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.040408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_external_events [req-9540a4d5-eac7-47e8-af44-ec6c0583fd8f req-9df5664d-1688-45f7-af2e-43f235b77745 service nova] Unable to find a host for instance 549c4297-08a2-4e85-8c9f-e1b9c081b452. Dropping event network-vif-unplugged {{(pid=136518) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 02 21:02:53.062641 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9540a4d5-eac7-47e8-af44-ec6c0583fd8f req-9df5664d-1688-45f7-af2e-43f235b77745 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.107687 Apr 02 21:02:53.069133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1857/3391] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 115 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 02 21:02:53.087167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:53.090106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:53.107061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.110349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.111548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.112368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.260960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:53.273806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b36c652-8ca5-4820-9299-9eb75e4580dd tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 200 len: 1297 microversion: 2.1 time: 0.203062 Apr 02 21:02:53.278128 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1858/3392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:53 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 1297 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:53.410692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d4d1c728-cda3-4383-961e-65c2264acf2e req-d34f14db-5f5f-4596-a70f-092f6fe62822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec11d324-32d2-402b-9d8c-8b8cbd5d1257", "name": "network-vif-deleted", "tag": "e54e9cb8-d03b-4911-b93d-685b77478126"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:53.422569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d4d1c728-cda3-4383-961e-65c2264acf2e req-d34f14db-5f5f-4596-a70f-092f6fe62822 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.423296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d4d1c728-cda3-4383-961e-65c2264acf2e req-d34f14db-5f5f-4596-a70f-092f6fe62822 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.439230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Updating instance_info_cache with network_info: [] {{(pid=136517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 21:02:53.449563 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d4d1c728-cda3-4383-961e-65c2264acf2e req-d34f14db-5f5f-4596-a70f-092f6fe62822 service nova] Creating event network-vif-deleted:e54e9cb8-d03b-4911-b93d-685b77478126 for instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 on nch2-master-1 Apr 02 21:02:53.463477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d4d1c728-cda3-4383-961e-65c2264acf2e req-d34f14db-5f5f-4596-a70f-092f6fe62822 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181913 Apr 02 21:02:53.470942 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1859/3393] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:53.478049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8e488793-a8f0-4bbc-8b51-417d7cf5e33c req-bae3a775-dfe1-488f-8450-646e9243edfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549c4297-08a2-4e85-8c9f-e1b9c081b452", "name": "network-vif-deleted", "tag": "5de1a212-3d81-4136-b0b8-531ca93bc340"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:53.515991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8e488793-a8f0-4bbc-8b51-417d7cf5e33c req-bae3a775-dfe1-488f-8450-646e9243edfa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.518386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8e488793-a8f0-4bbc-8b51-417d7cf5e33c req-bae3a775-dfe1-488f-8450-646e9243edfa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.555484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_external_events [req-8e488793-a8f0-4bbc-8b51-417d7cf5e33c req-bae3a775-dfe1-488f-8450-646e9243edfa service nova] Unable to find a host for instance 549c4297-08a2-4e85-8c9f-e1b9c081b452. Dropping event network-vif-deleted {{(pid=136518) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 02 21:02:53.557393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8e488793-a8f0-4bbc-8b51-417d7cf5e33c req-bae3a775-dfe1-488f-8450-646e9243edfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.085026 Apr 02 21:02:53.559993 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1860/3394] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 02 21:02:53.573014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:53.574605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:53.586604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.587014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.587864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.588334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.801712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:53.809769 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5472d8b-0e1d-448f-b270-e861ce5c0c41 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.248677 Apr 02 21:02:53.811705 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1861/3395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:53 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:53.816385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b9eb576-c579-41ff-b601-a13637a3de4c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e49040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:53.880141 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b9eb576-c579-41ff-b601-a13637a3de4c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.067437 Apr 02 21:02:53.880789 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1862/3396] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:53 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:53.885750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:53.886735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:53.894826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.895286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.896180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.896678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.939910 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5178a07-1470-4769-a010-1e40055de05b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057777 Apr 02 21:02:53.945700 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1863/3397] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:02:53 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:53.968925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:53.969568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:53.981364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.981830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:53.982670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:53.983666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.032546 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61b7c6d4-157a-4ae5-b173-dcbc240d0cf6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 204 len: 0 microversion: 2.1 time: 2.371882 Apr 02 21:02:54.033443 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1535/3398] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:51 2022] DELETE /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 0 bytes in 2373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:02:54.039031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.039845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.058097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.058809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.059788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.063156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.113756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:54.179054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:54.190474 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-740a8501-46ba-48b2-a27d-f05ca63b2f7f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.225186 Apr 02 21:02:54.191182 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1864/3399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:53 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:54.201545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.202951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.211493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.213381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.214542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.215515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.237023 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 could not be found. Apr 02 21:02:54.238033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:54.248153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce55bd4e-660b-4cd6-963c-d09a55345803 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 404 len: 111 microversion: 2.1 time: 0.055168 Apr 02 21:02:54.250778 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1865/3400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:54 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:54.266734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc2126b1-1ca7-47a7-9172-53e442c0912f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 204 len: 0 microversion: 2.20 time: 0.223070 Apr 02 21:02:54.268822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1536/3401] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:02:54 2022] DELETE /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:02:54.277572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.278189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.284851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.285536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.286525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.287426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.299649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.300714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: ec11d324-32d2-402b-9d8c-8b8cbd5d1257] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.308804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.309210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.310007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.310452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.328281 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] HTTP exception thrown: Instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 could not be found. Apr 02 21:02:54.329360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Returning 404 to user: Instance ec11d324-32d2-402b-9d8c-8b8cbd5d1257 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:54.330954 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4eeeb902-ef60-4196-a588-fdc071e097d8 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257" status: 404 len: 111 microversion: 2.1 time: 0.040251 Apr 02 21:02:54.335412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1537/3402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:54 2022] GET /compute/v2.1/servers/ec11d324-32d2-402b-9d8c-8b8cbd5d1257 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:02:54.341567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.343220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.349573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.350280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.351079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.351530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.384615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:02:54.496138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fd1b2d63-435a-4363-9a1e-708cc2d4938d tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 204 len: 0 microversion: 2.1 time: 0.158967 Apr 02 21:02:54.497052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1538/3403] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:02:54 2022] DELETE /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:02:54.505671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-730148897", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:54.518822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:54.529036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:54.531761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:54.532988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c38c06c-f039-445c-904c-1702dc95e238 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.259918 Apr 02 21:02:54.545105 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1866/3404] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:54 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:54.552249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.553321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.559924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.560383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.561300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.561829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.575359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:02:54.718406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:54.728076 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59701775-96f6-4c85-b4b9-c4ea128ef6e0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1477 microversion: 2.1 time: 0.180824 Apr 02 21:02:54.728981 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1867/3405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:54 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:54.829433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:54.830140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:54.847343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.847925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:54.849510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:54.857225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.040281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.051231 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f08b4dd6-f2b0-40ee-b03a-74c6dac6f2b9 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.227242 Apr 02 21:02:55.057897 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1868/3406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:54 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:55.059450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d664c1a4-db6a-44eb-98d9-957be0937062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e6a5e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:55.101720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:02:55.102191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:02:55.102630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:02:55.103047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:02:55.103691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:02:55.118723 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d664c1a4-db6a-44eb-98d9-957be0937062 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.065002 Apr 02 21:02:55.119594 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1869/3407] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:55 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:55.120926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.121591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.122442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.122888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.143480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:02:55.149583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:02:55.165135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:02:55.167685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:02:55.208441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:55.209071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:55.216249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.217054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.218382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55e61779-8796-4c3a-bb8d-2784315e700f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716118 Apr 02 21:02:55.218884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.219721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.224121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1539/3408] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:02:55.229495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c265ecc-acdf-4a32-8817-280bc41c18b2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:55.230138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c265ecc-acdf-4a32-8817-280bc41c18b2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:55.349613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2c265ecc-acdf-4a32-8817-280bc41c18b2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.356797 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c265ecc-acdf-4a32-8817-280bc41c18b2 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1214 microversion: 2.1 time: 0.131347 Apr 02 21:02:55.367944 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1540/3409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:55 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:55.415683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.424130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7bd55023-89ce-4738-a77a-6ae233fe9118 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.219917 Apr 02 21:02:55.424948 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1870/3410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:55 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:55.553421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:55.554409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:55.560931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.562086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.563129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.563867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.747400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:55.749102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:55.753398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.766781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.768738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.770199 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e4fb6afd-37ca-4f49-861a-ea05e170af4d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.221813 Apr 02 21:02:55.771255 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1541/3411] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:55 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:55.778733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.779410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.780566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:55.781298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:55.986193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:55.994933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-013377b5-d639-4eba-8a4c-e98612dd0bc3 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1477 microversion: 2.1 time: 0.253491 Apr 02 21:02:56.001782 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1871/3412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:55 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:02:56.073371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:56.074077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:56.096375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.099467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.104909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.106294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.133474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c58ae6d5-602a-4d73-a4ea-45f6bc0cbd84 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d48f3700>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:56.212139 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c58ae6d5-602a-4d73-a4ea-45f6bc0cbd84 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.083505 Apr 02 21:02:56.213528 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1872/3413] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:56 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:56.375101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:56.375653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:56.383720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.385167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.386152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.386751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.413695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:56.425736 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8a9345d8-8620-4c22-9b88-f6ac6dd3e98f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.358124 Apr 02 21:02:56.437811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1542/3414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:56 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:56.452569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:56.454953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:56.476037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.476530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.477319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.477924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.683410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:56.696135 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bccaa0c8-7195-484d-8d9e-6d4ac43b539e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1266 microversion: 2.1 time: 0.323730 Apr 02 21:02:56.704611 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1873/3415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:56 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:56.791096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:56.792032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:56.803042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.805245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:56.814446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:56.815250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.141327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.170248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.177313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.193248 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-20c1c7ba-7c4e-4e84-8409-a81d2aa02836 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1724 microversion: 2.20 time: 0.406727 Apr 02 21:02:57.194865 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1874/3416] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:56 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:57.216131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:57.218550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:57.238755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.240167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.241989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.242880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.318665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.319139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.319601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lazy-loading 'fault' on Instance uuid 2b99f2dd-ce26-44e6-ba16-847db4006038 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:57.372646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bed37cfaf3c460fa0a378aba8953078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6285976ac47c4791acbf3573297ab5a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.382572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9846ddbe-4fba-4eb0-a6b4-216fdc5207d0 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 200 len: 1312 microversion: 2.1 time: 0.186289 Apr 02 21:02:57.383486 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1875/3417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:57 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:57.390085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a1f84725-f7e2-4f1f-8164-f9aea83d320d req-acff34cb-85aa-4863-9887-cc0da686ad8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b99f2dd-ce26-44e6-ba16-847db4006038", "name": "network-vif-deleted", "tag": "c0e0f613-eb38-41f0-a061-c28be2758291"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:57.400577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a1f84725-f7e2-4f1f-8164-f9aea83d320d req-acff34cb-85aa-4863-9887-cc0da686ad8b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.401059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a1f84725-f7e2-4f1f-8164-f9aea83d320d req-acff34cb-85aa-4863-9887-cc0da686ad8b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.415255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a1f84725-f7e2-4f1f-8164-f9aea83d320d req-acff34cb-85aa-4863-9887-cc0da686ad8b service nova] Creating event network-vif-deleted:c0e0f613-eb38-41f0-a061-c28be2758291 for instance 2b99f2dd-ce26-44e6-ba16-847db4006038 on nch2-master-1 Apr 02 21:02:57.422902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a1f84725-f7e2-4f1f-8164-f9aea83d320d req-acff34cb-85aa-4863-9887-cc0da686ad8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038074 Apr 02 21:02:57.426611 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1876/3418] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:57.433765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e72c6dde-df9b-42ee-b4b9-968e8d387e2b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4ad8940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:57.511807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e72c6dde-df9b-42ee-b4b9-968e8d387e2b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.082249 Apr 02 21:02:57.519426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1877/3419] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:57 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:57.525385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:57.526206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:57.535144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.535636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.536683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.537201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.739627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.750617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.764271 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21bad86a-181f-4af6-9c12-180023db558c tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.243489 Apr 02 21:02:57.765344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed0ce715-a4f2-40b0-b73e-6d10d06d2696 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 1.325835 Apr 02 21:02:57.766430 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1543/3420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:56 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:57.775039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1878/3421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:57 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:57.778004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0d41b4a8-3c20-46b5-96a5-df115bd6eb3d req-9c77d514-51d9-43fb-a774-e5576bb1009e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e26eb0-1631-4bb6-a60d-1c2bb65097b3", "name": "network-vif-plugged", "status": "completed", "tag": "d154e01b-b647-45e1-9f62-4356af6468c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:57.784749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:57.784749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:57.791301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.791766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.792955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.793099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.802848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0d41b4a8-3c20-46b5-96a5-df115bd6eb3d req-9c77d514-51d9-43fb-a774-e5576bb1009e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:57.803344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0d41b4a8-3c20-46b5-96a5-df115bd6eb3d req-9c77d514-51d9-43fb-a774-e5576bb1009e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:57.815483 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0d41b4a8-3c20-46b5-96a5-df115bd6eb3d req-9c77d514-51d9-43fb-a774-e5576bb1009e service nova] Creating event network-vif-plugged:d154e01b-b647-45e1-9f62-4356af6468c4 for instance 01e26eb0-1631-4bb6-a60d-1c2bb65097b3 on nch1-master-1 Apr 02 21:02:57.833921 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0d41b4a8-3c20-46b5-96a5-df115bd6eb3d req-9c77d514-51d9-43fb-a774-e5576bb1009e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066084 Apr 02 21:02:57.834533 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1544/3422] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:57.885810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:57.897942 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-83e04008-039f-44cd-95e1-6ea6e917586e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1272 microversion: 2.1 time: 0.120958 Apr 02 21:02:57.907781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1879/3423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:57 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:58.214883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:58.216052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:58.228150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.230382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.231385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.231987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.388518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:58.399296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:58.406964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:58.407789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:58.408367 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5beca10-7012-413c-b690-350d1c50b15f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1656 microversion: 2.20 time: 0.198375 Apr 02 21:02:58.408759 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1545/3424] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:58 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1656 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:02:58.414858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] [instance: 2b99f2dd-ce26-44e6-ba16-847db4006038] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:58.426307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.427524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.428520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.429787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.461511 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] HTTP exception thrown: Instance 2b99f2dd-ce26-44e6-ba16-847db4006038 could not be found. Apr 02 21:02:58.462552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] Returning 404 to user: Instance 2b99f2dd-ce26-44e6-ba16-847db4006038 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:02:58.464652 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6139b05-d82b-45a2-a6a9-48ee006a1174 tempest-ServersAdminNegativeTestJSON-381565445 tempest-ServersAdminNegativeTestJSON-381565445-project] 10.222.0.18 "GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038" status: 404 len: 111 microversion: 2.1 time: 0.066310 Apr 02 21:02:58.465834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1880/3425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:58 2022] GET /compute/v2.1/servers/2b99f2dd-ce26-44e6-ba16-847db4006038 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:02:58.525463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-15d510f1-2d68-4c18-a3ad-95352adf2ec8 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ef8940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:58.593086 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-15d510f1-2d68-4c18-a3ad-95352adf2ec8 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.071243 Apr 02 21:02:58.593971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1546/3426] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:58 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:58.782894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:58.783530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:58.789323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:58.789551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:58.796225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.796719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.797515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.797962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.812742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.813127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:58.813922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:58.814372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.057414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:59.065933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1967126c-c93f-4ae4-8e05-fc31ed0f1399 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1292 microversion: 2.1 time: 0.287741 Apr 02 21:02:59.077221 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1881/3427] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:58 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1292 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:59.082546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:59.083367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:59.097938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:59.098267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.099077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:59.099531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.199434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:59.211272 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88cb73e5-780b-44b0-b2f0-ac1f2653be78 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.432684 Apr 02 21:02:59.214199 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1547/3428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:58 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:59.225192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-38c67ac7-7bea-4927-87d8-49c8ee734130 req-63a5942a-1720-4657-8dfa-27ce4e6f5d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e92f68-549b-4c9e-bbf9-803500a77d9c", "name": "network-vif-deleted", "tag": "ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:02:59.249609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-38c67ac7-7bea-4927-87d8-49c8ee734130 req-63a5942a-1720-4657-8dfa-27ce4e6f5d0c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:59.250697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-38c67ac7-7bea-4927-87d8-49c8ee734130 req-63a5942a-1720-4657-8dfa-27ce4e6f5d0c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.279102 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-38c67ac7-7bea-4927-87d8-49c8ee734130 req-63a5942a-1720-4657-8dfa-27ce4e6f5d0c service nova] Creating event network-vif-deleted:ff79ac0b-6e8d-4d62-8901-b44d7e4a87c4 for instance a9e92f68-549b-4c9e-bbf9-803500a77d9c on nch1-master-1 Apr 02 21:02:59.291566 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-38c67ac7-7bea-4927-87d8-49c8ee734130 req-63a5942a-1720-4657-8dfa-27ce4e6f5d0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074426 Apr 02 21:02:59.300914 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1548/3429] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:02:59.430858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:59.433979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:02:59.454993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:59.455862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.460356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:59.461206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.496793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:59.509982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df27b502-eb33-4c14-a246-004be495d406 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 0.427254 Apr 02 21:02:59.522636 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1882/3430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:02:59 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:02:59.566031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:02:59.566993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:02:59.567470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lazy-loading 'fault' on Instance uuid a9e92f68-549b-4c9e-bbf9-803500a77d9c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:02:59.606813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c9087089-8c1f-489f-833c-21d467ee9a61 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7daeee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:02:59.649516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:59.667205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:59.674894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:02:59.679085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecf45d0e-747e-47c9-91be-d5ef9903f578 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 200 len: 1370 microversion: 2.20 time: 0.255954 Apr 02 21:02:59.692996 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1549/3431] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:02:59 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:02:59.725121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c9087089-8c1f-489f-833c-21d467ee9a61 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.123365 Apr 02 21:02:59.725730 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1883/3432] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:02:59 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:00.083045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:00.083679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:00.094221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.094791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.095472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.103449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.235595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:00.237531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:00.284541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.290199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.297277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.303484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.620796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:00.643213 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce5b278c-b96b-41d8-9e7f-e39549ede4d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.412108 Apr 02 21:03:00.644003 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1884/3433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:00 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:00.658890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:00.660228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:00.660974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:00.667386 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a4aa68f-4de7-445f-a377-ec77eb6b2d06 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1484 microversion: 2.1 time: 0.589667 Apr 02 21:03:00.667962 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1550/3434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:00 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1484 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:00.685950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:00.688741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.689930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.690578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:00.690742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.691381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.710855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.711037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.715455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.715845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.907725 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-68c050d7-462e-4be3-85dd-88fe3aab73dc tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.225633 Apr 02 21:03:00.909145 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1551/3435] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:03:00 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:00.919457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:00.921370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:00.935114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.937314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.938435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:00.939137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:00.973014 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] HTTP exception thrown: Instance a9e92f68-549b-4c9e-bbf9-803500a77d9c could not be found. Apr 02 21:03:00.973682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Returning 404 to user: Instance a9e92f68-549b-4c9e-bbf9-803500a77d9c could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:00.974712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2417fd86-ca59-4959-833e-7a7c14d2a31c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 404 len: 111 microversion: 2.20 time: 0.064049 Apr 02 21:03:00.980953 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1552/3436] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:00 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:03:00.986660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e66eff1-b49a-4273-b0ac-4e13c7f6a047 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ef8430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:01.042619 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e66eff1-b49a-4273-b0ac-4e13c7f6a047 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.060501 Apr 02 21:03:01.044606 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1553/3437] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:00 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:01.051487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b6d96e9-c5a2-4d01-9e54-2db3cb50b486 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '.version_select at 0x7f54c7e7e790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:01.074941 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b6d96e9-c5a2-4d01-9e54-2db3cb50b486 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82577945" status: 204 len: 0 microversion: 2.20 time: 0.028433 Apr 02 21:03:01.076173 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1554/3438] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82577945 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:03:01.122724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:01.135735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d134d0c-58d4-4c64-8c8d-23a81cda3edf tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 0.490196 Apr 02 21:03:01.145378 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1885/3439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:00 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:01.620347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6b2a2cdc-6a87-4fee-a58f-383d0458588d req-2f38fd01-d357-486f-81be-b0505471a332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace", "tag": "1ff71ce6-8364-4e94-9d55-e369634bb9c0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:01.650877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6b2a2cdc-6a87-4fee-a58f-383d0458588d req-2f38fd01-d357-486f-81be-b0505471a332 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:01.651598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6b2a2cdc-6a87-4fee-a58f-383d0458588d req-2f38fd01-d357-486f-81be-b0505471a332 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:01.665936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:01.668910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:01.682195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:01.683324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:01.685740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:01.686967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:01.695715 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6b2a2cdc-6a87-4fee-a58f-383d0458588d req-2f38fd01-d357-486f-81be-b0505471a332 service nova] Creating event network-changed:1ff71ce6-8364-4e94-9d55-e369634bb9c0 for instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace on nch2-master-1 Apr 02 21:03:01.704303 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6b2a2cdc-6a87-4fee-a58f-383d0458588d req-2f38fd01-d357-486f-81be-b0505471a332 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090129 Apr 02 21:03:01.704992 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1555/3440] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:02.058152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f78f494-ecae-4a73-bb28-ca883e65fb9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ed7e50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:02.126376 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f78f494-ecae-4a73-bb28-ca883e65fb9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.073270 Apr 02 21:03:02.131842 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1556/3441] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:02 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:02.154077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:02.155536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:02.169695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:02.170154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:02.171565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:02.172007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:02.362869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:02.374964 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1fd1589f-eade-4052-9f48-f85cf44b9d31 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.715213 Apr 02 21:03:02.388561 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1886/3442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:01 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:02.589790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:02.602262 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cdad91b8-e397-4860-b501-ab72a79d081f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 0.451429 Apr 02 21:03:02.614558 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1557/3443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:02 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:02.905363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:02.906693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:02.913526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b6c8b4f4-9524-49fb-95c2-f352652bdb0c req-37d0ef2b-e557-4c6e-91ab-ce9c65ecdad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e26eb0-1631-4bb6-a60d-1c2bb65097b3", "tag": "d154e01b-b647-45e1-9f62-4356af6468c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:02.930713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:02.931557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:02.932621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:02.933273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:02.934857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b6c8b4f4-9524-49fb-95c2-f352652bdb0c req-37d0ef2b-e557-4c6e-91ab-ce9c65ecdad3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:02.935963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b6c8b4f4-9524-49fb-95c2-f352652bdb0c req-37d0ef2b-e557-4c6e-91ab-ce9c65ecdad3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:02.965561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b6c8b4f4-9524-49fb-95c2-f352652bdb0c req-37d0ef2b-e557-4c6e-91ab-ce9c65ecdad3 service nova] Creating event network-changed:d154e01b-b647-45e1-9f62-4356af6468c4 for instance 01e26eb0-1631-4bb6-a60d-1c2bb65097b3 on nch1-master-1 Apr 02 21:03:02.981415 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b6c8b4f4-9524-49fb-95c2-f352652bdb0c req-37d0ef2b-e557-4c6e-91ab-ce9c65ecdad3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072942 Apr 02 21:03:02.999491 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1558/3444] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:03.007442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24d1de44-2bbd-49fc-a4a8-cdf7e2daf24d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'create', calling method: .version_select at 0x7f54c7ed7f70>, body: {"keypair": {"name": "tempest-keypair-593430120"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:03.052128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-24d1de44-2bbd-49fc-a4a8-cdf7e2daf24d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:03.068437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-24d1de44-2bbd-49fc-a4a8-cdf7e2daf24d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for user eaa8ffe0235f4759bdb071a51ad51410 and project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:03.215934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:03.232577 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abe09f16-ec9a-45d7-93e2-608f7e6541f8 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1484 microversion: 2.1 time: 0.331950 Apr 02 21:03:03.233649 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1887/3445] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:02 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1484 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:03.266065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-458d0ba1-8e3a-4f19-8bc1-86459eaae4f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4aad670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:03.346472 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-458d0ba1-8e3a-4f19-8bc1-86459eaae4f0 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.095330 Apr 02 21:03:03.353529 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1888/3446] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:03 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:03.396198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:03.396973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:03.407577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:03.408582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:03.409749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:03.410625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:03.515202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-24d1de44-2bbd-49fc-a4a8-cdf7e2daf24d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:03.523403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-24d1de44-2bbd-49fc-a4a8-cdf7e2daf24d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for user eaa8ffe0235f4759bdb071a51ad51410 and project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:03.545870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24d1de44-2bbd-49fc-a4a8-cdf7e2daf24d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.543712 Apr 02 21:03:03.547754 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1559/3447] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 21:03:02 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 547 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:03:03.624729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:03.625815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:03.639134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:03.644945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:03.651643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:03.653075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:03.809069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:03.818059 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06fd6a78-2694-4d1b-9664-bcfde4e3c9b9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.427116 Apr 02 21:03:03.821634 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1889/3448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:03 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:04.361265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd6a2bd2-d523-40e6-91aa-18fc42246a26 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4a14040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:04.434619 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd6a2bd2-d523-40e6-91aa-18fc42246a26 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.077041 Apr 02 21:03:04.443358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1890/3449] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:04 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:04.672201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:04.684335 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31be4cb6-4fe2-4fcc-ab00-24ff1e7dc5db tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 1.064808 Apr 02 21:03:04.688192 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1560/3450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:03 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:04.838286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:04.839226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:04.850714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:04.861224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:04.862356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:04.863063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:05.271172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:05.282864 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d8ed10d-923e-4831-beed-a31a6455f40a tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.446044 Apr 02 21:03:05.283922 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1891/3451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:04 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:05.452386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0d04c3d-a44d-40f9-9bd2-f19713e2ee6e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ed74c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:05.534146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0d04c3d-a44d-40f9-9bd2-f19713e2ee6e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1452 microversion: 2.1 time: 0.090491 Apr 02 21:03:05.535958 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1561/3452] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:05 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:05.705013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:05.705753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:05.749373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:05.750215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:05.751049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:05.753815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:06.156570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:06.166545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60e6e5be-cba4-4276-8e5f-7363d277453c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 0.467040 Apr 02 21:03:06.167813 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1892/3453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:05 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:06.311359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:06.312635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:06.319942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:06.320938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:06.324046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:06.325223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:06.438345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-150519739", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d11c371b-654f-45ff-8edf-711168f9f05b"}], "security_groups": [{"name": "tempest-securitygroup--395691594"}], "key_name": "tempest-keypair-593430120", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:06.513156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:06.521255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-860b1f2e-bd93-4c8c-8e52-7ae03d4ac6c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.220414 Apr 02 21:03:06.521836 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1562/3454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:06 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:06.555098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] validate_networks() for [('d11c371b-654f-45ff-8edf-711168f9f05b', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:03:06.664802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-287484480", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "ef594637-3f90-4a79-a016-a5c5d61ecc4c"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:06.718108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] validate_networks() for [('ef594637-3f90-4a79-a016-a5c5d61ecc4c', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:03:06.945265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:03:06.945775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:03:06.946168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:03:06.946616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:03:06.947036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:03:06.956577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:06.957043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:06.957858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:06.958302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:06.975828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:06.981170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Getting quotas for user eaa8ffe0235f4759bdb071a51ad51410 and project 2a4f1507b69e40c8ace9eac029f1ced2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:06.994029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:03:06.996360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:03:07.044049 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf9c7990-7f33-436f-a0e4-2e2c20cc5044 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.610561 Apr 02 21:03:07.049753 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1893/3455] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 21:03:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 02 21:03:07.049753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d24771f2-4297-4bd2-bb32-38964055a962 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4a88160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.083972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:03:07.084549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:03:07.085255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:03:07.085996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:03:07.086679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:03:07.097943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.098650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.099630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.100286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.103441 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d24771f2-4297-4bd2-bb32-38964055a962 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1461 microversion: 2.1 time: 0.057185 Apr 02 21:03:07.104022 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1894/3456] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1461 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:07.108829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f613f703-2dbe-4e19-bf07-6798bdedc8b5 req-9d4dfc7e-8982-4a6d-bccf-910c44915a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace", "name": "network-vif-plugged", "status": "completed", "tag": "1ff71ce6-8364-4e94-9d55-e369634bb9c0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:07.116942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f613f703-2dbe-4e19-bf07-6798bdedc8b5 req-9d4dfc7e-8982-4a6d-bccf-910c44915a49 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.117397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f613f703-2dbe-4e19-bf07-6798bdedc8b5 req-9d4dfc7e-8982-4a6d-bccf-910c44915a49 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.127839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Getting quotas for project 8431477fcd064f4f8ba2dedbed85b937. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:07.129474 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f613f703-2dbe-4e19-bf07-6798bdedc8b5 req-9d4dfc7e-8982-4a6d-bccf-910c44915a49 service nova] Creating event network-vif-plugged:1ff71ce6-8364-4e94-9d55-e369634bb9c0 for instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace on nch2-master-1 Apr 02 21:03:07.134958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Getting quotas for user 1925c01ee4d94de9a9a2e7d5735fea14 and project 8431477fcd064f4f8ba2dedbed85b937. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:07.135413 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f613f703-2dbe-4e19-bf07-6798bdedc8b5 req-9d4dfc7e-8982-4a6d-bccf-910c44915a49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029338 Apr 02 21:03:07.136064 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1895/3457] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:07.143136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78bcce03-f0b3-47c1-b27b-dcd14d9fc5e5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.144031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-78bcce03-f0b3-47c1-b27b-dcd14d9fc5e5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:07.152142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:03:07.155583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:03:07.214528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-59ff495a-a2f8-49ca-80b0-d316a3f4ff11 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691443 Apr 02 21:03:07.220051 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1563/3458] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:03:07.226654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78bcce03-f0b3-47c1-b27b-dcd14d9fc5e5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.227066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-783005ca-219b-4529-9e48-e1e96c9acd87 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e7e820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.236026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78bcce03-f0b3-47c1-b27b-dcd14d9fc5e5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.237558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78bcce03-f0b3-47c1-b27b-dcd14d9fc5e5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.239187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78bcce03-f0b3-47c1-b27b-dcd14d9fc5e5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1280 microversion: 2.20 time: 0.101579 Apr 02 21:03:07.241048 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1896/3459] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:07.246368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.247195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:07.266173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.267117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.268054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.268701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.289164 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-783005ca-219b-4529-9e48-e1e96c9acd87 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 200 len: 1461 microversion: 2.1 time: 0.072777 Apr 02 21:03:07.290007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1564/3460] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 1461 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:07.296072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6395917-9a9c-4d4e-be82-ea15df4e8013 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.296970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6395917-9a9c-4d4e-be82-ea15df4e8013 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:07.366548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6395917-9a9c-4d4e-be82-ea15df4e8013 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.376939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6395917-9a9c-4d4e-be82-ea15df4e8013 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1217 microversion: 2.1 time: 0.085508 Apr 02 21:03:07.386284 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1565/3461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:07.386284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.386284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:07.389875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.390368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.391483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.392243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.447160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.461982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eade66b2-cca0-485c-bdbc-4a8137e590ea tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 0.219206 Apr 02 21:03:07.462583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1897/3462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:07.542753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.544270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:07.553632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.554720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.555837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.556985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.564985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.582801 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-97b07bdf-ecd6-4a3f-bb9b-a69a76c2846d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1467 microversion: 2.1 time: 0.203833 Apr 02 21:03:07.594621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1566/3463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1467 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:07.599853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1881741249"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:07.601260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:07.608412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.609064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.610022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:07.610638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:07.766839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:07.775646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9eb5094-620f-4267-b791-1bb985d1ac66 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.240081 Apr 02 21:03:07.785205 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1898/3464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:07.910823 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f406c15-1f63-4225-b991-bc3e434c5dd1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "POST /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4/action" status: 202 len: 0 microversion: 2.1 time: 0.314623 Apr 02 21:03:07.911482 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1567/3465] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:03:07 2022] POST /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:03:07.921486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-55de4b1d-79df-4b1d-b701-769a9c0c0034 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d496cf70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:07.970312 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-55de4b1d-79df-4b1d-b701-769a9c0c0034 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.053044 Apr 02 21:03:07.971536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1899/3466] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:07 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:08.261366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:08.262544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:08.269455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.269914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.270697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.271144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.354075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:08.363272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:08.365141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:08.366284 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2c4968a-ed36-4709-8101-d2f61beb3e84 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1332 microversion: 2.20 time: 0.109408 Apr 02 21:03:08.377417 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1568/3467] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:08 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:08.395467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:08.396470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:08.402728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.403665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.404589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.405038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.480251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:08.480900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:08.489434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.495062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.495896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.496532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.497927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:08.506591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06de2deb-f2e7-4aef-8312-f53addae5f9c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1269 microversion: 2.1 time: 0.115794 Apr 02 21:03:08.511335 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1900/3468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:08 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:08.793679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:08.794426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:08.802058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.802762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.803797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:08.804480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:08.821960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:08.830478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-826e8853-0aec-440d-8d01-3868d9bbe086 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1314 microversion: 2.1 time: 0.354838 Apr 02 21:03:08.831167 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1569/3469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:08 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:08.986132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c4085f0-f8df-41f8-bba4-6cb5983fe1f8 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e5a430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:09.035189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:09.039909 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c4085f0-f8df-41f8-bba4-6cb5983fe1f8 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.058938 Apr 02 21:03:09.044622 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7591cbe4-6ae5-47ab-a44d-47c17c5b2fde tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.255335 Apr 02 21:03:09.054808 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1570/3470] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:08 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:09.055693 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1901/3471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:08 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:09.387675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:09.388298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:09.399021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:09.399719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:09.400542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:09.400989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:09.527275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:09.528143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:09.534811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:09.535272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:09.536056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:09.536526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:09.667679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:09.681985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:09.683526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:09.684707 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4897bc8-7aeb-4335-87f0-dd82206dd98f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.303475 Apr 02 21:03:09.685588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1571/3472] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:09 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:03:09.750257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:09.757968 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e3171459-c0fc-4949-80d8-7312a4316177 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.234551 Apr 02 21:03:09.758750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1902/3473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:09 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:09.847551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:09.848704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:09.856054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:09.856720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:09.857509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:09.858120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.028131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ce1fbe9a-15c4-43d8-b79e-e676d1860c41 req-b7eb3cd0-6e51-4428-a13a-39067ad5cc2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac1888d-eac9-4e66-a536-9232652a75ce", "tag": "76286882-7eaa-4a02-bed9-78f11b3e3d7f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:10.043962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ce1fbe9a-15c4-43d8-b79e-e676d1860c41 req-b7eb3cd0-6e51-4428-a13a-39067ad5cc2d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.045248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ce1fbe9a-15c4-43d8-b79e-e676d1860c41 req-b7eb3cd0-6e51-4428-a13a-39067ad5cc2d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.058633 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ce1fbe9a-15c4-43d8-b79e-e676d1860c41 req-b7eb3cd0-6e51-4428-a13a-39067ad5cc2d service nova] Creating event network-changed:76286882-7eaa-4a02-bed9-78f11b3e3d7f for instance eac1888d-eac9-4e66-a536-9232652a75ce on nch1-master-1 Apr 02 21:03:10.065575 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ce1fbe9a-15c4-43d8-b79e-e676d1860c41 req-b7eb3cd0-6e51-4428-a13a-39067ad5cc2d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048026 Apr 02 21:03:10.066643 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1903/3474] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:10.073181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae256746-8948-4bbc-a4ff-9f9d126599a5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7daeaf0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:10.125925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae256746-8948-4bbc-a4ff-9f9d126599a5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.057531 Apr 02 21:03:10.127751 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1904/3475] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:10 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:10.133228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:10.141939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:10.143046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:10.154491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.156721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.159484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.161154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.167231 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42fbc299-c01d-4c03-8e9b-c597ce10db1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1501 microversion: 2.1 time: 0.323356 Apr 02 21:03:10.168759 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1572/3476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:09 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1501 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:10.184909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ece495f1-82ed-4a3f-b803-93b1ea3bf534 req-e17ab938-7c0e-41a8-b2ba-0ea636dcd103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:10.194969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ece495f1-82ed-4a3f-b803-93b1ea3bf534 req-e17ab938-7c0e-41a8-b2ba-0ea636dcd103 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.195710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ece495f1-82ed-4a3f-b803-93b1ea3bf534 req-e17ab938-7c0e-41a8-b2ba-0ea636dcd103 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.210432 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ece495f1-82ed-4a3f-b803-93b1ea3bf534 req-e17ab938-7c0e-41a8-b2ba-0ea636dcd103 service nova] Creating event network-changed:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:03:10.216061 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ece495f1-82ed-4a3f-b803-93b1ea3bf534 req-e17ab938-7c0e-41a8-b2ba-0ea636dcd103 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045494 Apr 02 21:03:10.217840 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1573/3477] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:10.223386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f06ee6b-61f3-4b26-98d6-da955fa25925 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:10.231722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f06ee6b-61f3-4b26-98d6-da955fa25925 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.232562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f06ee6b-61f3-4b26-98d6-da955fa25925 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.261073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f06ee6b-61f3-4b26-98d6-da955fa25925 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Going to try to stop instance {{(pid=136517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:03:10.315752 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f06ee6b-61f3-4b26-98d6-da955fa25925 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace/action" status: 202 len: 0 microversion: 2.1 time: 0.096222 Apr 02 21:03:10.316663 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1574/3478] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:03:10 2022] POST /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:03:10.326914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:10.328107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:10.336182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.336932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.338625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.339553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.478412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:10.487788 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13b48022-c1ae-47ef-b727-a13971a87996 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.358736 Apr 02 21:03:10.488645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1905/3479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:10 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:10.594678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:10.605083 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1a83ae3-8d7d-49e5-b9e4-26722da89673 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.283233 Apr 02 21:03:10.605683 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1575/3480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:10 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:10.704185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:10.705284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:10.712721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.713505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.714508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.715185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.777739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:10.778410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:10.785735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.786289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.787433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:10.787953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:10.985462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:10.995375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:10.996973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:10.998838 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bbb8ce29-9dfa-4121-8d8b-5bd7871d4348 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.298811 Apr 02 21:03:10.999637 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1906/3481] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:10 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:11.049207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:11.058087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cee6bdd-e70a-4b86-a398-0d6ea9ed1be5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.285202 Apr 02 21:03:11.058946 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1576/3482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:10 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:11.140652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7086f25a-7430-43c8-9036-57e8b838591c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4ab8310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:11.210464 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7086f25a-7430-43c8-9036-57e8b838591c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.073673 Apr 02 21:03:11.220385 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1907/3483] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:11 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:11.348819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-98277b2a-9d5f-48d7-aeb4-f29ab85d4a61 req-cc4f2d97-f9eb-445e-a397-52d30be51b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec52e0fc-98cb-4059-b291-a5a9e5987b70", "name": "network-vif-unplugged", "status": "completed", "tag": "6899260a-714f-44f5-b030-a483cf54a670"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:11.360053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-98277b2a-9d5f-48d7-aeb4-f29ab85d4a61 req-cc4f2d97-f9eb-445e-a397-52d30be51b3b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:11.360616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-98277b2a-9d5f-48d7-aeb4-f29ab85d4a61 req-cc4f2d97-f9eb-445e-a397-52d30be51b3b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:11.375252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-98277b2a-9d5f-48d7-aeb4-f29ab85d4a61 req-cc4f2d97-f9eb-445e-a397-52d30be51b3b service nova] Creating event network-vif-unplugged:6899260a-714f-44f5-b030-a483cf54a670 for instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 on nch1-master-1 Apr 02 21:03:11.382430 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-98277b2a-9d5f-48d7-aeb4-f29ab85d4a61 req-cc4f2d97-f9eb-445e-a397-52d30be51b3b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041790 Apr 02 21:03:11.383846 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1577/3484] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:11.505514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:11.506152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:11.513801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:11.514339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:11.515243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:11.515772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:11.626086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:11.626887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:11.633501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:11.634017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:11.634885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:11.635341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:11.681837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:11.689252 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5250fcc4-7c06-4b42-873b-de9b3a8d56d7 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1505 microversion: 2.1 time: 0.188195 Apr 02 21:03:11.689834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1908/3485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:11 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:11.776880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:11.785202 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d513cd4-8e34-425c-9c52-68be5e852775 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.165908 Apr 02 21:03:11.785787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1578/3486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:11 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:12.017129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:12.017750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:12.024350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.024915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.025704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.026218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.075539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:12.076946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:12.083024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.083487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.084267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.084743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.169306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:12.177540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:12.179071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:12.180202 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7aabebe-f749-49c2-a121-078c308e4354 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.167951 Apr 02 21:03:12.180804 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1909/3487] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:12 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:12.227621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-892807a9-2a48-44ca-a3ad-35ae0957212a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e2e3a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:12.227819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:12.236016 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b4b6a50-41d4-4a1a-bbe9-539c5721844f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.164393 Apr 02 21:03:12.236624 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1579/3488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:12 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:12.272077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-892807a9-2a48-44ca-a3ad-35ae0957212a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.048301 Apr 02 21:03:12.272632 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1910/3489] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:12 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:12.706996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:12.707691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:12.714803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.715259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.716036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.716511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.802506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:12.803284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:12.810148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.810707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.811559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:12.812080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:12.850949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:12.859237 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e07a3899-fa49-4919-915d-9056cd4c2de8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1485 microversion: 2.1 time: 0.156905 Apr 02 21:03:12.859841 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1580/3490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:12 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1485 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:12.953318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:12.960955 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5c02bba-627d-4e49-a338-4c1785c55dba tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.162432 Apr 02 21:03:12.961467 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1911/3491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:12 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:13.059587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-523399374", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:13.119516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] validate_networks() for [('15393407-38b0-412f-b2fb-6464d85ff0fe', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:03:13.199467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:13.200109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:13.207362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.207813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.208618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.209052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.356907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:13.365311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:13.366823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:13.368129 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a703ca8-81dc-458d-9be6-c8a2d1813360 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.173044 Apr 02 21:03:13.368753 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1912/3492] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:13 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:03:13.373624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:13.374372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:13.380763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.381316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.382380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.382893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.496242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:03:13.496710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:03:13.497198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:03:13.497615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:03:13.498035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:03:13.508219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.508742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.509549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.509999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.529529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Getting quotas for project ff8ea67a27f74237963a177abd07cc45. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:13.535295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Getting quotas for user f15cc4e52d554c3e9ab441d22453fffd and project ff8ea67a27f74237963a177abd07cc45. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:13.540667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:13.549367 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-44f480d6-7577-4490-b375-941c9b982574 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.179408 Apr 02 21:03:13.550189 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1913/3493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:13 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:13.554985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-63a0845e-fa50-421e-98ee-89acf710fee3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e49820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:13.559818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:03:13.563276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:03:13.600818 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-63a0845e-fa50-421e-98ee-89acf710fee3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.049240 Apr 02 21:03:13.601492 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1914/3494] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:13 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:13.611034 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a1553c87-ae34-4b41-89c6-ad909f693a23 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.556670 Apr 02 21:03:13.612082 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1581/3495] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:03:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:03:13.622476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-386ee5b6-9384-4952-93c9-d79541c9ad7b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:13.623975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-386ee5b6-9384-4952-93c9-d79541c9ad7b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:13.677447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-386ee5b6-9384-4952-93c9-d79541c9ad7b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:13.685605 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-386ee5b6-9384-4952-93c9-d79541c9ad7b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1213 microversion: 2.1 time: 0.067517 Apr 02 21:03:13.686277 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1915/3496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:13 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:13.979218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:13.979803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:13.988476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.988871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:13.989668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:13.990122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.133045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.141351 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-26838f0b-c83f-4622-9cf4-dc92d6da6972 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.166918 Apr 02 21:03:14.142128 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1582/3497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:13 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:14.206797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.207953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:14.216165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.216672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.217491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.218508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.251988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b38aba6-505c-4b5c-953b-343fd059b5d8 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049262 Apr 02 21:03:14.256623 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1916/3498] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:03:14 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:03:14.309656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.310160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:14.316238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.316730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.317508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.317947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.386721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.387340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:14.393963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.394421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.395210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.395652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.561096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.575490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.578169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.581199 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be76699b-2a0c-4deb-9e78-b9c5376b0812 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.198336 Apr 02 21:03:14.582536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1917/3499] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:14 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:03:14.595491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:03:14.597182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.597818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:14.604129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.604800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.605463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.605905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.699972 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6fd732fb-020a-4826-b221-2b32d15d31ec tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 204 len: 0 microversion: 2.1 time: 0.393741 Apr 02 21:03:14.704440 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1583/3500] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:03:14 2022] DELETE /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:14.714045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d885f001-bbf9-43f2-bd0f-ee9cfb5cc982 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7e63160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.759332 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d885f001-bbf9-43f2-bd0f-ee9cfb5cc982 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.053286 Apr 02 21:03:14.766135 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1584/3501] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:14 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:14.767087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.767895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:14.774710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.775069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.775741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.776587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.777173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.790937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf06a4bc-a898-4a6a-b672-cbb0c7f9e85f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.206899 Apr 02 21:03:14.791920 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1918/3502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:14 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:14.804232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:14.805111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:14.811065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.811575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.812508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:14.812952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:14.851921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.860546 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-87458355-8090-4afd-9706-97f064e991ef tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1271 microversion: 2.1 time: 0.098225 Apr 02 21:03:14.861317 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1585/3503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:14 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:14.950175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:14.958596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-535d3f1a-3bb2-4fdc-890c-3d1503338abf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1673 microversion: 2.1 time: 0.165504 Apr 02 21:03:14.959261 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1919/3504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:14 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:15.160948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:15.161656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:15.170242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.170693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.172607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.172607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.433411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:15.445748 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0a9ced62-47fd-4957-9fc8-cad6adb8d668 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.288963 Apr 02 21:03:15.455860 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1586/3505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:15 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:15.599648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:15.600778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:15.608057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.609322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.610873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.611380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.638616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ddfcbc91-d37b-493e-a2df-c15ce5672ef7 req-c5e59e0e-6be6-40bc-ba67-4b39cb9da183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "name": "network-vif-plugged", "status": "completed", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:15.647572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ddfcbc91-d37b-493e-a2df-c15ce5672ef7 req-c5e59e0e-6be6-40bc-ba67-4b39cb9da183 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.648296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ddfcbc91-d37b-493e-a2df-c15ce5672ef7 req-c5e59e0e-6be6-40bc-ba67-4b39cb9da183 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.661986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ddfcbc91-d37b-493e-a2df-c15ce5672ef7 req-c5e59e0e-6be6-40bc-ba67-4b39cb9da183 service nova] Creating event network-vif-plugged:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:03:15.667374 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ddfcbc91-d37b-493e-a2df-c15ce5672ef7 req-c5e59e0e-6be6-40bc-ba67-4b39cb9da183 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Apr 02 21:03:15.668583 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1587/3506] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:15.774808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32fc48bf-23f3-4be6-9ce4-d2fb6556fe71 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ef8af0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:15.788074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:15.798717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:15.801726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:15.807151 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-644d4ca3-35ea-415a-a134-6d3a55a1564f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.210919 Apr 02 21:03:15.808721 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1920/3507] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:15 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:15.816082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:15.817112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:15.825861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.826671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.827767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.828434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.834352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32fc48bf-23f3-4be6-9ce4-d2fb6556fe71 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.063853 Apr 02 21:03:15.834949 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1588/3508] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:15 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:15.878681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:15.879432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:15.894538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.895366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.896394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:15.897120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:15.990172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:15.999147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b76ad02b-926b-41e9-91d3-3a76198b3345 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.189085 Apr 02 21:03:15.999916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1921/3509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:15 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:16.013792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:16.014412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:16.020722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.021200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.021981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.022427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.130620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:16.140562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42e6f83e-1ca5-4fe1-8557-954cf2d6a336 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.265223 Apr 02 21:03:16.141309 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1589/3510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:15 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:16.193902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:16.204240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d1fdcc9-3c3c-4f09-8f02-080247bfd5ab tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1673 microversion: 2.1 time: 0.194291 Apr 02 21:03:16.204853 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1922/3511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:15 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:16.392035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fbbe4769-5394-4a72-a68c-2f459136cf25 req-ee3e79c8-f114-4c40-88f8-a0625e75058a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99317874-e637-442b-a46a-9c7d51b11694", "tag": "fa6dd3f6-e8bf-40c9-bd36-6020d00af7aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:16.401563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fbbe4769-5394-4a72-a68c-2f459136cf25 req-ee3e79c8-f114-4c40-88f8-a0625e75058a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.402020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fbbe4769-5394-4a72-a68c-2f459136cf25 req-ee3e79c8-f114-4c40-88f8-a0625e75058a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.425364 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fbbe4769-5394-4a72-a68c-2f459136cf25 req-ee3e79c8-f114-4c40-88f8-a0625e75058a service nova] Creating event network-changed:fa6dd3f6-e8bf-40c9-bd36-6020d00af7aa for instance 99317874-e637-442b-a46a-9c7d51b11694 on nch2-master-1 Apr 02 21:03:16.430744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fbbe4769-5394-4a72-a68c-2f459136cf25 req-ee3e79c8-f114-4c40-88f8-a0625e75058a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043109 Apr 02 21:03:16.431429 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1590/3512] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:16.463770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:16.464424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:16.471085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.471533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.472301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.472764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.607048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:16.615526 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-333d244d-5c5d-4892-9d06-ed5c7d898956 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.156075 Apr 02 21:03:16.616148 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1923/3513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:16 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:16.826867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:16.828204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:16.835048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.835510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.836299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:16.836776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:16.848084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5c26237-e6eb-46ab-8630-71bf5d0b2bd2 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d47dbf70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:16.899952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5c26237-e6eb-46ab-8630-71bf5d0b2bd2 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.056448 Apr 02 21:03:16.905703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1924/3514] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:16 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:17.016257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:17.017018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:17.023315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.023785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.024605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.025057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.060680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.070900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.072753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.073916 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5041929e-a937-4903-8076-30a5873f4fb9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.251636 Apr 02 21:03:17.074803 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1591/3515] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:16 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:17.158772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:17.159658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:17.165702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.166275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.167160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.167740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.182572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.190755 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ed10ad6-d184-414a-bafc-ceb0ad255d1a tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.179386 Apr 02 21:03:17.191540 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1925/3516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:17 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:17.325230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:17.326097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:17.332630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.333100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.333880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.334331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.429381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.438267 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6580452c-2a16-482b-8dc9-0db3e9e8f1fa tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.283294 Apr 02 21:03:17.460418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1592/3517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:17 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:17.556133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.563992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4814a43c-a6aa-428f-b4c0-f522b8aebf25 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1673 microversion: 2.1 time: 0.346688 Apr 02 21:03:17.564744 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1926/3518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:17 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1673 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:17.634097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:17.634852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:17.642035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.642619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.643469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:17.643982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:17.784273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:17.791715 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0b5f62d-e7c9-4ecc-9123-1cc40c610c6a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.162293 Apr 02 21:03:17.792291 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1593/3519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:17 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:17.913349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-97b04dae-3855-4c35-8b95-d4149fe62a02 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4aad550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:17.960859 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-97b04dae-3855-4c35-8b95-d4149fe62a02 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.051197 Apr 02 21:03:17.961999 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1927/3520] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:17 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:18.093041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:18.093752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:18.100664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.101132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.102163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.102956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.208679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:18.209301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:18.218314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.218783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.219577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.223798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.257404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:18.266632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:18.268251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:18.269559 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ce0b232-d5e6-40f0-a232-958ae87b68d5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.182194 Apr 02 21:03:18.270220 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1594/3521] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:18 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:18.349019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-eadff53d-79c5-4d92-a03d-aca7834ed5cc req-c92592d1-c110-4c53-b72d-2cfac831c336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259abe5f-f848-4966-b186-a747835eab18", "name": "network-vif-deleted", "tag": "f2ea41d2-5537-49e4-98d6-de0eedf3bff6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:18.360910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-eadff53d-79c5-4d92-a03d-aca7834ed5cc req-c92592d1-c110-4c53-b72d-2cfac831c336 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.361396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-eadff53d-79c5-4d92-a03d-aca7834ed5cc req-c92592d1-c110-4c53-b72d-2cfac831c336 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.382226 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-eadff53d-79c5-4d92-a03d-aca7834ed5cc req-c92592d1-c110-4c53-b72d-2cfac831c336 service nova] Creating event network-vif-deleted:f2ea41d2-5537-49e4-98d6-de0eedf3bff6 for instance 259abe5f-f848-4966-b186-a747835eab18 on nch1-master-1 Apr 02 21:03:18.390078 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-eadff53d-79c5-4d92-a03d-aca7834ed5cc req-c92592d1-c110-4c53-b72d-2cfac831c336 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044178 Apr 02 21:03:18.391114 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1595/3522] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:18.438297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:18.455372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa89dab4-c7a8-46e7-828b-77a54e88ce92 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.250586 Apr 02 21:03:18.456087 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1928/3523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:18 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:18.464597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:18.465309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:18.477707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.478327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.479287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.479849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.585955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:18.586913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:18.597494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.598330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.603901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.604795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.644258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.645164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.645787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lazy-loading 'fault' on Instance uuid 259abe5f-f848-4966-b186-a747835eab18 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:03:18.665459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:18.680941 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-95582e8e-002c-4775-aa9d-f1da1be5eaf5 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.220727 Apr 02 21:03:18.682083 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1596/3524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:18 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:18.710112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:18.722681 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4c7d357c-9fc3-453a-bef6-026d97ec69d9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 200 len: 1326 microversion: 2.1 time: 0.141371 Apr 02 21:03:18.723672 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1929/3525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:18 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 1326 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:18.809729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:18.810353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:18.818207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.818991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.819837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:18.820382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:18.978033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ad664a2-a790-48ec-a962-3b213b575dbe tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d47db0d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:19.010587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:19.025042 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd3af37b-6532-400d-be69-59842df53be6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.218373 Apr 02 21:03:19.027792 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1597/3526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:18 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:19.071147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ad664a2-a790-48ec-a962-3b213b575dbe tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.098405 Apr 02 21:03:19.072528 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1930/3527] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:18 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:19.291299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:19.292120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:19.303952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.304827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.305897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.306718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.476267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:19.476935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:19.490683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.491438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.493966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.494792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.527847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:19.539970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:19.544839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:19.546655 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b30f1c89-3eec-4b2e-8796-a7e7e4e48538 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.262100 Apr 02 21:03:19.548527 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1598/3528] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:19 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:19.567207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-521dda78-0692-48c4-b333-9d4ba759dec5 req-5dd03319-06c4-47e8-972d-41fc703c2b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "name": "network-vif-plugged", "status": "completed", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:19.582301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-521dda78-0692-48c4-b333-9d4ba759dec5 req-5dd03319-06c4-47e8-972d-41fc703c2b02 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.583206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-521dda78-0692-48c4-b333-9d4ba759dec5 req-5dd03319-06c4-47e8-972d-41fc703c2b02 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.611453 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-521dda78-0692-48c4-b333-9d4ba759dec5 req-5dd03319-06c4-47e8-972d-41fc703c2b02 service nova] Creating event network-vif-plugged:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:03:19.619374 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-521dda78-0692-48c4-b333-9d4ba759dec5 req-5dd03319-06c4-47e8-972d-41fc703c2b02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054103 Apr 02 21:03:19.620752 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1599/3529] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:19.701960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:19.702820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:19.714012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.716869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.718857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.719354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.756286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:19.767790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf44bbba-cb69-46dd-a4d1-739bc64f44fc tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.296616 Apr 02 21:03:19.768401 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1931/3530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:19 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:19.781917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:19.782550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:19.801974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.802656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.803493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:19.803913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:19.850520 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] HTTP exception thrown: Instance 259abe5f-f848-4966-b186-a747835eab18 could not be found. Apr 02 21:03:19.851405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Returning 404 to user: Instance 259abe5f-f848-4966-b186-a747835eab18 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:19.852431 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c42e1a9-18e9-458e-baf3-b1b539658fd7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 404 len: 111 microversion: 2.1 time: 0.079832 Apr 02 21:03:19.853879 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1932/3531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:19 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:19.864598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2bff5615-a8a8-4e35-ae85-7da91e715584 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '.version_select at 0x7f54d496ca60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:19.898296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2bff5615-a8a8-4e35-ae85-7da91e715584 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429665395" status: 202 len: 0 microversion: 2.1 time: 0.040130 Apr 02 21:03:19.899182 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1933/3532] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429665395 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:03:20.048270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:20.049018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:20.058329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:20.069445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:20.070513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:20.071754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:20.072417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:20.078148 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a003e6e7-3124-452a-ab74-f640b9f995f6 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.382834 Apr 02 21:03:20.078762 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1600/3533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:19 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:20.086038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-821d3e20-a1d5-45ae-9566-56b158e7469e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f7a160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:20.169251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-821d3e20-a1d5-45ae-9566-56b158e7469e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.087152 Apr 02 21:03:20.170811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1601/3534] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:20 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:20.356182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:20.366678 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-460a6c65-faa0-4aac-a4ec-b8c077984d9d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.324255 Apr 02 21:03:20.368728 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1934/3535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:20 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:20.569569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:20.570318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:20.581348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:20.582272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:20.583415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:20.584569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:20.787052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:20.787781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:20.797300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:20.797832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:20.804723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:20.808691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:20.926982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:20.938269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:20.939799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:20.943336 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44e1423c-5826-4558-8b4c-fa4153e15a29 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1405 microversion: 2.20 time: 0.379814 Apr 02 21:03:20.957530 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1602/3536] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:20 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:03:20.986868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c0c87fc-3b18-420c-9888-4723fbb032c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: .version_select at 0x7f54c7f7a040>, body: {"keypair": {"name": "tempest-keypair-419848064"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:21.007604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4c0c87fc-3b18-420c-9888-4723fbb032c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:21.014085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4c0c87fc-3b18-420c-9888-4723fbb032c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for user 449253ed73e04f47bcd09c3a1cca6e8c and project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:21.040397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:21.050438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e2316ef-46dc-4a9c-8cca-f051cf2a5882 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.268076 Apr 02 21:03:21.051429 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1935/3537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:20 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:21.095469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:21.099360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:21.106461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.107203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:21.108247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.109800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:21.201497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4c0c87fc-3b18-420c-9888-4723fbb032c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:21.207191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4c0c87fc-3b18-420c-9888-4723fbb032c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for user 449253ed73e04f47bcd09c3a1cca6e8c and project da03d0fc36de405d87c8e99d209af9fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:21.225188 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c0c87fc-3b18-420c-9888-4723fbb032c6 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.244053 Apr 02 21:03:21.226045 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1603/3538] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:03:20 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:21.230623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-879b43ae-cb93-4d9d-8cb3-6aaf75d422d6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f0f040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:21.277749 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-879b43ae-cb93-4d9d-8cb3-6aaf75d422d6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.050638 Apr 02 21:03:21.278602 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1604/3539] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:21 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:21.317517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:21.326460 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e4357f1-3c56-4b9c-bd4e-903cd12c3365 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.235369 Apr 02 21:03:21.327796 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1936/3540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:21 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:21.385267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:21.386138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:21.398704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.399147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:21.399954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.400694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:21.651197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2160396e-0017-4648-8ee0-56e286391730 req-37aa3693-0bfc-4435-a9d7-d4d71d66992e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac1888d-eac9-4e66-a536-9232652a75ce", "name": "network-vif-plugged", "status": "completed", "tag": "76286882-7eaa-4a02-bed9-78f11b3e3d7f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:21.652682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:21.663745 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-894bcb30-e5d7-41c8-b316-2f6b0acc0acb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.282383 Apr 02 21:03:21.665141 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1605/3541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:21 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:21.674344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2160396e-0017-4648-8ee0-56e286391730 req-37aa3693-0bfc-4435-a9d7-d4d71d66992e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.675401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2160396e-0017-4648-8ee0-56e286391730 req-37aa3693-0bfc-4435-a9d7-d4d71d66992e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:21.690958 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2160396e-0017-4648-8ee0-56e286391730 req-37aa3693-0bfc-4435-a9d7-d4d71d66992e service nova] Creating event network-vif-plugged:76286882-7eaa-4a02-bed9-78f11b3e3d7f for instance eac1888d-eac9-4e66-a536-9232652a75ce on nch1-master-1 Apr 02 21:03:21.697717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2160396e-0017-4648-8ee0-56e286391730 req-37aa3693-0bfc-4435-a9d7-d4d71d66992e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052636 Apr 02 21:03:21.698665 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1937/3542] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:21.966277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:21.966914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:21.977573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.978111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:21.979245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:21.979710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.069900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:22.070814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:22.089060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.089662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.091087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.091595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.204311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:22.216827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:22.219638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:22.220275 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3434958-6a77-4868-b710-6e0c164652e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1598 microversion: 2.20 time: 0.258901 Apr 02 21:03:22.232903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1606/3543] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:03:21 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1598 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:03:22.238566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:22.239067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:22.245719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.246306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.247101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.247543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.341188 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bcbfe30a-f863-475f-9084-39be9ab018aa tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106450 Apr 02 21:03:22.341720 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1607/3544] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Apr 2 21:03:22 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:03:22.352641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5968e36-5f4e-44db-a6e3-a8d45f99ce24 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f7a940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:22.406871 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5968e36-5f4e-44db-a6e3-a8d45f99ce24 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.057955 Apr 02 21:03:22.407469 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1608/3545] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:22 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:22.412090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:22.412756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:22.419295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.419767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.420588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.422177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.515445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:22.526939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f310a695-f2ab-4bb1-8858-ca0da11ca571 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.462426 Apr 02 21:03:22.528916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1938/3546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:22 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:22.656046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:22.665365 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f4c8e7f1-d2aa-4264-a4bb-e24b63f02d5f tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.256485 Apr 02 21:03:22.666482 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1609/3547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:22 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:22.683167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:22.687155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:22.695716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.697301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:22.698409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:22.699599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:23.137312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:23.173557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4aa9252-93a3-4172-b015-b85a8d03c9b6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.495197 Apr 02 21:03:23.174199 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1939/3548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:22 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:23.422460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5356b887-0bb0-484d-b71e-7f0ef7b5bbcb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f10f70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:23.477735 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5356b887-0bb0-484d-b71e-7f0ef7b5bbcb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.061198 Apr 02 21:03:23.478999 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1610/3549] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:23 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:23.546968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:23.547941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:23.557945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:23.558731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:23.559830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:23.560511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:23.685578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:23.687783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:23.695878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:23.696865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:23.698087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:23.698745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:23.917643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:23.931163 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74d0959a-841f-4870-a724-a2af4caff964 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.251688 Apr 02 21:03:23.940231 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1611/3550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:23 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:23.949727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0e684617-0ece-4ff6-a207-7cc11405bdee req-873a5851-3080-4506-a3f2-b37a6f0947ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99317874-e637-442b-a46a-9c7d51b11694", "name": "network-vif-plugged", "status": "completed", "tag": "fa6dd3f6-e8bf-40c9-bd36-6020d00af7aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:23.969860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0e684617-0ece-4ff6-a207-7cc11405bdee req-873a5851-3080-4506-a3f2-b37a6f0947ff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:23.970954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0e684617-0ece-4ff6-a207-7cc11405bdee req-873a5851-3080-4506-a3f2-b37a6f0947ff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:24.006689 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0e684617-0ece-4ff6-a207-7cc11405bdee req-873a5851-3080-4506-a3f2-b37a6f0947ff service nova] Creating event network-vif-plugged:fa6dd3f6-e8bf-40c9-bd36-6020d00af7aa for instance 99317874-e637-442b-a46a-9c7d51b11694 on nch2-master-1 Apr 02 21:03:24.033009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0e684617-0ece-4ff6-a207-7cc11405bdee req-873a5851-3080-4506-a3f2-b37a6f0947ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085570 Apr 02 21:03:24.034887 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1612/3551] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:24.194992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:24.196279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:24.203498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:24.204412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:24.205665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:24.206120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:24.422501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:24.431033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:24.438487 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9e1ba41d-5a0e-4370-b7e6-dd793594da8f tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1317 microversion: 2.1 time: 0.896624 Apr 02 21:03:24.438787 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0109be02-4b01-452b-a8d1-c86bcfe4e6d1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.249605 Apr 02 21:03:24.440500 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1940/3552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:23 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:24.440738 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1613/3553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:24 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:24.492198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-045742ea-e783-4c8c-b8bc-6f5fee2fe436 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d48f3040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:24.548742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-045742ea-e783-4c8c-b8bc-6f5fee2fe436 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.060905 Apr 02 21:03:24.555141 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1941/3554] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:24 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:24.608856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-14753301", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "754f7ab9-bcf9-43d7-b1a5-7e428bb23b29"}], "security_groups": [{"name": "tempest-securitygroup--313732821"}], "key_name": "tempest-keypair-419848064", "user_data": "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:24.765200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] validate_networks() for [('754f7ab9-bcf9-43d7-b1a5-7e428bb23b29', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:03:24.785168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1ddfffce-36de-4c66-8438-6410fab2f5e4 req-83069303-a8bb-43f7-906f-add817c01ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:24.805256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1ddfffce-36de-4c66-8438-6410fab2f5e4 req-83069303-a8bb-43f7-906f-add817c01ab4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:24.805753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1ddfffce-36de-4c66-8438-6410fab2f5e4 req-83069303-a8bb-43f7-906f-add817c01ab4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:24.832302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1ddfffce-36de-4c66-8438-6410fab2f5e4 req-83069303-a8bb-43f7-906f-add817c01ab4 service nova] Creating event network-changed:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:03:24.838721 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1ddfffce-36de-4c66-8438-6410fab2f5e4 req-83069303-a8bb-43f7-906f-add817c01ab4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057790 Apr 02 21:03:24.841648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1942/3555] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:24.962282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:24.965928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:24.983185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:24.984083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:24.987667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:24.989471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.342246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:03:25.343083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:03:25.343567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:03:25.344015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:03:25.344559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:03:25.358898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:25.359693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.360729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:25.361487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.394726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for project da03d0fc36de405d87c8e99d209af9fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:25.404781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Getting quotas for user 449253ed73e04f47bcd09c3a1cca6e8c and project da03d0fc36de405d87c8e99d209af9fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:25.431278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:03:25.433994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:03:25.509210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:25.552889 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f44c29bf-3a9e-45ce-bf5f-58d821f88659 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1313 microversion: 2.1 time: 0.589628 Apr 02 21:03:25.559911 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1943/3556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:24 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:25.591236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:25.595325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:25.614126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:25.618253 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2ed549b-da5c-486f-bf81-38245a562029 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.013849 Apr 02 21:03:25.618881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.619037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1614/3557] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:03:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:03:25.620089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:25.620730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.635922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:25.640783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:25.674035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:25.674511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.686230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:25.687187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:25.979615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:25.989372 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6bf138f2-01ba-44fa-b4db-2992d51cd0e9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.369192 Apr 02 21:03:25.990262 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1615/3558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:25 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:26.005236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b3f6c21-ecbc-4605-84ec-aa16edc2959e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7ecd940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:26.082587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b3f6c21-ecbc-4605-84ec-aa16edc2959e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.081250 Apr 02 21:03:26.089576 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1616/3559] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:25 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:26.095988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ceb3b1a0-a20d-4a66-8c68-b2c782656055 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:26.097369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ceb3b1a0-a20d-4a66-8c68-b2c782656055 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:26.187616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:26.198994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ceb3b1a0-a20d-4a66-8c68-b2c782656055 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:26.199584 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b8de17b-b1e2-479d-8200-0880f85dbff5 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1507 microversion: 2.1 time: 0.638261 Apr 02 21:03:26.200869 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1944/3560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:25 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1507 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:26.211751 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ceb3b1a0-a20d-4a66-8c68-b2c782656055 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1235 microversion: 2.1 time: 0.116652 Apr 02 21:03:26.212796 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1617/3561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:26 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:26.575476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:26.576902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:26.590481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:26.601168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:26.602269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:26.602746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:26.851645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:26.865037 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ddc50867-72b9-4f6b-a305-a3de0ae2d8d4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1499 microversion: 2.1 time: 0.293917 Apr 02 21:03:26.874553 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1945/3562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:26 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1499 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:26.893468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:26.895748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:26.907378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:26.908632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:26.910523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:26.911663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:26.976811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lazy-loading 'flavor' on Instance uuid 99317874-e637-442b-a46a-9c7d51b11694 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:03:27.006906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:27.007619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:27.016840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:27.019274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:27.020376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:27.022120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:27.105909 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02b864da-012d-44a9-803e-0111b954171e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "POST /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694/action" status: 200 len: 32 microversion: 2.1 time: 0.217888 Apr 02 21:03:27.112830 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1618/3563] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:03:26 2022] POST /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:03:27.118865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36718e64-f8f8-442b-a650-05c4cab251b5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7faa550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:27.192885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36718e64-f8f8-442b-a650-05c4cab251b5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.077270 Apr 02 21:03:27.197018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1619/3564] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:27 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:27.202990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:27.204000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:27.219295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:27.220061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:27.221880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:27.222517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:27.350408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:27.361821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67f14080-e74f-4d3e-8bc1-75b6d6fd0c50 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.359351 Apr 02 21:03:27.362524 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1946/3565] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:27 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:27.377378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:27.379704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:27.395176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:27.410766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:27.412194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:27.413587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:27.617495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:27.638853 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e1b02e7-9c54-436f-90fd-aefd57360619 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1295 microversion: 2.1 time: 0.274880 Apr 02 21:03:27.642274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1947/3566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:27 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:27.663731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:27.687131 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3ddf92c-8c46-4eba-ae34-f7490a0b3f0d tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.486605 Apr 02 21:03:27.697708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1620/3567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:27 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:27.996334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8016281-474e-40f1-96a1-36878763ad51"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:27.997920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:28.007882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.012838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.013743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.014204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.221207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e127ede7-3578-4bf2-8c29-b9a2ca94cff2 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7faadc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:28.311161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e127ede7-3578-4bf2-8c29-b9a2ca94cff2 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.103756 Apr 02 21:03:28.311795 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1621/3568] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:28 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:28.381510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:28.382993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:28.397650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.398913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.400419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.401080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.513303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "POST /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518454 Apr 02 21:03:28.515585 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1948/3569] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:03:27 2022] POST /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:28.666100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:28.666942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:28.679451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.680269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.681325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.682295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.786548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:28.797128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:28.807045 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42ab27a4-4e72-4152-bf4a-079fdb32c480 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1293 microversion: 2.1 time: 0.144095 Apr 02 21:03:28.807772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3fc725e-6478-4787-828a-2332f7279308 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.433149 Apr 02 21:03:28.808392 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1622/3570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:28 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:28.809967 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1949/3571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:28 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1293 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:28.827696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:28.828342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:28.835421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.836116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:28.837248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:28.837862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:29.328313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-886b7dd2-2349-4824-8218-b555eb559364 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4733c10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:29.432201 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-886b7dd2-2349-4824-8218-b555eb559364 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.109514 Apr 02 21:03:29.433179 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1950/3572] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:29 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:29.675248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:29.689848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b81774d0-59ed-44f0-a816-4e05915cad67 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.880338 Apr 02 21:03:29.690739 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1623/3573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:28 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:29.831791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:29.832772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:29.837307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:29.837947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:29.861074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:29.867034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:29.868816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:29.869653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:29.870382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:29.871047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:29.872055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:29.874818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:30.190062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:30.202497 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb2adaca-51c0-437d-b5a2-41611a7ea70f tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.378471 Apr 02 21:03:30.229356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1624/3574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:29 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:30.243412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-58e019f0-60e4-43ce-a30f-386b2f4c5db9 req-fce1d0cc-0075-4246-b07f-0695869ee50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38215506-1d7a-4c7d-a1ac-044505a7d57a", "tag": "db837a8b-f891-4234-9834-f700a43fd759"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:30.266808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-58e019f0-60e4-43ce-a30f-386b2f4c5db9 req-fce1d0cc-0075-4246-b07f-0695869ee50e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:30.268049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-58e019f0-60e4-43ce-a30f-386b2f4c5db9 req-fce1d0cc-0075-4246-b07f-0695869ee50e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:30.310375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-58e019f0-60e4-43ce-a30f-386b2f4c5db9 req-fce1d0cc-0075-4246-b07f-0695869ee50e service nova] Creating event network-changed:db837a8b-f891-4234-9834-f700a43fd759 for instance 38215506-1d7a-4c7d-a1ac-044505a7d57a on nch2-master-1 Apr 02 21:03:30.321757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-58e019f0-60e4-43ce-a30f-386b2f4c5db9 req-fce1d0cc-0075-4246-b07f-0695869ee50e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085122 Apr 02 21:03:30.323923 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1625/3575] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:30.349750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:30.365805 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2fc5989e-337f-4517-966e-e80d73883337 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.543089 Apr 02 21:03:30.370138 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1951/3576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:29 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:30.447362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f5c15b58-5237-46db-834c-6a5d185205fb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4d7c820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:30.529247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f5c15b58-5237-46db-834c-6a5d185205fb tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.086697 Apr 02 21:03:30.531087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1626/3577] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:30 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:30.710743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:30.711543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:30.719563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:30.720307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:30.721626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:30.722232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:31.109995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:31.120919 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d81ceb24-1e54-4c39-9958-f2ba1f589e3e tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.416481 Apr 02 21:03:31.121518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1952/3578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:30 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:31.223970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:31.225097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:31.237185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:31.237928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:31.238892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:31.239340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:31.383970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:31.384660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:31.399200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:31.400491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:31.403273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:31.413442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:31.458587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:31.474106 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd31d2a7-e37d-402d-b4c3-3638dcf1802e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.255676 Apr 02 21:03:31.474917 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1627/3579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:31 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:31.543339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37028773-493c-41f2-9b9a-33d42e2211b4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f484c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:31.594361 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37028773-493c-41f2-9b9a-33d42e2211b4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.055022 Apr 02 21:03:31.595447 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1628/3580] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:31 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:31.780858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:31.789902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-faacf01a-1fde-4bc3-b17d-1b8295f19f1a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.410558 Apr 02 21:03:31.790645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1953/3581] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:31 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:32.145474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:32.148162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:32.165967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:32.166855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:32.168328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:32.169046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:32.374982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:32.384615 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56907b0a-6178-49b0-8d87-d497bc6120dc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.250024 Apr 02 21:03:32.385764 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1629/3582] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:32 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:32.491873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:32.493084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:32.501957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:32.503041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:32.504188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:32.505019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:32.608793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6b1e089-3af4-4afd-97db-3e7738a20078 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4d7cf70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:32.669870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6b1e089-3af4-4afd-97db-3e7738a20078 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.065224 Apr 02 21:03:32.672675 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1630/3583] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:32 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:32.742738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:32.758257 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35e8ac8c-0912-4bf6-8295-2042216af974 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.268330 Apr 02 21:03:32.768610 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1954/3584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:32 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:32.809101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:32.809820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:32.826972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:32.827361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:32.828229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:32.828719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.000704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:33.010698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93777ce0-6dd2-49fa-a50a-b60371507aee tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.206270 Apr 02 21:03:33.011411 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1631/3585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:32 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:33.175271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "44dddc33-47aa-495e-b14d-22f047229fdc"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:33.176408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:33.182901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.183383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.184160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.184656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.313366 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] HTTP exception thrown: Volume 44dddc33-47aa-495e-b14d-22f047229fdc could not be found. Apr 02 21:03:33.314010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Returning 400 to user: Volume 44dddc33-47aa-495e-b14d-22f047229fdc could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:33.314874 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4425b12-0fa8-4b9d-9ad0-f7f399603f28 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments/a8016281-474e-40f1-96a1-36878763ad51" status: 400 len: 107 microversion: 2.1 time: 0.200741 Apr 02 21:03:33.315473 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1955/3586] 10.222.0.18 () {60 vars in 1432 bytes} [Sat Apr 2 21:03:33 2022] PUT /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments/a8016281-474e-40f1-96a1-36878763ad51 => generated 107 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:03:33.394285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:33.394869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:33.403015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.403699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.404694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.405887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.406277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:33.406899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:33.422201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.423227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.424929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.429090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.541281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lazy-loading 'services' on Instance uuid eac1888d-eac9-4e66-a536-9232652a75ce {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:03:33.643381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:33.669099 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32f308c6-b6ca-4722-8540-22bd67a5eeb4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.268789 Apr 02 21:03:33.670108 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1956/3587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:33 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:33.677440 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8a14cf3c-b8b3-4c15-944c-feb69183d7de tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments/a8016281-474e-40f1-96a1-36878763ad51" status: 202 len: 0 microversion: 2.1 time: 0.289258 Apr 02 21:03:33.680184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1632/3588] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:03:33 2022] DELETE /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments/a8016281-474e-40f1-96a1-36878763ad51 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:03:33.693863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3a13cc6-8fdf-4f67-ba49-b2ea0af500f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d48c48b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:33.698838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:33.703048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:33.713080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.713606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.714804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.715532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.763841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02851691-41f8-40ff-a960-992d47458eeb tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073216 Apr 02 21:03:33.769129 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1633/3589] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:03:33 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:33.777105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:33.778138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:33.781927 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3a13cc6-8fdf-4f67-ba49-b2ea0af500f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1453 microversion: 2.1 time: 0.101193 Apr 02 21:03:33.787808 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1957/3590] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:33 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:33.794580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.795319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.796555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:33.797153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:33.958269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:33.966777 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07730489-3a2e-4960-93e8-b1c4622c49cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.194893 Apr 02 21:03:33.967445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1634/3591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:33 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:34.028912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.029659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:34.036413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.036920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.037701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.038181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.174000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:34.181502 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-080b33c9-2205-4999-aad8-fb9a7f5def9e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.156940 Apr 02 21:03:34.182110 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1958/3592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:34.686770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.687377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:34.696065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.696648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.697937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.698451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.777339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.778571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:34.786454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.787054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.787941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.790071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.823193 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec9457f4-b86c-42b4-be5d-c2545dd8a0f4 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Apr 02 21:03:34.824187 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1959/3593] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:34.830345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8db594ba-5d74-4f26-8d53-0723c81cf6b4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d496cb80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.866670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:34.878052 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36a5161a-7c97-4d89-afba-79de2bc99261 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.195577 Apr 02 21:03:34.878648 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1635/3594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:34.892164 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8db594ba-5d74-4f26-8d53-0723c81cf6b4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1462 microversion: 2.1 time: 0.066250 Apr 02 21:03:34.892819 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1960/3595] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1462 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:34.906927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5433597-63df-4edc-b0d5-4a8f5e80b533 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7fd4790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.957999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5433597-63df-4edc-b0d5-4a8f5e80b533 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 200 len: 1462 microversion: 2.1 time: 0.056520 Apr 02 21:03:34.958761 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1636/3596] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 1462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:34.971816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.972611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:34.983159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.983540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:34.983864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.984178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:34.984927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.985381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.991211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.992432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:34.993403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:34.993922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.162909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:35.173983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07dbf108-08cb-4609-8e0b-34f88fdbb078 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.194291 Apr 02 21:03:35.174949 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1637/3597] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:35.177222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:35.186860 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f5d12885-f6b8-424d-ae71-775cfbadbe8e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 1468 microversion: 2.1 time: 0.219430 Apr 02 21:03:35.187615 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1961/3598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:34 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 1468 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:35.201668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.202761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:35.210606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:35.211209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.211352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7fe37a6-8af7-4ed0-a8cd-af8e9c6984cd tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4d18ee0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.212249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:35.212848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.319298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a7fe37a6-8af7-4ed0-a8cd-af8e9c6984cd tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?changes-since=2022-04-02T21%3A01%3A50Z" status: 200 len: 1902 microversion: 2.1 time: 0.113444 Apr 02 21:03:35.320411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1962/3599] 10.222.0.18 () {58 vars in 1198 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?changes-since=2022-04-02T21%3A01%3A50Z => generated 1902 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:35.331915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-04236008-c1f9-4d01-9e10-383d65991983 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7dae670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.382304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:35.391394 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8bc23fe-308f-4721-93c5-c29a3be405a9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.194882 Apr 02 21:03:35.391940 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1638/3600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:35.409885 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-04236008-c1f9-4d01-9e10-383d65991983 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1790341586" status: 200 len: 485 microversion: 2.1 time: 0.081525 Apr 02 21:03:35.410405 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1963/3601] 10.222.0.18 () {58 vars in 1230 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1790341586 => generated 485 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:35.423557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca51e849-daf3-4e53-a716-99ccbf8991b1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7faa9d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.521198 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca51e849-daf3-4e53-a716-99ccbf8991b1 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?server=aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 958 microversion: 2.1 time: 0.103130 Apr 02 21:03:35.521877 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1639/3602] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?server=aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 958 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:35.535343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a19ee84-d2df-4b8b-8528-c374af831ccd tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4766550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.588765 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a19ee84-d2df-4b8b-8528-c374af831ccd tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 484 microversion: 2.1 time: 0.057405 Apr 02 21:03:35.589527 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1964/3603] 10.222.0.18 () {58 vars in 1316 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 484 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:35.600655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4edcd56b-36f1-4a08-918a-3f3e759a37e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f7a040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.655482 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4edcd56b-36f1-4a08-918a-3f3e759a37e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 484 microversion: 2.1 time: 0.058324 Apr 02 21:03:35.662757 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1640/3604] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 484 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:35.668441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d935d7c-3235-40fe-861c-456245e3a6bf tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7dae280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.788093 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d935d7c-3235-40fe-861c-456245e3a6bf tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.123959 Apr 02 21:03:35.789004 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1965/3605] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:35.803362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21b1f4e6-66d1-416c-90a6-df15f9a7f45d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7faa1f0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.836150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.837488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:35.844238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:35.844731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.845515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:35.845954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.874087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21b1f4e6-66d1-416c-90a6-df15f9a7f45d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.075776 Apr 02 21:03:35.874673 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1641/3606] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:35.876346 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79dd87e8-87e1-4533-9eee-2a03e23f3121 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044976 Apr 02 21:03:35.876955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1966/3607] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:03:35.886643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-430214f5-35b6-493d-9aa3-061792733b85 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7fd4940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.897575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:35.898417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:35.905888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:35.906331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.907451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:35.907821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:35.943762 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-430214f5-35b6-493d-9aa3-061792733b85 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.060502 Apr 02 21:03:35.944527 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1642/3608] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:35.957417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7d974bd-44f4-4700-9b02-64967348aa9d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f7ae50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.048159 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7d974bd-44f4-4700-9b02-64967348aa9d tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?changes-since=2022-04-02T21%3A01%3A46Z" status: 200 len: 6327 microversion: 2.1 time: 0.094925 Apr 02 21:03:36.059372 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1643/3609] 10.222.0.18 () {58 vars in 1219 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-04-02T21%3A01%3A46Z => generated 6327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:36.066216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-280b008a-dc0f-48f7-b752-bd12ae15547f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7fd4670>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.078031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:36.086991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ccad3fc5-6f8c-46c9-9967-08b6eda4b6c4 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.193978 Apr 02 21:03:36.097881 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1967/3610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:35 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.119723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-280b008a-dc0f-48f7-b752-bd12ae15547f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1790341586" status: 200 len: 665 microversion: 2.1 time: 0.058270 Apr 02 21:03:36.120343 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1644/3611] 10.222.0.18 () {58 vars in 1251 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1790341586 => generated 665 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:36.134321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7962b15b-e123-4317-85f9-90b1da925932 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d47a19d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.189088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7962b15b-e123-4317-85f9-90b1da925932 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1464 microversion: 2.1 time: 0.058821 Apr 02 21:03:36.190080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1968/3612] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1464 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.192741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.193824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:36.200962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:36.201594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:36.203112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:36.203565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:36.204638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a094b4c1-7fbc-4dcf-8116-33786a8c24ff tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4758e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.272448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a094b4c1-7fbc-4dcf-8116-33786a8c24ff tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1464 microversion: 2.1 time: 0.069165 Apr 02 21:03:36.273797 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1969/3613] 10.222.0.18 () {58 vars in 1323 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2Fec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1464 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.289482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26b404b7-e623-445e-930f-7795287b9ba5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d48765e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.374501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:36.374980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26b404b7-e623-445e-930f-7795287b9ba5 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.089261 Apr 02 21:03:36.375634 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1970/3614] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.390562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7d118cd-4234-4265-9633-59b04a7f316d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.202799 Apr 02 21:03:36.390956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1dda79a8-5a20-4be7-8429-c15e90d90faf tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4758ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.391366 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1645/3615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:36.411476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.412373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:36.418743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:36.419423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:36.420232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:36.421594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:36.480869 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1dda79a8-5a20-4be7-8429-c15e90d90faf tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.093057 Apr 02 21:03:36.490540 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1971/3616] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.496235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76bc0265-9568-402c-880e-552df5d4b750 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d492b820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.547670 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76bc0265-9568-402c-880e-552df5d4b750 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/9e007d99-9b87-492c-9398-c1bd6aff27cb" status: 200 len: 784 microversion: 2.1 time: 0.055291 Apr 02 21:03:36.550893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1972/3617] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/9e007d99-9b87-492c-9398-c1bd6aff27cb => generated 784 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:36.561853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1375990-0334-423e-b903-56c3a0808e0e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d46f21f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.595920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:36.605601 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aff1021d-c272-44c1-a11b-a28ca0bb324f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.200005 Apr 02 21:03:36.612501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1646/3618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.612916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5cc20df3-b212-4f88-81f1-55565099a988 req-72529a7b-df92-4b27-a335-a3dc4e77d309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38215506-1d7a-4c7d-a1ac-044505a7d57a", "name": "network-vif-plugged", "status": "completed", "tag": "db837a8b-f891-4234-9834-f700a43fd759"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:36.622002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5cc20df3-b212-4f88-81f1-55565099a988 req-72529a7b-df92-4b27-a335-a3dc4e77d309 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:36.622393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5cc20df3-b212-4f88-81f1-55565099a988 req-72529a7b-df92-4b27-a335-a3dc4e77d309 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:36.622539 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1375990-0334-423e-b903-56c3a0808e0e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.065113 Apr 02 21:03:36.624105 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1973/3619] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 21:03:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:36.636749 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5cc20df3-b212-4f88-81f1-55565099a988 req-72529a7b-df92-4b27-a335-a3dc4e77d309 service nova] Creating event network-vif-plugged:db837a8b-f891-4234-9834-f700a43fd759 for instance 38215506-1d7a-4c7d-a1ac-044505a7d57a on nch2-master-1 Apr 02 21:03:36.637046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee2beeba-c8ff-482a-aee4-21f01ce4209b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54da1dfaf0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:36.641822 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5cc20df3-b212-4f88-81f1-55565099a988 req-72529a7b-df92-4b27-a335-a3dc4e77d309 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Apr 02 21:03:36.642881 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1647/3620] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:37.045249 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee2beeba-c8ff-482a-aee4-21f01ce4209b tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f" status: 204 len: 0 microversion: 2.1 time: 0.412293 Apr 02 21:03:37.046471 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1974/3621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:36 2022] DELETE /compute/v2.1/images/c128d225-90b7-4718-9037-e3ebc3006f5f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:03:37.055620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92984a2e-0610-42ab-b39b-a53f1006cdcf tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d4d7cf70>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:37.105532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:37.106283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:37.112993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.113467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.114254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.114711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.255057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:37.263208 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd0806b0-4fb3-4a1c-9dbf-9a64379eb759 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.161571 Apr 02 21:03:37.273450 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1975/3622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:37 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:37.295520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0e42c72d-7ae4-49bb-b651-7ca2439ae6c1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:37.296576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:37.302696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.303153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.304044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.304592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.354133 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] HTTP exception thrown: Volume 078ab8b7-57ef-4578-8dff-bc758755c84a could not be found. Apr 02 21:03:37.354761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] Returning 404 to user: Volume 078ab8b7-57ef-4578-8dff-bc758755c84a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:37.355616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9c9a725-2f8e-43c3-97cf-a39b5f47a3d8 tempest-VolumesAdminNegativeTest-468857122 tempest-VolumesAdminNegativeTest-468857122-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments/078ab8b7-57ef-4578-8dff-bc758755c84a" status: 404 len: 109 microversion: 2.1 time: 0.064302 Apr 02 21:03:37.356187 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1976/3623] 10.222.0.18 () {60 vars in 1432 bytes} [Sat Apr 2 21:03:37 2022] PUT /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce/os-volume_attachments/078ab8b7-57ef-4578-8dff-bc758755c84a => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:03:37.408074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:37.408715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:37.416496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.417088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.418168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.418464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.537620 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-92984a2e-0610-42ab-b39b-a53f1006cdcf tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764" status: 204 len: 0 microversion: 2.1 time: 0.486153 Apr 02 21:03:37.538263 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1648/3624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:37 2022] DELETE /compute/v2.1/images/742fc26c-cc8e-4a70-a32b-2b948249b764 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:37.547069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1ed90051-33b1-4fac-9ca7-5664f1e2ed30 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7f48430>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:37.610296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:37.621997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36dc9e76-e2e2-4619-af0b-41471fedf522 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1360 microversion: 2.1 time: 0.218555 Apr 02 21:03:37.622544 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1977/3625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:37 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1360 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:37.628304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:37.628953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:37.635442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.635906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.636735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:37.637172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:37.791513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:37.799752 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf21dcf3-83c8-4d57-9db2-e57428aef03e tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.175805 Apr 02 21:03:37.800175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1978/3626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:37 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:38.021990 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1ed90051-33b1-4fac-9ca7-5664f1e2ed30 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b" status: 204 len: 0 microversion: 2.1 time: 0.479216 Apr 02 21:03:38.022573 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1649/3627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:37 2022] DELETE /compute/v2.1/images/814aa695-b826-4a4f-b052-406d028a683b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:03:38.030976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:38.031510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:38.038350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.038802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.039580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.040013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.067282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:03:38.148801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4860dd4c-5a2b-4db5-bdf1-a4b3cfa39bf7 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 204 len: 0 microversion: 2.1 time: 0.121395 Apr 02 21:03:38.149660 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1979/3628] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:03:38 2022] DELETE /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:38.159551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:38.160512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:38.167976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.168809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.169668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.170809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.281734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:38.282471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:38.288430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.288916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.289690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.290131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.306996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:38.314555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36c3b7cc-746e-446f-bdbb-4e6a4a1cf4da tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1473 microversion: 2.1 time: 0.160617 Apr 02 21:03:38.315367 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1650/3629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:38 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1473 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:38.423426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:38.430833 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d52c1a31-7925-4327-9828-375758eed1c9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.154004 Apr 02 21:03:38.431400 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1980/3630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:38 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:38.640349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:38.641059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:38.647426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.647965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.648840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.649357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.675899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-219f822e-e569-446a-acf6-149f7293a1fb req-6e1e5500-0351-47c2-915d-eb4ed8afbc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "name": "network-vif-unplugged", "status": "completed", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:38.687372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-219f822e-e569-446a-acf6-149f7293a1fb req-6e1e5500-0351-47c2-915d-eb4ed8afbc42 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.688279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-219f822e-e569-446a-acf6-149f7293a1fb req-6e1e5500-0351-47c2-915d-eb4ed8afbc42 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.709205 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-219f822e-e569-446a-acf6-149f7293a1fb req-6e1e5500-0351-47c2-915d-eb4ed8afbc42 service nova] Creating event network-vif-unplugged:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:03:38.716843 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-219f822e-e569-446a-acf6-149f7293a1fb req-6e1e5500-0351-47c2-915d-eb4ed8afbc42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046782 Apr 02 21:03:38.719700 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1981/3631] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:38.809867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:38.817842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:38.818901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:38.820130 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acf12f90-a4f7-4b6b-b785-82245935f00a tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1545 microversion: 2.1 time: 0.184242 Apr 02 21:03:38.821189 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1651/3632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:38 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1545 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:38.825678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.826148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.827507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.827954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.838825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:38.839483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:38.847259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.847858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.848821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:38.849427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:38.944827 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b784de50-62d0-41de-b1bf-6271817c6a55 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110495 Apr 02 21:03:38.945458 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1652/3633] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:03:38 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:38.982259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:38.991179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0b3761c-afbb-48a1-ad79-0d0d0c7c73fb tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.177653 Apr 02 21:03:38.991950 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1982/3634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:38 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:39.332172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:39.332978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:39.338927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.339384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.340161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.340641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.449326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:39.449997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:39.458854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.459484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.460869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.461532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.603681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:39.611372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b4ed7ae-fd0c-41b2-8a5a-3f15601a5504 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.167786 Apr 02 21:03:39.612021 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1983/3635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:39 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:39.626485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:39.639631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb9f89e0-398b-412c-a62e-1848da004e9f tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1473 microversion: 2.1 time: 0.308487 Apr 02 21:03:39.644784 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1653/3636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:39 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:39.650429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:39.650946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:39.657866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.658366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.659385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.659860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.685452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:03:39.774499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a4298622-faa0-4853-8f5a-8b65d554d044 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 204 len: 0 microversion: 2.1 time: 0.132838 Apr 02 21:03:39.775671 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1984/3637] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:03:39 2022] DELETE /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:39.785407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:39.786253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:39.792764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.793372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:39.794260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:39.794959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.008537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:40.009433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:40.016754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.017191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.018014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.018514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.094847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:40.105287 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-365ffe62-e01c-48a2-974c-a5aa7e58479c tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1513 microversion: 2.1 time: 0.323997 Apr 02 21:03:40.106144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1654/3638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:39 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:40.173481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:40.180678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-59f74824-a1da-4760-a7bf-7fa11781e7d9 req-f270f16e-0db8-4577-a7cb-ba1b3cfc8b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38215506-1d7a-4c7d-a1ac-044505a7d57a", "tag": "db837a8b-f891-4234-9834-f700a43fd759"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:40.182600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c80ba55a-d2f3-41eb-b84d-69913d880a33 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1511 microversion: 2.1 time: 0.178512 Apr 02 21:03:40.183447 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1985/3639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:40 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:40.190011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-59f74824-a1da-4760-a7bf-7fa11781e7d9 req-f270f16e-0db8-4577-a7cb-ba1b3cfc8b98 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.190678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-59f74824-a1da-4760-a7bf-7fa11781e7d9 req-f270f16e-0db8-4577-a7cb-ba1b3cfc8b98 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.202279 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-59f74824-a1da-4760-a7bf-7fa11781e7d9 req-f270f16e-0db8-4577-a7cb-ba1b3cfc8b98 service nova] Creating event network-changed:db837a8b-f891-4234-9834-f700a43fd759 for instance 38215506-1d7a-4c7d-a1ac-044505a7d57a on nch2-master-1 Apr 02 21:03:40.207207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-59f74824-a1da-4760-a7bf-7fa11781e7d9 req-f270f16e-0db8-4577-a7cb-ba1b3cfc8b98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031468 Apr 02 21:03:40.207805 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1655/3640] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:40.631978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:40.632982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:40.640421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.641754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.642484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.643084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.656706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:40.657520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:40.676320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.676988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.677900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:40.678463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:40.865381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:40.875821 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f4a4c01-029e-444c-8715-80bcc9b36f9e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1473 microversion: 2.1 time: 0.224783 Apr 02 21:03:40.876546 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1656/3641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:40 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1473 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:41.046898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:41.055505 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f6246749-a85a-4531-a186-e981efa4225b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.429293 Apr 02 21:03:41.056256 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1986/3642] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:40 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:41.126471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:41.127702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:41.135795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.136658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.137814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.138248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.200999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:41.202816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:41.209819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.210610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.211745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.212360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.315062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:41.324259 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6d821089-076e-470b-b4f5-529138da408e tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1513 microversion: 2.1 time: 0.202531 Apr 02 21:03:41.324971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1657/3643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:41 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:41.604668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:41.617770 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-432e52a1-ec62-4382-9f2d-bcb8a5eb6460 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1488 microversion: 2.1 time: 0.421012 Apr 02 21:03:41.618486 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1987/3644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:41 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1488 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:41.637859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:41.638638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:41.649190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.649873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.650552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.659942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.705248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:03:41.729410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-da3e4c6f-b52b-44ad-ba04-e990e0e67293 req-2930d851-653d-45e9-90d9-fc2d8acfa0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec52e0fc-98cb-4059-b291-a5a9e5987b70", "name": "network-vif-deleted", "tag": "6899260a-714f-44f5-b030-a483cf54a670"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:41.743787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-da3e4c6f-b52b-44ad-ba04-e990e0e67293 req-2930d851-653d-45e9-90d9-fc2d8acfa0b8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.744679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-da3e4c6f-b52b-44ad-ba04-e990e0e67293 req-2930d851-653d-45e9-90d9-fc2d8acfa0b8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.764926 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-da3e4c6f-b52b-44ad-ba04-e990e0e67293 req-2930d851-653d-45e9-90d9-fc2d8acfa0b8 service nova] Creating event network-vif-deleted:6899260a-714f-44f5-b030-a483cf54a670 for instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 on nch1-master-1 Apr 02 21:03:41.771823 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-da3e4c6f-b52b-44ad-ba04-e990e0e67293 req-2930d851-653d-45e9-90d9-fc2d8acfa0b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049882 Apr 02 21:03:41.772715 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1988/3645] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:41.804397 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f62b052e-8d95-4c7f-ba2c-73ddff3ba948 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 204 len: 0 microversion: 2.1 time: 0.171735 Apr 02 21:03:41.805214 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1658/3646] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:03:41 2022] DELETE /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:41.815737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:41.816535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:41.824030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.824531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.825321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.825815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.894321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:41.895043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:41.901119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.901585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.902761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.903514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.937751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:41.938234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:41.938931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lazy-loading 'fault' on Instance uuid ec52e0fc-98cb-4059-b291-a5a9e5987b70 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:03:41.991654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:42.002208 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2de74594-be53-414c-9a8c-291bd2913b67 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 200 len: 1308 microversion: 2.1 time: 0.112979 Apr 02 21:03:42.003097 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1659/3647] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:41 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:42.065305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:42.073898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:42.074524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:42.075182 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d1e326d1-de1f-4264-b709-b9cd82a26ab1 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1494 microversion: 2.1 time: 0.265040 Apr 02 21:03:42.075836 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1989/3648] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:41 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1494 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:42.085885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:42.085885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:42.085885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:42.085885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:42.283112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:42.292666 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aaa1c30a-c010-419b-ae0a-7cb126dd25b2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.222927 Apr 02 21:03:42.293290 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1660/3649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:42 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:42.344774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:42.345388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:42.352149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:42.352696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:42.353486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:42.354039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:42.589301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1925c01ee4d94de9a9a2e7d5735fea14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8431477fcd064f4f8ba2dedbed85b937', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:42.597437 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f74a7749-50dd-4290-8619-b8341a917faf tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 200 len: 1513 microversion: 2.1 time: 0.256879 Apr 02 21:03:42.598048 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1990/3650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:42 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:43.021236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:43.022672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: ec52e0fc-98cb-4059-b291-a5a9e5987b70] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:43.031371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.031840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.032672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.033124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.048982 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] HTTP exception thrown: Instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 could not be found. Apr 02 21:03:43.049639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Returning 404 to user: Instance ec52e0fc-98cb-4059-b291-a5a9e5987b70 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:43.050600 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e33e4727-ef43-48d5-973f-fe86a3f63a06 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70" status: 404 len: 111 microversion: 2.1 time: 0.033871 Apr 02 21:03:43.051221 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1661/3651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:43 2022] GET /compute/v2.1/servers/ec52e0fc-98cb-4059-b291-a5a9e5987b70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:43.059674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:43.060281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:43.069821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.070303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.071090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.071707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.094725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:43.095748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:43.102267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.102875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.103769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.104264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.105927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:03:43.201308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56e814e3-aa46-42e8-be18-06b28aa2490e tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 204 len: 0 microversion: 2.1 time: 0.145314 Apr 02 21:03:43.202658 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1991/3652] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:03:43 2022] DELETE /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:43.211582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:43.212544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:43.219642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.220111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.220966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.221428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.276696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:43.286982 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc716829-570c-4d3c-b7fb-e56db8f1f278 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1494 microversion: 2.1 time: 0.196927 Apr 02 21:03:43.287857 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1662/3653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:43 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1494 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:43.311412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:43.312170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:43.319557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.320051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.320924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.321492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.472730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:43.483081 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a426d104-8827-4b44-bd9d-749f1ce485f6 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 1474 microversion: 2.1 time: 0.275542 Apr 02 21:03:43.483678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:43.484289 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1992/3654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:43 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 1474 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:43.492115 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45ea3ad4-a4d9-4d26-ab4c-1adec2907dbc tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.185481 Apr 02 21:03:43.493025 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1663/3655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:43 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:43.616278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:43.616977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] [instance: eac1888d-eac9-4e66-a536-9232652a75ce] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:43.624038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.624619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.625416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.625909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.640873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] HTTP exception thrown: Instance eac1888d-eac9-4e66-a536-9232652a75ce could not be found. Apr 02 21:03:43.641482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] Returning 404 to user: Instance eac1888d-eac9-4e66-a536-9232652a75ce could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:43.642334 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-907c95f9-c0dc-49f5-86ec-2f5ec3503d68 tempest-VolumesAdminNegativeTest-1843338013 tempest-VolumesAdminNegativeTest-1843338013-project] 10.222.0.18 "GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce" status: 404 len: 111 microversion: 2.1 time: 0.030206 Apr 02 21:03:43.643281 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1993/3656] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:43 2022] GET /compute/v2.1/servers/eac1888d-eac9-4e66-a536-9232652a75ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:43.806429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d1f76916-a634-480c-8674-c7478b0f3df6 req-bd408cc6-0959-4160-a6a2-a37cd32d7a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac1888d-eac9-4e66-a536-9232652a75ce", "name": "network-vif-deleted", "tag": "76286882-7eaa-4a02-bed9-78f11b3e3d7f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:43.816862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d1f76916-a634-480c-8674-c7478b0f3df6 req-bd408cc6-0959-4160-a6a2-a37cd32d7a5e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:43.817639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d1f76916-a634-480c-8674-c7478b0f3df6 req-bd408cc6-0959-4160-a6a2-a37cd32d7a5e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:43.835188 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d1f76916-a634-480c-8674-c7478b0f3df6 req-bd408cc6-0959-4160-a6a2-a37cd32d7a5e service nova] Creating event network-vif-deleted:76286882-7eaa-4a02-bed9-78f11b3e3d7f for instance eac1888d-eac9-4e66-a536-9232652a75ce on nch1-master-1 Apr 02 21:03:43.842096 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d1f76916-a634-480c-8674-c7478b0f3df6 req-bd408cc6-0959-4160-a6a2-a37cd32d7a5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041157 Apr 02 21:03:43.843374 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1664/3657] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:44.304553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:44.305173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:44.314373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.314929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.315779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.316394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.360789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.361613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.361837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lazy-loading 'fault' on Instance uuid e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:03:44.413713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:44.422519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa236fad-d4ac-4f92-a329-a239bcb90160 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 200 len: 1304 microversion: 2.1 time: 0.122164 Apr 02 21:03:44.423148 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1994/3658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:44 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:44.518386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:44.521035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:44.524618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:44.525250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:44.534588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.535048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.536078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.536983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.537179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.537709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.538682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:44.539675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:44.694839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:44.704358 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d05e3de0-55ee-44d0-ba3c-f7e654916c1c tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 1474 microversion: 2.1 time: 0.189292 Apr 02 21:03:44.705324 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1995/3659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:44 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:44.795481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:44.804343 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21107cda-1e2c-4d1e-ba4a-08dd26cc225c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.297738 Apr 02 21:03:44.805037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1665/3660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:44 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:45.460421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:45.461075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:45.483126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:45.483647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:45.484798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:45.495864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:45.516481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace could not be found. Apr 02 21:03:45.517249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:45.518115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5960a98-ae3f-4060-a5c8-be6f21491121 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 404 len: 111 microversion: 2.1 time: 0.080595 Apr 02 21:03:45.518902 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1996/3661] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:45 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:45.659788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1400287759", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "0579e432-6dc2-4773-9b49-bc1eb8621629"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:45.726382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:45.727860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:45.734069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] validate_networks() for [('0579e432-6dc2-4773-9b49-bc1eb8621629', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:03:45.736755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:45.737507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:45.738496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:45.739384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:46.063783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e687099ccfe4d6fbeca88231424699a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434a8950c15b4a96a46ed0f64c87c417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:46.076247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-53029b1c-14ea-4a20-8baf-df1c221b5cad tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 200 len: 1474 microversion: 2.1 time: 0.356407 Apr 02 21:03:46.087511 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1997/3662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:45 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 1474 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:46.095079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:46.095922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:46.103691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:46.105254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:46.106345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:46.107249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:46.235203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:03:46.235755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:03:46.236266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:03:46.237369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:03:46.239107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:03:46.250711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:46.251270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:46.252355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:46.253046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:46.273813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:03:46.282455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Getting quotas for user 3dfe516204634bdd902f2e1236d7a6ec and project 67592663633d4cd89aed8f728fd7ca86. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:03:46.299681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:03:46.302285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:03:46.318988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:46.333736 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-058f08a2-06f8-410a-9d54-f9633b25ccb8 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.243767 Apr 02 21:03:46.334849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1998/3663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:46 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:46.341312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-343c859e-e4e7-4a1f-ac68-73c6796121a2 req-f8847f4a-8aa6-4557-8dd3-f9c57bb5cedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace", "name": "network-vif-deleted", "tag": "1ff71ce6-8364-4e94-9d55-e369634bb9c0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:46.351053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-343c859e-e4e7-4a1f-ac68-73c6796121a2 req-f8847f4a-8aa6-4557-8dd3-f9c57bb5cedb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:46.351389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-343c859e-e4e7-4a1f-ac68-73c6796121a2 req-f8847f4a-8aa6-4557-8dd3-f9c57bb5cedb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:46.364114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-343c859e-e4e7-4a1f-ac68-73c6796121a2 req-f8847f4a-8aa6-4557-8dd3-f9c57bb5cedb service nova] Creating event network-vif-deleted:1ff71ce6-8364-4e94-9d55-e369634bb9c0 for instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace on nch2-master-1 Apr 02 21:03:46.369650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-343c859e-e4e7-4a1f-ac68-73c6796121a2 req-f8847f4a-8aa6-4557-8dd3-f9c57bb5cedb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Apr 02 21:03:46.370375 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 1999/3664] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:46.375548 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86b6ca79-a2f0-4311-b3d9-f30369a409b7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720110 Apr 02 21:03:46.376200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1666/3665] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:03:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:03:46.387315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54f668f1-014a-48f9-800c-479224ec535f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:46.388437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54f668f1-014a-48f9-800c-479224ec535f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:46.479835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-54f668f1-014a-48f9-800c-479224ec535f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:46.489197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54f668f1-014a-48f9-800c-479224ec535f tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1215 microversion: 2.1 time: 0.106744 Apr 02 21:03:46.491042 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2000/3666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:46 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:47.094512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:47.096070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] [instance: aa959ba1-e51a-4333-998b-723a9c17a1a4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:47.109923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:47.110734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:47.112353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:47.113134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:47.129647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] HTTP exception thrown: Instance aa959ba1-e51a-4333-998b-723a9c17a1a4 could not be found. Apr 02 21:03:47.130621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Returning 404 to user: Instance aa959ba1-e51a-4333-998b-723a9c17a1a4 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:47.131446 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23fd52ca-1c97-46e1-928c-f5a15db840e3 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4" status: 404 len: 111 microversion: 2.1 time: 0.041879 Apr 02 21:03:47.132204 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1667/3667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:47 2022] GET /compute/v2.1/servers/aa959ba1-e51a-4333-998b-723a9c17a1a4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:47.141792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed634b78-48ff-4da8-b787-f5cd8e9bd26a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d45f11f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:47.361532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:47.362320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:47.369297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:47.369764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:47.370948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:47.371411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:47.662770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:47.673151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-001641ba-962e-47f6-acd2-faa2d95dc4e0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.316205 Apr 02 21:03:47.674394 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1668/3668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:47 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:47.679750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:47.680644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:47.687086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:47.687800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:47.688672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:47.689156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:47.745122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed634b78-48ff-4da8-b787-f5cd8e9bd26a tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/images/0ccd78fb-63d8-4efe-94a4-c138d12e835e" status: 204 len: 0 microversion: 2.1 time: 0.607956 Apr 02 21:03:47.746392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2001/3669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:47 2022] DELETE /compute/v2.1/images/0ccd78fb-63d8-4efe-94a4-c138d12e835e => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:47.771074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85ddd39e-7743-46ce-8668-daec5158ade4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54d48761f0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:47.788427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:47.799745 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a1e2c608-f309-47f2-829a-f074ddfac35c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1285 microversion: 2.1 time: 0.123993 Apr 02 21:03:47.810160 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1669/3670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:47 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:48.071470 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85ddd39e-7743-46ce-8668-daec5158ade4 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/images/e06a8a05-cb7b-4012-92d1-4c0db8e95841" status: 204 len: 0 microversion: 2.1 time: 0.319577 Apr 02 21:03:48.073212 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2002/3671] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:47 2022] DELETE /compute/v2.1/images/e06a8a05-cb7b-4012-92d1-4c0db8e95841 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:03:48.088178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b431266-0348-4aa1-9da3-caf447c07b09 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] Calling method '.version_select at 0x7f54c7fbe790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:48.387175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-553e9626-076a-418d-abe1-9db9b87bf9cc req-359a0d6a-180a-42a2-9c18-4fbe3234f3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa959ba1-e51a-4333-998b-723a9c17a1a4", "name": "network-vif-deleted", "tag": "09b2da71-53de-4a86-a10f-8df6fc7762bd"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:48.404753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-553e9626-076a-418d-abe1-9db9b87bf9cc req-359a0d6a-180a-42a2-9c18-4fbe3234f3df service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:48.406747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-553e9626-076a-418d-abe1-9db9b87bf9cc req-359a0d6a-180a-42a2-9c18-4fbe3234f3df service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:48.432251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b431266-0348-4aa1-9da3-caf447c07b09 tempest-ListImageFiltersTestJSON-529599722 tempest-ListImageFiltersTestJSON-529599722-project] 10.222.0.18 "DELETE /compute/v2.1/images/d96dddb2-c538-4a44-bf6f-192947a316a8" status: 204 len: 0 microversion: 2.1 time: 0.354087 Apr 02 21:03:48.432966 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-553e9626-076a-418d-abe1-9db9b87bf9cc req-359a0d6a-180a-42a2-9c18-4fbe3234f3df service nova] Creating event network-vif-deleted:09b2da71-53de-4a86-a10f-8df6fc7762bd for instance aa959ba1-e51a-4333-998b-723a9c17a1a4 on nch1-master-1 Apr 02 21:03:48.437285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1670/3672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:48 2022] DELETE /compute/v2.1/images/d96dddb2-c538-4a44-bf6f-192947a316a8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:03:48.457964 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-553e9626-076a-418d-abe1-9db9b87bf9cc req-359a0d6a-180a-42a2-9c18-4fbe3234f3df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075702 Apr 02 21:03:48.463829 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2003/3673] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:03:48.692053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:48.693419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:48.701447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:48.702063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:48.703018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:48.703609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:48.821011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:48.821856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:48.837882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:48.838717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:48.839838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:48.840593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:49.053152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:49.069905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6d0610c2-e93b-448a-8165-800fa3b0a864 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.382615 Apr 02 21:03:49.080400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1671/3674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:48 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:49.271424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:49.293799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60b3e83b-954b-4a3b-b811-54a346312361 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.478297 Apr 02 21:03:49.309099 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2004/3675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:48 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:50.087241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:50.087945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:50.100290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.100888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.101564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.102018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.316810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:50.318385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:50.328897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.329655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.331136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.332273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.425272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:50.434739 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e044ded-d2f6-4b3e-9760-63dc9eb25f9c tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.351394 Apr 02 21:03:50.435824 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1672/3676] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:50 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:50.483017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-924dd151-e428-4ac1-9ec3-7f892262221a req-f4dde4ad-4e91-4bf1-b5a1-363fa13c76db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f", "tag": "eec90799-94e8-418d-8658-ab70f2f3ade1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:50.495542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-924dd151-e428-4ac1-9ec3-7f892262221a req-f4dde4ad-4e91-4bf1-b5a1-363fa13c76db service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.497035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-924dd151-e428-4ac1-9ec3-7f892262221a req-f4dde4ad-4e91-4bf1-b5a1-363fa13c76db service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.518578 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-924dd151-e428-4ac1-9ec3-7f892262221a req-f4dde4ad-4e91-4bf1-b5a1-363fa13c76db service nova] Creating event network-changed:eec90799-94e8-418d-8658-ab70f2f3ade1 for instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f on nch1-master-1 Apr 02 21:03:50.529330 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-924dd151-e428-4ac1-9ec3-7f892262221a req-f4dde4ad-4e91-4bf1-b5a1-363fa13c76db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050526 Apr 02 21:03:50.533947 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1673/3677] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:50.636172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:50.650126 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31c41b78-6354-4166-9a9b-fb1b93e92816 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.340713 Apr 02 21:03:50.651307 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2005/3678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:50 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:50.858639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a320416-8a9e-4ed3-a898-54a14a41ae12 tempest-AbsoluteLimitsTestJSON-1577827344 tempest-AbsoluteLimitsTestJSON-1577827344-project] Calling method '.version_select at 0x7f54d49ad9d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:50.871201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a320416-8a9e-4ed3-a898-54a14a41ae12 tempest-AbsoluteLimitsTestJSON-1577827344 tempest-AbsoluteLimitsTestJSON-1577827344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.871667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a320416-8a9e-4ed3-a898-54a14a41ae12 tempest-AbsoluteLimitsTestJSON-1577827344 tempest-AbsoluteLimitsTestJSON-1577827344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.872705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a320416-8a9e-4ed3-a898-54a14a41ae12 tempest-AbsoluteLimitsTestJSON-1577827344 tempest-AbsoluteLimitsTestJSON-1577827344-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:50.873939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a320416-8a9e-4ed3-a898-54a14a41ae12 tempest-AbsoluteLimitsTestJSON-1577827344 tempest-AbsoluteLimitsTestJSON-1577827344-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:50.902046 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a320416-8a9e-4ed3-a898-54a14a41ae12 tempest-AbsoluteLimitsTestJSON-1577827344 tempest-AbsoluteLimitsTestJSON-1577827344-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.238259 Apr 02 21:03:50.902757 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1674/3679] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Apr 2 21:03:50 2022] GET /compute/v2.1/limits => generated 511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:51.466355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:51.468326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:51.477655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:51.478333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:51.479353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:51.480642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:51.668644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:51.669656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:51.677159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:51.678018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:51.678911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:51.679607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:51.809729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:51.824831 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b63702cb-287b-4873-be07-438e18ac0179 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.373729 Apr 02 21:03:51.828878 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2006/3680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:51 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:52.020508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:52.030962 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a005d0b-226a-4f4e-9f69-81d4fe99f190 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.366354 Apr 02 21:03:52.041558 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1675/3681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:51 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:52.847297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:52.857141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:52.869667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:52.871784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:52.873527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:52.874034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:53.048995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:53.050771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:53.062736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:53.063458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:53.069027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:53.069709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:53.479731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:53.487700 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6617045e-724d-4300-b8b1-a15e1f87b88b tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.443096 Apr 02 21:03:53.490743 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1676/3682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:53 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:53.563711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:53.577579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a3a2541-cf12-423c-b4fe-d734070c1288 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.735624 Apr 02 21:03:53.578327 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2007/3683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:52 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:53.703357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-119b38cc-9a0c-4b59-aa6a-7e1957877983 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] Calling method '.version_select at 0x7f54c7fbe8b0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:53.791042 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-119b38cc-9a0c-4b59-aa6a-7e1957877983 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.290836 Apr 02 21:03:53.795657 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1677/3684] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 21:03:53 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:03:53.807491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ec3af72-517b-4c51-8852-fbabde6326e1 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] Action: 'create', calling method: .version_select at 0x7f54c7e493a0>, body: {"pool": "non_exist_pool"} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:53.884895 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6ec3af72-517b-4c51-8852-fbabde6326e1 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] HTTP exception thrown: Floating IP pool not found. Apr 02 21:03:53.886210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ec3af72-517b-4c51-8852-fbabde6326e1 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] Returning 404 to user: Floating IP pool not found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:53.887742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ec3af72-517b-4c51-8852-fbabde6326e1 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.085308 Apr 02 21:03:53.890572 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2008/3685] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 21:03:53 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:03:53.900079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed51e63e-ba0a-4744-9896-989df9871521 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] Calling method '.version_select at 0x7f54d4061820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:54.011156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG neutronclient.v2_0.client [None req-ed51e63e-ba0a-4744-9896-989df9871521 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5d74032d-1a54-4c01-8a04-abdd46a1a058 could not be found", "detail": ""}} {{(pid=136517) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 02 21:03:54.012073 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ed51e63e-ba0a-4744-9896-989df9871521 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] HTTP exception thrown: Floating IP not found for ID 5d74032d-1a54-4c01-8a04-abdd46a1a058 Apr 02 21:03:54.012765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed51e63e-ba0a-4744-9896-989df9871521 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] Returning 404 to user: Floating IP not found for ID 5d74032d-1a54-4c01-8a04-abdd46a1a058 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:03:54.015224 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed51e63e-ba0a-4744-9896-989df9871521 tempest-FloatingIPsNegativeTestJSON-373600809 tempest-FloatingIPsNegativeTestJSON-373600809-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/5d74032d-1a54-4c01-8a04-abdd46a1a058" status: 404 len: 111 microversion: 2.1 time: 0.120461 Apr 02 21:03:54.016787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1678/3686] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:03:53 2022] DELETE /compute/v2.1/os-floating-ips/5d74032d-1a54-4c01-8a04-abdd46a1a058 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:03:54.507127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:54.507739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:54.515126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:54.515583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:54.516356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:54.516828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:54.597598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:54.598219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:54.605905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:54.606586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:54.607562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:54.608007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:54.671832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:54.681500 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d850b599-3024-4699-a69c-7b4ddff17bd8 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.178277 Apr 02 21:03:54.682097 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2009/3687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:54 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:54.906289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:54.916247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7155b960-3fae-4863-967a-de08cb9887ca tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.325151 Apr 02 21:03:54.931292 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1679/3688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:54 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:55.699197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:55.699986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:55.715714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:55.716269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:55.719550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:55.720031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:55.941708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:55.942357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:55.969598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:55.972213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:55.973342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:55.975095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:55.986446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:55.997888 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28636fd8-ca99-4ec6-8fe9-0972c64e4d3c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.302337 Apr 02 21:03:55.998592 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2010/3689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:55 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:56.256196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-167fef0d-222b-49af-8317-89f107e866fe req-34704695-7186-4cfe-b8f8-51c11ca15566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f", "name": "network-vif-plugged", "status": "completed", "tag": "eec90799-94e8-418d-8658-ab70f2f3ade1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:56.273548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-167fef0d-222b-49af-8317-89f107e866fe req-34704695-7186-4cfe-b8f8-51c11ca15566 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:56.274725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-167fef0d-222b-49af-8317-89f107e866fe req-34704695-7186-4cfe-b8f8-51c11ca15566 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:56.291389 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-167fef0d-222b-49af-8317-89f107e866fe req-34704695-7186-4cfe-b8f8-51c11ca15566 service nova] Creating event network-vif-plugged:eec90799-94e8-418d-8658-ab70f2f3ade1 for instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f on nch1-master-1 Apr 02 21:03:56.298077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-167fef0d-222b-49af-8317-89f107e866fe req-34704695-7186-4cfe-b8f8-51c11ca15566 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045742 Apr 02 21:03:56.299236 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2011/3690] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:03:56.554270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:56.576795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13d8c73d-5d28-416e-bd34-665ef0dbdb2b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.640867 Apr 02 21:03:56.577651 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1680/3691] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:55 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:57.016852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:57.018696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:57.032706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:57.038940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:57.040137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:57.040727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:57.500940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:57.512386 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-948750c0-af81-46af-a26f-d6d42e266ffd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1315 microversion: 2.1 time: 0.500793 Apr 02 21:03:57.514652 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2012/3692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:57 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:57.597863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:57.599248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:57.611530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:57.614458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:57.615715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:57.616581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:58.119161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:58.136116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad80f801-57cd-46d4-a18c-534c816f26b0 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.544541 Apr 02 21:03:58.138735 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1681/3693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:57 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:58.531663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:58.532479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:58.549550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:58.550179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:58.550994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:58.552710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.005633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:59.015971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2d8785bf-64df-4313-8097-81bbfcc0a669 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1502 microversion: 2.1 time: 0.487755 Apr 02 21:03:59.018506 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2013/3694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:58 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1502 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:03:59.046504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:03:59.047902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:59.088268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:59.089053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.092760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:59.093303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.156843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:59.157714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:59.176431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:59.177489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.180070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:59.180670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.200700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lazy-loading 'flavor' on Instance uuid 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:03:59.308994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d58639f-62a4-421c-9d4a-b128a81d3f9a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "POST /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f/action" status: 202 len: 0 microversion: 2.1 time: 0.271431 Apr 02 21:03:59.312701 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1682/3695] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:03:59 2022] POST /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:03:59.343468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:03:59.344524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:03:59.365631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:59.366571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.367592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:03:59.368292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:03:59.598095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:59.612159 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-666e37d5-fa99-4e08-93c7-53b50dcfc339 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.460307 Apr 02 21:03:59.626409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2014/3696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:59 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:03:59.726055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:03:59.738421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35dbcbac-182b-4f1e-a63e-7afab5d4bfae tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1510 microversion: 2.1 time: 0.410557 Apr 02 21:03:59.739336 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1683/3697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:03:59 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:00.633536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:00.634498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:00.645149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:00.645620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:00.646524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:00.647016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:00.756881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:00.758384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:00.767940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:00.768667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:00.769939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:00.779472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:00.884364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:00.895422 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a523ec58-762a-4c95-859f-11c0fe023a99 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.265843 Apr 02 21:04:00.898444 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2015/3698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:00 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:00.978091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:00.986731 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-740bbdb2-7f2a-4247-955d-99480a46a69a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1493 microversion: 2.1 time: 0.235096 Apr 02 21:04:00.987322 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1684/3699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:00 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1493 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:01.008371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:01.009006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:01.015337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:01.016123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:01.017287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:01.017902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:01.057163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:04:01.190282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-765248f6-3739-4608-90dd-30c406028e0a tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 204 len: 0 microversion: 2.1 time: 0.188823 Apr 02 21:04:01.195677 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2016/3700] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:00 2022] DELETE /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:04:01.205855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:01.206152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:01.214032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:01.215236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:01.216042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:01.219043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:01.551523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:01.561065 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-59cb10b8-0286-4e30-a65f-835e0c21c07d tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1499 microversion: 2.1 time: 0.360411 Apr 02 21:04:01.561812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1685/3701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:01 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1499 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:01.917072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:01.917800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:01.933305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:01.933784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:01.937149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:01.937621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.243284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:02.255600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eef50d93-5c04-4872-a593-233927bbcf36 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1485 microversion: 2.1 time: 0.344292 Apr 02 21:04:02.256768 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2017/3702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:01 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1485 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:02.273497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:02.274052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:02.283272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:02.284081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.285574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:02.286180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.381833 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3ebd159-e5a1-40f2-84f8-a840411eeb35 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "POST /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694/action" status: 202 len: 0 microversion: 2.1 time: 0.112651 Apr 02 21:04:02.384194 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1686/3703] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:04:02 2022] POST /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:04:02.393310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:02.394025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:02.411048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:02.412204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.414458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:02.417044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.582995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:02.584072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:02.601111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:02.601928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.603190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:02.604061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:02.958123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:02.975079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:02.980503 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f040010-e693-4fbf-8653-c17096df82af tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1499 microversion: 2.1 time: 0.402326 Apr 02 21:04:02.987636 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1687/3704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:02 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1499 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:02.991529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d969b16-14da-43e9-b3a2-af9ba9fb2760 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1493 microversion: 2.1 time: 0.601830 Apr 02 21:04:02.994085 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2018/3705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:02 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1493 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:04.010755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:04.011439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:04.017137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:04.017774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:04.029052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:04.029876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:04.030717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:04.031178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:04.043669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:04.044388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:04.045277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:04.045749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:04.499461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dfe516204634bdd902f2e1236d7a6ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67592663633d4cd89aed8f728fd7ca86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:04.507649 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ff483bb-e2ee-447f-a457-a75faac489ec tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 200 len: 1499 microversion: 2.1 time: 0.507306 Apr 02 21:04:04.516207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:04.527490 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1688/3706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:03 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 1499 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:04.532108 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0dd7177-bad6-4a10-99c0-ecdb343801fe tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1493 microversion: 2.1 time: 0.520260 Apr 02 21:04:04.548361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2025243956", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "fd635466-1963-4551-be06-e364f82a0810"}, {"uuid": "d7809203-7d69-472c-8f1a-ec77c3562417"}, {"uuid": "fd635466-1963-4551-be06-e364f82a0810"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:04.549010 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2019/3707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:04 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1493 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:04.554180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7c24cf63-662c-4cd4-806c-81c20279132e req-42df816c-9186-4a0a-abcf-bf1cb03c2ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f", "name": "network-vif-deleted", "tag": "eec90799-94e8-418d-8658-ab70f2f3ade1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:04.583712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7c24cf63-662c-4cd4-806c-81c20279132e req-42df816c-9186-4a0a-abcf-bf1cb03c2ff8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:04.584490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7c24cf63-662c-4cd4-806c-81c20279132e req-42df816c-9186-4a0a-abcf-bf1cb03c2ff8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:04.619179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7c24cf63-662c-4cd4-806c-81c20279132e req-42df816c-9186-4a0a-abcf-bf1cb03c2ff8 service nova] Creating event network-vif-deleted:eec90799-94e8-418d-8658-ab70f2f3ade1 for instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f on nch1-master-1 Apr 02 21:04:04.627809 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7c24cf63-662c-4cd4-806c-81c20279132e req-42df816c-9186-4a0a-abcf-bf1cb03c2ff8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077258 Apr 02 21:04:04.629221 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2020/3708] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:04.674553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] validate_networks() for [('fd635466-1963-4551-be06-e364f82a0810', None, None, None, None, None), ('d7809203-7d69-472c-8f1a-ec77c3562417', None, None, None, None, None), ('fd635466-1963-4551-be06-e364f82a0810', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:04:05.550260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:05.551079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:05.562568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:05.563032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:05.563823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:05.568552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:05.617902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f could not be found. Apr 02 21:04:05.618781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:05.619850 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c885c97a-2f8b-40d6-9549-63f7f4bfaa21 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 404 len: 111 microversion: 2.1 time: 0.077287 Apr 02 21:04:05.625873 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2021/3709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:05 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:04:05.641144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:05.644594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:05.681649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:05.682117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:05.682933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:05.683509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.347955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:06.359444 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67bfa624-5ed4-4c75-8cb5-baf0d1b0aaf9 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1493 microversion: 2.1 time: 0.730922 Apr 02 21:04:06.360355 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2022/3710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:05 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1493 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:06.365915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.366635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.375202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.375927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.377044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.377659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.394587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f could not be found. Apr 02 21:04:06.395762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.396841 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-783b0f86-57d6-4d90-8358-06a4276ba6fd tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 404 len: 111 microversion: 2.1 time: 0.035342 Apr 02 21:04:06.397640 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2023/3711] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:06 2022] DELETE /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.406749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.407926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.417462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.420704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.424441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.425267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.469448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f could not be found. Apr 02 21:04:06.470139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.471304 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2dd818e8-d78c-4696-990a-f9506a072e18 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f" status: 404 len: 111 microversion: 2.1 time: 0.069165 Apr 02 21:04:06.475369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2024/3712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:06 2022] GET /compute/v2.1/servers/5bd3ffbc-835f-42e8-8c9e-91ecbd2e582f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.484089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.484613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.496132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.497052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.498082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.499496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.540982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace could not be found. Apr 02 21:04:06.542631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.545842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18e89abe-89a3-4158-8802-ff01a3c5bad6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 404 len: 111 microversion: 2.1 time: 0.069095 Apr 02 21:04:06.548543 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2025/3713] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:06 2022] DELETE /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.561432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.562143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.596109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.596246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.602517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.603506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.636400 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace could not be found. Apr 02 21:04:06.642875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.643904 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4bf77ada-0344-4f89-90ef-ba34a4255680 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace" status: 404 len: 111 microversion: 2.1 time: 0.092827 Apr 02 21:04:06.644795 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2026/3714] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:06 2022] GET /compute/v2.1/servers/e7c76cf3-5bd9-4eb4-a7f5-2456743d4ace => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.656363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.659113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.675723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.676473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.677741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.678453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.743664 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 could not be found. Apr 02 21:04:06.744895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.746011 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-169f2cbf-20de-4528-9e74-d97079a38ced tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 404 len: 111 microversion: 2.1 time: 0.096981 Apr 02 21:04:06.747154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2027/3715] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:06 2022] DELETE /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.756250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.759068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 549c4297-08a2-4e85-8c9f-e1b9c081b452] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.771475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.775875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.778910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.779548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.799980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 could not be found. Apr 02 21:04:06.801091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 549c4297-08a2-4e85-8c9f-e1b9c081b452 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.803105 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0da829be-0038-4a23-bf2b-dad13190e9c6 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452" status: 404 len: 111 microversion: 2.1 time: 0.051002 Apr 02 21:04:06.806695 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2028/3716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:06 2022] GET /compute/v2.1/servers/549c4297-08a2-4e85-8c9f-e1b9c081b452 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.824240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.825207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.834077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.834757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.835801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:04:06.836559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.836829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:04:06.837731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:04:06.838340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:04:06.838808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.839194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:04:06.862145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.863157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.863307 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 9962e223-2c12-4549-830d-3602ca472347 could not be found. Apr 02 21:04:06.864135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 9962e223-2c12-4549-830d-3602ca472347 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.865014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.865993 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee08994b-4fad-4398-bbc3-c609f380bdb7 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 404 len: 111 microversion: 2.1 time: 0.048422 Apr 02 21:04:06.866974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.867834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2029/3717] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:06 2022] DELETE /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.897242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Getting quotas for project 6ae16de34fd342cda85aa2bd981452c4. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:06.902448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.906596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Getting quotas for user 437b151556e04bdfa22a80b72f34c088 and project 6ae16de34fd342cda85aa2bd981452c4. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:06.922254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 9962e223-2c12-4549-830d-3602ca472347] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:06.934007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:04:06.936850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.937686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.938610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:04:06.939766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:06.940662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:06.971547 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 9962e223-2c12-4549-830d-3602ca472347 could not be found. Apr 02 21:04:06.972923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 9962e223-2c12-4549-830d-3602ca472347 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:06.974277 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b41eb67-5bc5-47e3-8174-b7a9b8f9f36c tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347" status: 404 len: 111 microversion: 2.1 time: 0.099488 Apr 02 21:04:06.975656 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2030/3718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:06 2022] GET /compute/v2.1/servers/9962e223-2c12-4549-830d-3602ca472347 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:06.993157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d404dd50-5109-4f84-a804-0b93f7424dad tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:06.994209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d404dd50-5109-4f84-a804-0b93f7424dad tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:07.006280 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d404dd50-5109-4f84-a804-0b93f7424dad tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance f2c714a2-cc85-43f7-b74e-16e09497fdbd could not be found. Apr 02 21:04:07.007027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d404dd50-5109-4f84-a804-0b93f7424dad tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance f2c714a2-cc85-43f7-b74e-16e09497fdbd could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:07.008011 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d404dd50-5109-4f84-a804-0b93f7424dad tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd" status: 404 len: 111 microversion: 2.1 time: 0.028173 Apr 02 21:04:07.017882 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2031/3719] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:06 2022] DELETE /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:07.028630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42ce17fe-acb1-4464-9fe5-d63fd2447656 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:07.030506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42ce17fe-acb1-4464-9fe5-d63fd2447656 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: f2c714a2-cc85-43f7-b74e-16e09497fdbd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:07.066789 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bf5d12dd-6439-4530-93ae-595a37864b6a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.531768 Apr 02 21:04:07.067541 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1689/3720] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:04:07.068506 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-42ce17fe-acb1-4464-9fe5-d63fd2447656 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance f2c714a2-cc85-43f7-b74e-16e09497fdbd could not be found. Apr 02 21:04:07.072188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42ce17fe-acb1-4464-9fe5-d63fd2447656 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance f2c714a2-cc85-43f7-b74e-16e09497fdbd could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:07.077358 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42ce17fe-acb1-4464-9fe5-d63fd2447656 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd" status: 404 len: 111 microversion: 2.1 time: 0.056027 Apr 02 21:04:07.083224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2032/3721] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:07 2022] GET /compute/v2.1/servers/f2c714a2-cc85-43f7-b74e-16e09497fdbd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:07.088118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-115a898e-0e8c-4a87-9014-8cbc50fe46ab tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:07.105101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-115a898e-0e8c-4a87-9014-8cbc50fe46ab tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:07.304483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-115a898e-0e8c-4a87-9014-8cbc50fe46ab tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:07.325045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-115a898e-0e8c-4a87-9014-8cbc50fe46ab tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1213 microversion: 2.1 time: 0.250531 Apr 02 21:04:07.331891 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1690/3722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:07 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1213 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:07.381362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:07.382868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:07.411808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:07.413236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:07.415151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:07.416990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:07.916315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:07.943615 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e228e3c8-8456-4b6b-a940-fbb5c0eb163b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1499 microversion: 2.1 time: 0.567610 Apr 02 21:04:07.946651 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2033/3723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:07 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:07.971974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:07.972519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:07.990394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:07.992074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:07.995134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:07.997000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.093674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:04:08.322973 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9427890e-4110-4517-8b6d-28fa9e8b8b02 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 204 len: 0 microversion: 2.1 time: 0.356102 Apr 02 21:04:08.324969 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1691/3724] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:07 2022] DELETE /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:04:08.335794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.340191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:08.347486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.348660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:08.357643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.358301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.359324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.363296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.368992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.369478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.370310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.370766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.535855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:08.554547 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5c1d976-6b3c-4bf2-9852-feaa2a24a9a9 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1217 microversion: 2.1 time: 0.213276 Apr 02 21:04:08.566641 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1692/3725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:08 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:08.577795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.582846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:08.592675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.593737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.594995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.595795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.615500 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. Apr 02 21:04:08.616699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:08.618611 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04283842-c2c7-44e1-b665-72f3c0f192f9 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 404 len: 111 microversion: 2.1 time: 0.050056 Apr 02 21:04:08.619991 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1693/3726] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:08 2022] DELETE /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:08.626579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.631902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:08.632897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Searching by: {'deleted': False, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:04:08.639619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.642903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.645352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.649757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.716651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:04:08.778571 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e4ec9748-535b-4214-8195-ce0e7f64a178 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.157047 Apr 02 21:04:08.782236 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1694/3727] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:04:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:08.793876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.797585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 25509bd1-b73f-48ea-af8c-c66e7bd1a312] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:08.810809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.816096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.818597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.819395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.838620 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. Apr 02 21:04:08.839570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 25509bd1-b73f-48ea-af8c-c66e7bd1a312 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:08.840867 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad1190a2-e7eb-4355-a295-d75bd7ac8e19 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312" status: 404 len: 111 microversion: 2.1 time: 0.054474 Apr 02 21:04:08.841752 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1695/3728] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:08 2022] GET /compute/v2.1/servers/25509bd1-b73f-48ea-af8c-c66e7bd1a312 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:08.848164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.852920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:08.854115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Searching by: {'deleted': False, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:04:08.860921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.861852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.862916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:08.863728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:08.919093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:04:08.962920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:08.972942 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cb40be33-b1d1-43a3-b728-9b7b11b1f7d2 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.643175 Apr 02 21:04:08.977059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2034/3729] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:08 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:08.990286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:08.992961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:09.010015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.013478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.014697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.015371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.024016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:09.034058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.034732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.058394 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b could not be found. Apr 02 21:04:09.059263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:09.060439 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e149fe4-2863-4081-887a-243a4c00e825 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 404 len: 111 microversion: 2.1 time: 0.082137 Apr 02 21:04:09.061325 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2035/3730] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:08 2022] DELETE /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:09.077626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:09.078626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] [instance: 05bed59b-2f6c-45b3-baf5-0ba5ef23941b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:09.099987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.102729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.109336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.110157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.166192 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] HTTP exception thrown: Instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b could not be found. Apr 02 21:04:09.168110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] Returning 404 to user: Instance 05bed59b-2f6c-45b3-baf5-0ba5ef23941b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:09.171729 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-84b5920c-0546-4a10-8764-ea9315f27519 tempest-DeleteServersTestJSON-1658862532 tempest-DeleteServersTestJSON-1658862532-project] 10.222.0.18 "GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b" status: 404 len: 111 microversion: 2.1 time: 0.102031 Apr 02 21:04:09.182392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2036/3731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:09 2022] GET /compute/v2.1/servers/05bed59b-2f6c-45b3-baf5-0ba5ef23941b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:09.460062 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9783d59f-9665-4aa2-9d39-137fd84451a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.616455 Apr 02 21:04:09.460809 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1696/3732] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:04:08 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:09.484890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34a694cc-c5b0-4e4f-ba7c-525106d8ad85 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:09.500255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34a694cc-c5b0-4e4f-ba7c-525106d8ad85 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020545 Apr 02 21:04:09.524298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2037/3733] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:04:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:09.581928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:09.582728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:09.593363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.594280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.595897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.596483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.777225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:09.797455 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4270bd66-b039-413a-b080-ea69fd00fdf7 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1271 microversion: 2.1 time: 0.226414 Apr 02 21:04:09.799277 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1697/3734] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:09 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:09.931461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:09.932191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:09.952067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.953546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:09.957313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:09.957987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.003588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:10.004538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:10.006752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:04:10.016740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:10.021131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.022270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:10.026012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.207994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "DELETE /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 204 len: 0 microversion: 2.1 time: 0.281578 Apr 02 21:04:10.209194 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2038/3735] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:09 2022] DELETE /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:04:10.225742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:10.226782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:10.244445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:10.248117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.251127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:10.251881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.579882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:10.591434 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1374fc30-6588-484c-b99f-eef179614227 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1608 microversion: 2.1 time: 0.376341 Apr 02 21:04:10.596579 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2039/3736] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:10 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1608 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:10.627002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:10.635807 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31964957-a94c-4d31-928f-53ff3c33ac6b tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.645712 Apr 02 21:04:10.636925 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1698/3737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:09 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:10.820561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:10.822147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:10.837142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:10.845156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.859357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27f92b2b-61a9-4dcf-98e6-26c6289f5894 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Action: 'create', calling method: .version_select at 0x7f54d46be940>, body: {"keypair": {"name": "tempest-keypair-2048420459"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:10.864309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:10.866583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:10.934149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-27f92b2b-61a9-4dcf-98e6-26c6289f5894 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for project a5aab95c86ad418185090595372fd48c. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:10.949110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-27f92b2b-61a9-4dcf-98e6-26c6289f5894 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for user b3fba445dba44b79a1e912e2cf10c905 and project a5aab95c86ad418185090595372fd48c. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:11.311464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:11.327209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f10e0f8e-389d-401a-923c-63dc090bb4d6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1313 microversion: 2.1 time: 0.511322 Apr 02 21:04:11.329461 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1699/3738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:10 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:11.402198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-27f92b2b-61a9-4dcf-98e6-26c6289f5894 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for project a5aab95c86ad418185090595372fd48c. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:11.423241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-27f92b2b-61a9-4dcf-98e6-26c6289f5894 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for user b3fba445dba44b79a1e912e2cf10c905 and project a5aab95c86ad418185090595372fd48c. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:11.468568 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-27f92b2b-61a9-4dcf-98e6-26c6289f5894 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.849275 Apr 02 21:04:11.469644 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2040/3739] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:04:10 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:11.613429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:11.614875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:11.649493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:11.651714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:11.653469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:11.654694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:11.658161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:11.659870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:11.666843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:11.667670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:11.668006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:11.668491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:11.961180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:11.974852 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67c5edf0-3028-4e31-84fc-dfd039ae6679 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1608 microversion: 2.1 time: 0.368426 Apr 02 21:04:11.976540 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1700/3740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:11 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1608 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:12.346316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:12.347564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:12.365838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:12.367238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:12.370079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:12.373425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:12.384228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:12.392201 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc5aa547-8b03-4859-80e9-dffcbeae0974 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1505 microversion: 2.1 time: 0.742526 Apr 02 21:04:12.403952 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2041/3741] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:11 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1505 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:12.660289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:12.673443 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e0968a8-8a91-4ac7-85c4-1c68db9a76b5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1334 microversion: 2.1 time: 0.331032 Apr 02 21:04:12.683313 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1701/3742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:12 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1334 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:12.993685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:12.994509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:13.008561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.017620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.019349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.019919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.187688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:13.198284 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d1fd6c9b-e570-4a90-a3ab-af62199c92a1 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1541 microversion: 2.1 time: 0.208860 Apr 02 21:04:13.211596 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2042/3743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:12 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1541 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:13.394832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-026f41da-1411-4c60-9d17-14c0a78891f5 req-22cae139-c6d2-420d-bad4-f09748ef19dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99317874-e637-442b-a46a-9c7d51b11694", "name": "network-vif-deleted", "tag": "fa6dd3f6-e8bf-40c9-bd36-6020d00af7aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:13.414084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-026f41da-1411-4c60-9d17-14c0a78891f5 req-22cae139-c6d2-420d-bad4-f09748ef19dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.414771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-026f41da-1411-4c60-9d17-14c0a78891f5 req-22cae139-c6d2-420d-bad4-f09748ef19dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.423629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:13.424853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:13.433871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.453290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.468387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.472787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.475312 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-026f41da-1411-4c60-9d17-14c0a78891f5 req-22cae139-c6d2-420d-bad4-f09748ef19dc service nova] Creating event network-vif-deleted:fa6dd3f6-e8bf-40c9-bd36-6020d00af7aa for instance 99317874-e637-442b-a46a-9c7d51b11694 on nch2-master-1 Apr 02 21:04:13.490658 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-026f41da-1411-4c60-9d17-14c0a78891f5 req-22cae139-c6d2-420d-bad4-f09748ef19dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099662 Apr 02 21:04:13.498860 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1702/3744] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:13.692398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:13.693617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:13.694478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:13.708492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.709197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.710340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:13.711030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:13.714665 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa627e89-def7-4649-a927-febede82c895 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 200 len: 1298 microversion: 2.1 time: 0.293374 Apr 02 21:04:13.715370 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2043/3745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:13 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 1298 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:14.253786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:14.261212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:14.311657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:14.314987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:14.320180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:14.321306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:14.338571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:14.354283 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9382a4a-b6cc-4e23-9092-18c596d306eb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1334 microversion: 2.1 time: 0.666177 Apr 02 21:04:14.355513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1703/3746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:13 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1334 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:14.372723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-4db77d88-c8f2-4ca5-8553-03ccad8f72e4 req-ce01704b-5667-4d1f-931b-f7bdd80f48c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e26eb0-1631-4bb6-a60d-1c2bb65097b3", "name": "network-vif-deleted", "tag": "d154e01b-b647-45e1-9f62-4356af6468c4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:14.395068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4db77d88-c8f2-4ca5-8553-03ccad8f72e4 req-ce01704b-5667-4d1f-931b-f7bdd80f48c6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:14.395758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4db77d88-c8f2-4ca5-8553-03ccad8f72e4 req-ce01704b-5667-4d1f-931b-f7bdd80f48c6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:14.431866 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4db77d88-c8f2-4ca5-8553-03ccad8f72e4 req-ce01704b-5667-4d1f-931b-f7bdd80f48c6 service nova] Creating event network-vif-deleted:d154e01b-b647-45e1-9f62-4356af6468c4 for instance 01e26eb0-1631-4bb6-a60d-1c2bb65097b3 on nch1-master-1 Apr 02 21:04:14.448563 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-4db77d88-c8f2-4ca5-8553-03ccad8f72e4 req-ce01704b-5667-4d1f-931b-f7bdd80f48c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091242 Apr 02 21:04:14.454510 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1704/3747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:15.006925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1087385334", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "a152d338-1362-4112-aded-4ce4e8c5efcf"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:15.062857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf97b33a7644fd9b2c92af3138f040c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf913c65b2ee4d168f38d2ffd7f02585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:15.073976 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a9886af-1ce8-48e8-bf30-d87fb9954d3f tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 200 len: 1541 microversion: 2.1 time: 0.852932 Apr 02 21:04:15.080425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2044/3748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:14 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 1541 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:15.108511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:15.109435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 99317874-e637-442b-a46a-9c7d51b11694] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:15.117240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] validate_networks() for [('a152d338-1362-4112-aded-4ce4e8c5efcf', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:04:15.129193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:15.133834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:15.137500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:15.144206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:15.191377 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] HTTP exception thrown: Instance 99317874-e637-442b-a46a-9c7d51b11694 could not be found. Apr 02 21:04:15.194562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Returning 404 to user: Instance 99317874-e637-442b-a46a-9c7d51b11694 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:15.197094 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a982a5bc-e7e7-4918-86ef-2a79f6763081 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694" status: 404 len: 111 microversion: 2.1 time: 0.114105 Apr 02 21:04:15.199312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2045/3749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:15 2022] GET /compute/v2.1/servers/99317874-e637-442b-a46a-9c7d51b11694 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:15.208803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:15.211866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:15.226944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:15.229157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:15.230466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:15.235092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:15.313932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:04:15.654192 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d02a285-34f8-4b9c-8e55-2ac5ab765721 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "DELETE /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 204 len: 0 microversion: 2.1 time: 0.449503 Apr 02 21:04:15.655453 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2046/3750] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:15 2022] DELETE /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:04:15.667334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:15.668425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:15.688506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:15.689217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:15.692609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:15.693670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.136239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:16.145349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b05bf90a-2b03-4698-9c0d-b34fa510c400 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.488236 Apr 02 21:04:16.150106 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2047/3751] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:15 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:16.160625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:16.161431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:16.178354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.179263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.180324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.181035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.633452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:16.644892 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ae55f41-747b-4dd5-ac47-124e2fe5f947 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1491 microversion: 2.1 time: 0.493569 Apr 02 21:04:16.645678 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2048/3752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:16 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1491 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:16.645875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:04:16.646924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:04:16.647566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:04:16.648282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:04:16.648887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:04:16.650510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-75bcb895-f968-4ecb-a7d0-74592a60c101 req-01892060-e1b0-4287-aa3f-68947a2d905f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "tag": "2c7ec2c2-dab7-4dae-867b-c7e2ca43c895"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:16.663869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-75bcb895-f968-4ecb-a7d0-74592a60c101 req-01892060-e1b0-4287-aa3f-68947a2d905f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.667011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-75bcb895-f968-4ecb-a7d0-74592a60c101 req-01892060-e1b0-4287-aa3f-68947a2d905f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.674679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.675140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.675954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.681699 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-75bcb895-f968-4ecb-a7d0-74592a60c101 req-01892060-e1b0-4287-aa3f-68947a2d905f service nova] Creating event network-changed:2c7ec2c2-dab7-4dae-867b-c7e2ca43c895 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:16.688421 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-75bcb895-f968-4ecb-a7d0-74592a60c101 req-01892060-e1b0-4287-aa3f-68947a2d905f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040603 Apr 02 21:04:16.689364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2049/3753] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:16.692241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.696288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:16.697256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] [instance: 01e26eb0-1631-4bb6-a60d-1c2bb65097b3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:16.705379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.706037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.707177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.707786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.755454 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] HTTP exception thrown: Instance 01e26eb0-1631-4bb6-a60d-1c2bb65097b3 could not be found. Apr 02 21:04:16.756083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Returning 404 to user: Instance 01e26eb0-1631-4bb6-a60d-1c2bb65097b3 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:16.756998 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-644b4b28-8865-4c94-be04-08fb1056ac73 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3" status: 404 len: 111 microversion: 2.1 time: 0.065835 Apr 02 21:04:16.757572 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2050/3754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:16 2022] GET /compute/v2.1/servers/01e26eb0-1631-4bb6-a60d-1c2bb65097b3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:16.768714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Getting quotas for project 7f1a5e5adf8141058ce50ee9295e57cc. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:16.776434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Getting quotas for user 5331b96019b4418a8aa6a1facd9e1c06 and project 7f1a5e5adf8141058ce50ee9295e57cc. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:16.779945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:16.786593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:16.803331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.803803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.805217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:16.805691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:16.812704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:04:16.823728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:04:16.861246 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7091463-9848-4123-9fe4-d8382be6e433 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/ips" status: 200 len: 144 microversion: 2.1 time: 0.090528 Apr 02 21:04:16.861954 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2051/3755] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:04:16 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/ips => generated 144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:16.883402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-702336915", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ffc1bb71-f995-4112-abd6-0fae8b61953f"}], "security_groups": [{"name": "tempest-securitygroup--242247267"}], "key_name": "tempest-keypair-2048420459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:16.913552 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-54a2be9e-10d0-4ce2-be21-0fa81ea16346 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247990 Apr 02 21:04:16.915104 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1705/3756] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:04:16.928717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a8afdca-24b7-4e46-a280-7ab0225a47b7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] Calling method '.version_select at 0x7f54d42bc940>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:16.957090 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a8afdca-24b7-4e46-a280-7ab0225a47b7 tempest-ServersTestBootFromVolume-28230648 tempest-ServersTestBootFromVolume-28230648-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324145803" status: 202 len: 0 microversion: 2.1 time: 0.040130 Apr 02 21:04:16.958330 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1706/3757] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:04:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324145803 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:04:16.986476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34a59578-d6ee-42f6-928e-a4888efdc94f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:16.987274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34a59578-d6ee-42f6-928e-a4888efdc94f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:17.248645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34a59578-d6ee-42f6-928e-a4888efdc94f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:17.259607 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34a59578-d6ee-42f6-928e-a4888efdc94f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1218 microversion: 2.1 time: 0.297960 Apr 02 21:04:17.261310 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1707/3758] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:16 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1218 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:17.289090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:17.289907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:17.319422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:17.319954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:17.321198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:17.321702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:17.478640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] validate_networks() for [('ffc1bb71-f995-4112-abd6-0fae8b61953f', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:04:17.694567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:17.704434 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a3f2529-9b32-42cf-9586-f23b6bb0ce47 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.429754 Apr 02 21:04:17.714112 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1708/3759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:17 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:17.721894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:17.723394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:17.732432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:17.732992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:17.733788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:17.734670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:17.953574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:17.963493 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00f4aacf-abe9-40d2-9524-3f34184e4bd3 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1491 microversion: 2.1 time: 0.247956 Apr 02 21:04:17.964339 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1709/3760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:17 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1491 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:18.276924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:18.278155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:18.286049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.286848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.287877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.288561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.559354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for project a5aab95c86ad418185090595372fd48c. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:18.570377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for user b3fba445dba44b79a1e912e2cf10c905 and project a5aab95c86ad418185090595372fd48c. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:18.607061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:04:18.608144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:04:18.609205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:04:18.610020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:04:18.610643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:04:18.625023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.625772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.627003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.627835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.649686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for project a5aab95c86ad418185090595372fd48c. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:18.659957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Getting quotas for user b3fba445dba44b79a1e912e2cf10c905 and project a5aab95c86ad418185090595372fd48c. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:18.682955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:04:18.686912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:04:18.771058 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef01fa11-839e-4549-b69e-969460ba28e6 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.902682 Apr 02 21:04:18.776882 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2052/3761] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:04:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:04:18.782220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0034258a-4e3b-426a-a2c4-7a067fe59f80"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:18.788794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:18.798775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:18.800884 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-da609b87-af1f-40f8-8abb-6395cf5c8e7d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1270 microversion: 2.1 time: 0.527733 Apr 02 21:04:18.801739 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1710/3762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:18 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1270 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:18.810650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:18.811312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.812288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.812645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:18.813025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.814090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.826602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.828031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:18.829061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:18.829667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:19.175160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-25e53df7-db90-41a4-9fe5-5f7e888c801b tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398457 Apr 02 21:04:19.176053 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2053/3763] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:04:18 2022] POST /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:19.194715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-912bb19c-8862-429a-8288-033df2d33af4 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:19.199130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-912bb19c-8862-429a-8288-033df2d33af4 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:19.234550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:19.247595 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93674cdd-6d2c-4d91-aebd-6e9863c44ea1 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.442441 Apr 02 21:04:19.248428 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1711/3764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:18 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:19.256647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:19.257271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:19.274860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:19.276485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:19.277318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:19.277772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:19.339224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-912bb19c-8862-429a-8288-033df2d33af4 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:19.354068 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-912bb19c-8862-429a-8288-033df2d33af4 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1269 microversion: 2.1 time: 0.176730 Apr 02 21:04:19.357437 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2054/3765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:19 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:19.363694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-aa02d2a0-9027-41c6-bca2-c847226001d5 req-a17e4fb1-248d-46da-9296-cc9ca850fa6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "tag": "acf81fb5-8fa8-4b26-bd2a-abf8b03e87f9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:19.402980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-aa02d2a0-9027-41c6-bca2-c847226001d5 req-a17e4fb1-248d-46da-9296-cc9ca850fa6d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:19.406609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-aa02d2a0-9027-41c6-bca2-c847226001d5 req-a17e4fb1-248d-46da-9296-cc9ca850fa6d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:19.427477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-aa02d2a0-9027-41c6-bca2-c847226001d5 req-a17e4fb1-248d-46da-9296-cc9ca850fa6d service nova] Creating event network-changed:acf81fb5-8fa8-4b26-bd2a-abf8b03e87f9 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:19.435346 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-aa02d2a0-9027-41c6-bca2-c847226001d5 req-a17e4fb1-248d-46da-9296-cc9ca850fa6d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076248 Apr 02 21:04:19.458188 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2055/3766] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:19.844035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:19.855392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:19.883143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:19.885777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:19.886600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:19.887051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:19.952888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f15cc4e52d554c3e9ab441d22453fffd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff8ea67a27f74237963a177abd07cc45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:19.962090 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6206a48-8e59-4128-8033-7ffcbfe4ed70 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 200 len: 1491 microversion: 2.1 time: 0.709156 Apr 02 21:04:19.964864 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1712/3767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:19 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 1491 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:20.047736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:20.056086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0125d00e-1734-4fde-98cf-621ff54c8d68 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1276 microversion: 2.1 time: 0.240992 Apr 02 21:04:20.067280 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2056/3768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:19 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:20.267404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:20.268448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:20.280226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:20.281068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:20.283962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:20.284799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:20.373248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:20.373879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:20.401851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:20.405072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:20.410230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:20.413030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:20.625259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:20.649866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-915ec502-ce70-4bc6-9c8b-924d8e08f41f tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1321 microversion: 2.1 time: 0.281814 Apr 02 21:04:20.664272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2057/3769] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:20 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:20.876381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:20.884807 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40c479de-f2b8-4677-af07-8f3d687dae67 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.622992 Apr 02 21:04:20.885618 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1713/3770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:20 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:20.981931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:20.982549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] [instance: 29437825-e42a-4c34-8d70-199c8bf119d4] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:20.989641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:20.990374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:20.992399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:20.992906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.010816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] HTTP exception thrown: Instance 29437825-e42a-4c34-8d70-199c8bf119d4 could not be found. Apr 02 21:04:21.011619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] Returning 404 to user: Instance 29437825-e42a-4c34-8d70-199c8bf119d4 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:21.012812 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0df6f4a-67ef-402f-8a4a-41f3a8697f48 tempest-ServerRescueTestJSON-1170662528 tempest-ServerRescueTestJSON-1170662528-project] 10.222.0.18 "GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4" status: 404 len: 111 microversion: 2.1 time: 0.035663 Apr 02 21:04:21.017812 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2058/3771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:20 2022] GET /compute/v2.1/servers/29437825-e42a-4c34-8d70-199c8bf119d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:21.075821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:21.076524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:21.084175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.084661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.085446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.085884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.478163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:21.486425 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d239dd4-0768-4ee1-9112-10d800acdd33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.415148 Apr 02 21:04:21.496361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c774bafb-f61d-453d-898d-11c19e6cb085 req-ce77bf6e-da0f-4787-843b-8c3e588ade92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29437825-e42a-4c34-8d70-199c8bf119d4", "name": "network-vif-deleted", "tag": "14bbc9b5-7e6e-44d2-855e-651eac54cff7"}, {"name": "network-changed", "server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "tag": "9c1b477f-22c8-4a4c-b760-ba163a584bc7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:21.497134 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1714/3772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:21 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:21.507532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c774bafb-f61d-453d-898d-11c19e6cb085 req-ce77bf6e-da0f-4787-843b-8c3e588ade92 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.508219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c774bafb-f61d-453d-898d-11c19e6cb085 req-ce77bf6e-da0f-4787-843b-8c3e588ade92 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.523705 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c774bafb-f61d-453d-898d-11c19e6cb085 req-ce77bf6e-da0f-4787-843b-8c3e588ade92 service nova] Creating event network-vif-deleted:14bbc9b5-7e6e-44d2-855e-651eac54cff7 for instance 29437825-e42a-4c34-8d70-199c8bf119d4 on nch2-master-1 Apr 02 21:04:21.524538 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c774bafb-f61d-453d-898d-11c19e6cb085 req-ce77bf6e-da0f-4787-843b-8c3e588ade92 service nova] Creating event network-changed:9c1b477f-22c8-4a4c-b760-ba163a584bc7 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:21.534795 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c774bafb-f61d-453d-898d-11c19e6cb085 req-ce77bf6e-da0f-4787-843b-8c3e588ade92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042097 Apr 02 21:04:21.535978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2059/3773] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:21.672322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:21.673119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:21.679935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.680575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.682109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.682795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.769239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:21.780379 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-59dd60be-d46e-4c34-bb47-3581212ced9e tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1327 microversion: 2.1 time: 0.112083 Apr 02 21:04:21.783770 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1715/3774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:21 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:21.904020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:21.904948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:21.912700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.913616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:21.914609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:21.915272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:22.508875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:22.510229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:22.518996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:22.519465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:22.520261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:22.520912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:22.868957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:22.878477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-62a82aef-4def-4e33-afc9-b7cd17ec2159 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.978972 Apr 02 21:04:22.879372 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2060/3775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:21 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:22.892223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-29a22899-a948-43d3-9c5c-697c31bdeb7a req-9645ac15-0943-4cab-a951-39ce15057c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d783ddb6-bc96-4d25-9003-8c587ffefaec", "tag": "40619b23-550c-41ce-a969-700e42af64d7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:22.901247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-29a22899-a948-43d3-9c5c-697c31bdeb7a req-9645ac15-0943-4cab-a951-39ce15057c66 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:22.902040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-29a22899-a948-43d3-9c5c-697c31bdeb7a req-9645ac15-0943-4cab-a951-39ce15057c66 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:22.931623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-29a22899-a948-43d3-9c5c-697c31bdeb7a req-9645ac15-0943-4cab-a951-39ce15057c66 service nova] Creating event network-changed:40619b23-550c-41ce-a969-700e42af64d7 for instance d783ddb6-bc96-4d25-9003-8c587ffefaec on nch2-master-1 Apr 02 21:04:22.949156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-29a22899-a948-43d3-9c5c-697c31bdeb7a req-9645ac15-0943-4cab-a951-39ce15057c66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068172 Apr 02 21:04:22.950085 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2061/3776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:22.956357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:22.957532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:22.964808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:22.965380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:22.967051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:22.967740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:23.000614 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c3b08f37-40dd-4053-85fa-21348c7b2ff9 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048391 Apr 02 21:04:23.001366 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2062/3777] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:04:22 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:23.013260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:23.014111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:23.021432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:23.022163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:23.022985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:23.023450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:23.306981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:23.318290 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-330d154b-8168-491e-84fc-742e20d7ccca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.817455 Apr 02 21:04:23.319163 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1716/3778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:22 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:23.324269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:23.325061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:23.331993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:23.332564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:23.333772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:23.334420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:23.366594 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecac041f-5372-4bad-8548-8f3e1f5dafc2 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/0034258a-4e3b-426a-a2c4-7a067fe59f80" status: 200 len: 194 microversion: 2.1 time: 0.046058 Apr 02 21:04:23.367122 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1717/3779] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Apr 2 21:04:23 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/0034258a-4e3b-426a-a2c4-7a067fe59f80 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:23.498434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:23.516650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc8d9baf-93f1-4fda-b866-e3d6ba537310 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.507975 Apr 02 21:04:23.518702 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2063/3780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:23 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:23.897408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:23.898029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:23.906560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:23.907023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:23.907804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:23.908249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.336152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:24.336789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:24.352324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.355419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.357903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.358774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.385731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:24.396492 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41322ee2-9984-4fc1-9f31-f85e7c490921 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.502838 Apr 02 21:04:24.407457 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1718/3781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:23 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:24.535390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:24.536408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:24.543809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.545078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.546452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.547113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.829590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:24.838618 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38b7d10d-12b6-4e42-a4c5-ed446c53b6b0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.306937 Apr 02 21:04:24.849217 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1719/3782] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:24 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:24.854339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-41fc6599-012d-4a3f-9d1d-df730fd353d7 req-36a0cd58-780d-4b65-85b4-caba7c6374e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6072d790-7f5b-42a2-b398-e5521af36a5c", "tag": "b0b07539-5b31-495b-ae92-64bd4e85ef91"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:24.863738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-41fc6599-012d-4a3f-9d1d-df730fd353d7 req-36a0cd58-780d-4b65-85b4-caba7c6374e1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.864486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-41fc6599-012d-4a3f-9d1d-df730fd353d7 req-36a0cd58-780d-4b65-85b4-caba7c6374e1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.876693 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-41fc6599-012d-4a3f-9d1d-df730fd353d7 req-36a0cd58-780d-4b65-85b4-caba7c6374e1 service nova] Creating event network-changed:b0b07539-5b31-495b-ae92-64bd4e85ef91 for instance 6072d790-7f5b-42a2-b398-e5521af36a5c on nch1-master-1 Apr 02 21:04:24.882637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-41fc6599-012d-4a3f-9d1d-df730fd353d7 req-36a0cd58-780d-4b65-85b4-caba7c6374e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031855 Apr 02 21:04:24.884359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1720/3783] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:24.889968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd15cb3b-4950-4474-9ff9-8e934132619b"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:24.891179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:24.898641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.899239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.900038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:24.900582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:24.954392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:24.991032 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-939ef728-814a-4f2e-bd27-d81f43c3daec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.654343 Apr 02 21:04:25.001801 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2064/3784] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:24 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:25.184694 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3b746f6-69be-4454-a06f-1b538597c3e7 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "POST /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298765 Apr 02 21:04:25.185268 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1721/3785] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:04:24 2022] POST /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:25.417756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:25.419306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:25.426397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:25.427181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:25.428311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:25.429417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:25.864267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:25.865765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:25.878612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:25.879997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:25.882160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:25.883671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:25.917758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:25.929058 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4714c586-d0d6-4dad-a26b-28eb3fdf1765 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.514176 Apr 02 21:04:25.931905 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2065/3786] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:25 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:26.015013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:26.016557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:26.028941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:26.031224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:26.035017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:26.035832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:26.155553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:26.165718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-822867ce-f7ed-48e3-b577-43ba201cad35 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.312256 Apr 02 21:04:26.166954 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1722/3787] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:25 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:26.562152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:26.581635 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f46741a7-0e47-4f6a-aedb-3b30560db3a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.573896 Apr 02 21:04:26.582902 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2066/3788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:26 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:26.957783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:26.959254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:26.978077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:26.979580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:26.981959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:26.984944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:27.186583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:27.187973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:27.202501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:27.203246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:27.205860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:27.206998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:27.447013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:27.455582 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4684ea16-dea6-4c89-b9e0-570e3a5701c0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.510036 Apr 02 21:04:27.468523 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1723/3789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:26 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:27.604470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:27.605570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:27.615782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:27.616520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:27.619040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:27.619742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:27.694658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:27.710089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2d0326ce-eeaa-4a05-8f89-488d5ac6dfab tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.528931 Apr 02 21:04:27.717945 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2067/3790] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:27 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:27.931788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:27.941389 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6415645d-eb46-4222-8fb4-7a6dac2650db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.343173 Apr 02 21:04:27.942013 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1724/3791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:27 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:28.476379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:28.477125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:28.483351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.483821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.484784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.485602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.539576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:28.540775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:28.547368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.547962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.549479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.550023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.582155 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4fc49e4-7873-42f7-9b6c-9e628c10942c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046808 Apr 02 21:04:28.583028 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1725/3792] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:04:28 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:28.714391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:28.725963 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3857b342-9ac5-4880-9fae-083f7739f0d3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.255391 Apr 02 21:04:28.727411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2068/3793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:28 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:28.742254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:28.743176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:28.754040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.754515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.756323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.757361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.834074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:28.834865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:28.844500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.846733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.847727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.849646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.922528 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c56da3c0-40c9-4928-8038-9009d90b6990 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/0034258a-4e3b-426a-a2c4-7a067fe59f80" status: 200 len: 194 microversion: 2.1 time: 0.093740 Apr 02 21:04:28.923847 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2069/3794] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Apr 2 21:04:28 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/0034258a-4e3b-426a-a2c4-7a067fe59f80 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:28.943061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:28.943696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:28.952782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.953592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:28.955374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:28.956001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:29.003425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:29.014566 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65085648-6ee8-48ff-973f-920231f2f228 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.276363 Apr 02 21:04:29.015893 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1726/3795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:28 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:29.022304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:29.023294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:29.032787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:29.033617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:29.034593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:29.036092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:29.115377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lazy-loading 'services' on Instance uuid 38215506-1d7a-4c7d-a1ac-044505a7d57a {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:04:29.227230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:29.235764 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57a89149-c8be-4c70-b675-370341eb1587 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.218041 Apr 02 21:04:29.239665 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1727/3796] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:29 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:29.260286 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-805b7e60-faab-4681-b6ec-8a250d41cb61 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/0034258a-4e3b-426a-a2c4-7a067fe59f80" status: 202 len: 0 microversion: 2.1 time: 0.330011 Apr 02 21:04:29.261512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2070/3797] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:04:28 2022] DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/0034258a-4e3b-426a-a2c4-7a067fe59f80 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:04:29.745209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:29.745840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:29.757245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:29.759908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:29.761123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:29.761742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:29.985979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:29.996724 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5c49455-bc52-4608-8ef5-3d550d05c72a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.256594 Apr 02 21:04:29.997778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1728/3798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:29 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:30.019870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-01f0a7e8-e440-47e4-90ff-1f6d75f93393 req-7787624b-8b09-4de4-ab48-3e04e4508354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-plugged", "status": "completed", "tag": "9c1b477f-22c8-4a4c-b760-ba163a584bc7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:30.038999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:30.040490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:30.058789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.059271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.065055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-01f0a7e8-e440-47e4-90ff-1f6d75f93393 req-7787624b-8b09-4de4-ab48-3e04e4508354 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.066242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.067080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-01f0a7e8-e440-47e4-90ff-1f6d75f93393 req-7787624b-8b09-4de4-ab48-3e04e4508354 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.069177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.107968 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-01f0a7e8-e440-47e4-90ff-1f6d75f93393 req-7787624b-8b09-4de4-ab48-3e04e4508354 service nova] Creating event network-vif-plugged:9c1b477f-22c8-4a4c-b760-ba163a584bc7 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:30.117715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-01f0a7e8-e440-47e4-90ff-1f6d75f93393 req-7787624b-8b09-4de4-ab48-3e04e4508354 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104932 Apr 02 21:04:30.122686 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2071/3799] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:30.256764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:30.257911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:30.280807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.283858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.285545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.286246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.394996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:30.406038 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35dac18b-0c87-4bb4-918e-bfb67b8fde72 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.372275 Apr 02 21:04:30.407599 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1729/3800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:30 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:30.433425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:30.434218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:30.443950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.444409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.445860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.448528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.511369 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4bc5e070-5747-4cf8-a177-526b2ac831cf tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/bd15cb3b-4950-4474-9ff9-8e934132619b" status: 200 len: 194 microversion: 2.1 time: 0.081987 Apr 02 21:04:30.513207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1730/3801] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Apr 2 21:04:30 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/bd15cb3b-4950-4474-9ff9-8e934132619b => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:30.523013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:30.523533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:30.530910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.531381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.532167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:30.532687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:30.672517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lazy-loading 'services' on Instance uuid 38215506-1d7a-4c7d-a1ac-044505a7d57a {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:04:30.752136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:30.754776 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/bd15cb3b-4950-4474-9ff9-8e934132619b" status: 202 len: 0 microversion: 2.1 time: 0.235945 Apr 02 21:04:30.756020 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1731/3802] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:04:30 2022] DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments/bd15cb3b-4950-4474-9ff9-8e934132619b => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:04:30.780749 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b9efc04-7e2b-4403-b767-82bdac8a221c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.528822 Apr 02 21:04:30.789978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2072/3803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:30 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:31.021448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:31.023132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:31.033668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:31.034581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:31.036666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:31.037280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:31.219077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:31.226878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f81c2354-751d-41b5-bb66-05250dfd0050 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.215210 Apr 02 21:04:31.228957 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1732/3804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:31 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:31.424865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:31.425742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:31.433863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:31.435089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:31.436019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:31.436872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:31.800973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:31.801690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:31.810409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:31.811142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:31.812022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:31.812963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.023523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:32.043002 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a45fd32-8d20-4b66-a694-bf84513c826d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.248881 Apr 02 21:04:32.044202 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1733/3805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:31 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:32.049424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:32.050608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:32.056834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.057517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.058487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.058936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.080247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:32.090378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a246476e-481e-45a6-a0b1-01935d2f946c tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044849 Apr 02 21:04:32.091807 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1734/3806] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:04:32 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:04:32.096831 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42dbf142-c1e6-42fd-bb10-a214ca29e59a tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.671654 Apr 02 21:04:32.102833 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2073/3807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:31 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:32.150470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-plugged", "status": "completed", "tag": "2c7ec2c2-dab7-4dae-867b-c7e2ca43c895"}, {"server_uuid": "d783ddb6-bc96-4d25-9003-8c587ffefaec", "name": "network-vif-plugged", "status": "completed", "tag": "40619b23-550c-41ce-a969-700e42af64d7"}, {"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-plugged", "status": "completed", "tag": "acf81fb5-8fa8-4b26-bd2a-abf8b03e87f9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:32.187571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.188041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.230790 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] Creating event network-vif-plugged:2c7ec2c2-dab7-4dae-867b-c7e2ca43c895 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:32.231488 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] Creating event network-vif-plugged:40619b23-550c-41ce-a969-700e42af64d7 for instance d783ddb6-bc96-4d25-9003-8c587ffefaec on nch2-master-1 Apr 02 21:04:32.232005 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] Creating event network-vif-plugged:acf81fb5-8fa8-4b26-bd2a-abf8b03e87f9 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:32.233239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:32.237697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:32.241398 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c57382e3-40ba-4d57-8be3-be112e1b06a3 req-04e5af4f-2649-4d43-a218-2f59c5d136ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.102319 Apr 02 21:04:32.242223 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1735/3808] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:32.249259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:32.260166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:32.272253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.278297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.279175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.279415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.280425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.282218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.282622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.283315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.389287 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1adf659b-9276-400e-a553-7a999ac65492 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.162207 Apr 02 21:04:32.390478 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2074/3809] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:04:32 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a/os-volume_attachments => generated 25 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:04:32.491937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:32.492537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:32.505317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.505838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.514327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.515141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.570656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:04:32.690420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:32.703411 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7197050b-bef9-4ae4-8763-652ebe586315 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.459785 Apr 02 21:04:32.727037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1736/3810] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:32 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:32.765197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b6c4b04-470f-41d1-99ee-eabd971f957e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 204 len: 0 microversion: 2.1 time: 0.276637 Apr 02 21:04:32.777867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:32.779834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:32.785063 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2075/3811] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:32 2022] DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:04:32.795052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.797817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:32.801348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:32.802799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:33.001427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:33.010791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d96ac018-7a42-454f-87cb-237e2a62db08 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1669 microversion: 2.1 time: 0.237354 Apr 02 21:04:33.011639 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1737/3812] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:32 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1669 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:33.061505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:33.065265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:33.076165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:33.078402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:33.081053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:33.082923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:33.110707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:33.111353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:33.134312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:33.134788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:33.140124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:33.140937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:33.377243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:33.388477 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-33008244-1a8e-4e54-81d1-165d88aff8c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.282264 Apr 02 21:04:33.393038 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1738/3813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:33 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:33.415308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:33.423590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abcefc2e-97d7-459f-81d3-b8b65bfdec92 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1318 microversion: 2.1 time: 0.367425 Apr 02 21:04:33.424823 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2076/3814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:33 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:33.724089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:33.725041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:33.737588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:33.740724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:33.743496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:33.745064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.011225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:34.030244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:34.031203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:34.046488 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6573252e-a1d3-452d-b979-c5c7b0c1be6f tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1355 microversion: 2.1 time: 0.327775 Apr 02 21:04:34.051383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.051846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.057332 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1739/3815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:33 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1355 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:34.058119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.058836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.269026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8dbd07af-bb5a-4ec9-80be-cee88f39a53f req-ba06aa36-4da8-4327-9078-992636b7086f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6072d790-7f5b-42a2-b398-e5521af36a5c", "name": "network-vif-plugged", "status": "completed", "tag": "b0b07539-5b31-495b-ae92-64bd4e85ef91"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:34.286022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8dbd07af-bb5a-4ec9-80be-cee88f39a53f req-ba06aa36-4da8-4327-9078-992636b7086f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.286743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8dbd07af-bb5a-4ec9-80be-cee88f39a53f req-ba06aa36-4da8-4327-9078-992636b7086f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.302558 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8dbd07af-bb5a-4ec9-80be-cee88f39a53f req-ba06aa36-4da8-4327-9078-992636b7086f service nova] Creating event network-vif-plugged:b0b07539-5b31-495b-ae92-64bd4e85ef91 for instance 6072d790-7f5b-42a2-b398-e5521af36a5c on nch1-master-1 Apr 02 21:04:34.309944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8dbd07af-bb5a-4ec9-80be-cee88f39a53f req-ba06aa36-4da8-4327-9078-992636b7086f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045789 Apr 02 21:04:34.311178 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1740/3816] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:34.412617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:34.414945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:34.437186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.438316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.439208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.442833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.691209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:34.703632 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f00fb8e-111c-4314-bba9-c067aede468c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.295469 Apr 02 21:04:34.703632 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1741/3817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:34 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:34.717386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:34.718251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:34.726980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.727613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:34.728823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:34.729362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.070618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:35.085764 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c69650e-3210-4728-8e4b-1bd3bffe8b71 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1507 microversion: 2.1 time: 0.380764 Apr 02 21:04:35.088297 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1742/3818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:34 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:35.101969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:35.102860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:35.121059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.121870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.122843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.123620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.393207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:35.401149 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-354a2720-da8c-4b79-8c85-a3148eeecf2d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1669 microversion: 2.1 time: 1.375597 Apr 02 21:04:35.414005 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2077/3819] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:34 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1669 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:35.419115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:35.419745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:35.440283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:35.444779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.445205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.446195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.446827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.450413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0f7a126-eca8-49f6-828e-6ddeac5d4199 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1805 microversion: 2.1 time: 0.360174 Apr 02 21:04:35.468545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1743/3820] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:35 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1805 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:35.478216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:35.478722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:35.487903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.488365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.489195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.500280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.535407 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc3815d2-52a9-47cb-a626-903750bc9dc3 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c/ips" status: 200 len: 218 microversion: 2.1 time: 0.061011 Apr 02 21:04:35.536208 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1744/3821] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:04:35 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c/ips => generated 218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:35.551606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:35.552119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:35.569352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.569817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.570669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.571067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.623237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:04:35.766542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d822849-d4ef-4e25-910d-2ae0cf219c81 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "DELETE /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 204 len: 0 microversion: 2.1 time: 0.218075 Apr 02 21:04:35.770566 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1745/3822] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:35 2022] DELETE /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:04:35.775066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:35.775888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:35.784764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.785686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.786572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.787249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.896038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:35.904222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f873525-d97e-4210-b8bd-d9a697adf224 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1507 microversion: 2.1 time: 0.488935 Apr 02 21:04:35.905048 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2078/3823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:35 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:35.920114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:35.921049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:35.939196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.939672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:35.940559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:35.941176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.322887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:36.331516 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2cb4db1e-7d72-49c5-b995-148b9d83f2e0 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1394 microversion: 2.1 time: 0.562257 Apr 02 21:04:36.342544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1746/3824] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:35 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1394 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:36.342544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:36.342769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:36.349441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.349902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.350948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.351394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.354994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:36.366339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-04452968-3bea-4ea2-a65e-be8a9e81c42b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1811 microversion: 2.1 time: 0.459884 Apr 02 21:04:36.370583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2079/3825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:35 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1811 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:36.418349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:36.419224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:36.431522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.435415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.436482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.463606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.484908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:04:36.485250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:04:36.485738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:04:36.486320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:04:36.486753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:04:36.597698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:36.627754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.630977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.633024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.633662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.655643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '449253ed73e04f47bcd09c3a1cca6e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da03d0fc36de405d87c8e99d209af9fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:36.665190 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afc3f495-b0e7-4796-a78e-cd17aee86405 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 200 len: 1602 microversion: 2.1 time: 0.251151 Apr 02 21:04:36.679748 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2080/3826] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:36 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 1602 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:36.745047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d405c8b-a32d-4e8c-bce2-a044f42b7bf4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "POST /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec/action" status: 202 len: 1109 microversion: 2.1 time: 0.408633 Apr 02 21:04:36.747553 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1747/3827] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:04:36 2022] POST /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec/action => generated 1109 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 02 21:04:36.761632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:36.763099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:36.776619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.777195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:36.778157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:36.778697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.001424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-35695c8f-b206-4b9d-b9bf-d3260f0c1af0 req-22f28d56-a965-4ffe-aa9e-4e7615bd164c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38215506-1d7a-4c7d-a1ac-044505a7d57a", "name": "network-vif-deleted", "tag": "db837a8b-f891-4234-9834-f700a43fd759"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:37.013679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-35695c8f-b206-4b9d-b9bf-d3260f0c1af0 req-22f28d56-a965-4ffe-aa9e-4e7615bd164c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.014602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-35695c8f-b206-4b9d-b9bf-d3260f0c1af0 req-22f28d56-a965-4ffe-aa9e-4e7615bd164c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.031102 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-35695c8f-b206-4b9d-b9bf-d3260f0c1af0 req-22f28d56-a965-4ffe-aa9e-4e7615bd164c service nova] Creating event network-vif-deleted:db837a8b-f891-4234-9834-f700a43fd759 for instance 38215506-1d7a-4c7d-a1ac-044505a7d57a on nch2-master-1 Apr 02 21:04:37.040781 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-35695c8f-b206-4b9d-b9bf-d3260f0c1af0 req-22f28d56-a965-4ffe-aa9e-4e7615bd164c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042872 Apr 02 21:04:37.046412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1748/3828] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:04:37.354611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:37.356780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:37.365653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.366717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.368164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.368885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.598099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:37.608688 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb38f807-f341-4b4c-9207-0c243c962ad7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1575 microversion: 2.1 time: 0.261378 Apr 02 21:04:37.611376 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1749/3829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:37 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:37.622616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:37.623797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:37.637931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.638764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.639894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.641708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.786878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:37.794649 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-774ffd54-dc3d-4b3f-91e3-80a69fe59345 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 1.037117 Apr 02 21:04:37.807034 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2081/3830] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:36 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:37.813636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:37.814433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:37.824073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.833306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.834661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.835501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.844772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:37.855910 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-515e5637-6d5d-48d6-86f6-b70d112dbc86 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1811 microversion: 2.1 time: 0.242260 Apr 02 21:04:37.866283 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1750/3831] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:37 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:37.866283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:37.866283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:37.874478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.874947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.875744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:37.876196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:37.919216 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] HTTP exception thrown: Instance 38215506-1d7a-4c7d-a1ac-044505a7d57a could not be found. Apr 02 21:04:37.920027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Returning 404 to user: Instance 38215506-1d7a-4c7d-a1ac-044505a7d57a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:37.920928 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed2dbaad-8e51-409c-85f3-7c0236ceaf1e tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 404 len: 111 microversion: 2.1 time: 0.061992 Apr 02 21:04:37.921942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1751/3832] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:37 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:37.933331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-14be92ff-33c5-4b0d-aa8a-52587097dc67 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '.version_select at 0x7f54d42e5040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:37.961695 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-14be92ff-33c5-4b0d-aa8a-52587097dc67 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-419848064" status: 202 len: 0 microversion: 2.1 time: 0.032681 Apr 02 21:04:37.978670 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1752/3833] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-419848064 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:04:38.127806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e63efca-53cc-4b63-ba70-85ecb94013ba tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319277 Apr 02 21:04:38.128993 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2082/3834] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:04:37 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:38.823996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:38.825209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:38.841930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:38.842429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:38.843252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:38.843697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:38.874046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:38.874662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:38.881017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:38.884378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:38.897766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:38.898414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:39.246437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:39.259829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ac52f74-d5f9-4ebf-8b9a-8670a311e4d3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.439147 Apr 02 21:04:39.259829 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1753/3835] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:38 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:39.643800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:39.657154 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9284219-b566-4cc4-98a7-d2e37fa423a8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1811 microversion: 2.1 time: 0.786764 Apr 02 21:04:39.657965 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2083/3836] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:38 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1811 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:39.977145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-9e4ad313-3744-46de-ad52-25a1df5e2f32 req-ced707b3-96f2-4fd6-af78-3a2f9447a5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-deleted", "tag": "2c7ec2c2-dab7-4dae-867b-c7e2ca43c895"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:40.004179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9e4ad313-3744-46de-ad52-25a1df5e2f32 req-ced707b3-96f2-4fd6-af78-3a2f9447a5ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.013891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9e4ad313-3744-46de-ad52-25a1df5e2f32 req-ced707b3-96f2-4fd6-af78-3a2f9447a5ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.039580 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-9e4ad313-3744-46de-ad52-25a1df5e2f32 req-ced707b3-96f2-4fd6-af78-3a2f9447a5ca service nova] Creating event network-vif-deleted:2c7ec2c2-dab7-4dae-867b-c7e2ca43c895 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:40.056708 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-9e4ad313-3744-46de-ad52-25a1df5e2f32 req-ced707b3-96f2-4fd6-af78-3a2f9447a5ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084565 Apr 02 21:04:40.057636 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1754/3837] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:40.276897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:40.277518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:40.286298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.287015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.288003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.288644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.507374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:40.508179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:40.518490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.520630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.522845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.523505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.791872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:40.804957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a344888-8623-4ec0-91ff-5dbd0fd09e65 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1575 microversion: 2.1 time: 0.303284 Apr 02 21:04:40.836378 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1755/3838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:40 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1575 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:40.850944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d312e233-7d37-4f74-9eec-437f03e3515d req-a15eada8-f332-4da7-9888-05fc67d90ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6072d790-7f5b-42a2-b398-e5521af36a5c", "tag": "b0b07539-5b31-495b-ae92-64bd4e85ef91"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:40.879939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d312e233-7d37-4f74-9eec-437f03e3515d req-a15eada8-f332-4da7-9888-05fc67d90ee6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.880788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d312e233-7d37-4f74-9eec-437f03e3515d req-a15eada8-f332-4da7-9888-05fc67d90ee6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.910313 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d312e233-7d37-4f74-9eec-437f03e3515d req-a15eada8-f332-4da7-9888-05fc67d90ee6 service nova] Creating event network-changed:b0b07539-5b31-495b-ae92-64bd4e85ef91 for instance 6072d790-7f5b-42a2-b398-e5521af36a5c on nch1-master-1 Apr 02 21:04:40.924117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d312e233-7d37-4f74-9eec-437f03e3515d req-a15eada8-f332-4da7-9888-05fc67d90ee6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083710 Apr 02 21:04:40.925388 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1756/3839] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:40.936090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:40.941366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:40.956750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.962172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:40.964277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:40.964931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:41.462536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:41.474464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d34eaf5-31e6-430f-b13d-11bdad4db4a6 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1675 microversion: 2.1 time: 0.545354 Apr 02 21:04:41.478237 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1757/3840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:40 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1675 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:41.519642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:41.543392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08d27073-29a8-4132-8eba-22dc4cf6ff1f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 1.267975 Apr 02 21:04:41.547024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2084/3841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:40 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:41.903867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:41.904382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:41.922956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:41.926538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:41.929712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:41.930183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:41.990111 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51d6215a-8501-4adb-9811-33cd7befa9dc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/ips" status: 200 len: 153 microversion: 2.20 time: 0.504179 Apr 02 21:04:41.997359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1758/3842] 10.222.0.18 () {60 vars in 1288 bytes} [Sat Apr 2 21:04:41 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/ips => generated 153 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:04:42.158622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d82a9823-ab26-46e4-9f5d-b93125008851 req-ea393d2a-e1e7-4e83-a2c6-cf8f9b38503c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-deleted", "tag": "acf81fb5-8fa8-4b26-bd2a-abf8b03e87f9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:42.175422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d82a9823-ab26-46e4-9f5d-b93125008851 req-ea393d2a-e1e7-4e83-a2c6-cf8f9b38503c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.175959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d82a9823-ab26-46e4-9f5d-b93125008851 req-ea393d2a-e1e7-4e83-a2c6-cf8f9b38503c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:42.222517 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d82a9823-ab26-46e4-9f5d-b93125008851 req-ea393d2a-e1e7-4e83-a2c6-cf8f9b38503c service nova] Creating event network-vif-deleted:acf81fb5-8fa8-4b26-bd2a-abf8b03e87f9 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:42.242319 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d82a9823-ab26-46e4-9f5d-b93125008851 req-ea393d2a-e1e7-4e83-a2c6-cf8f9b38503c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086174 Apr 02 21:04:42.243925 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2085/3843] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:42.498898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:42.499530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:42.511532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.511995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:42.517219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.534695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:42.563426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:42.564141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:42.589663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.593112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:42.594262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.594409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:42.883556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:42.896956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25653918-0502-4d12-9a87-c2126ecab300 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1496 microversion: 2.1 time: 0.404530 Apr 02 21:04:42.909004 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1759/3844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:42 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1496 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:42.975300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:42.976723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:42.985044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.985913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:42.987123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:42.987994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:43.005627 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] HTTP exception thrown: Instance 38215506-1d7a-4c7d-a1ac-044505a7d57a could not be found. Apr 02 21:04:43.006668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Returning 404 to user: Instance 38215506-1d7a-4c7d-a1ac-044505a7d57a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:43.007728 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-018726e5-b9d6-42fd-b063-310291d216d5 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 404 len: 111 microversion: 2.1 time: 0.036526 Apr 02 21:04:43.008822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1760/3845] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:42 2022] DELETE /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:43.017596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:43.018430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 38215506-1d7a-4c7d-a1ac-044505a7d57a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:43.029592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:43.030075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:43.031718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:43.032172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:43.057131 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] HTTP exception thrown: Instance 38215506-1d7a-4c7d-a1ac-044505a7d57a could not be found. Apr 02 21:04:43.062962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Returning 404 to user: Instance 38215506-1d7a-4c7d-a1ac-044505a7d57a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:43.065297 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07313038-5828-4691-bf9a-951ae5a748d3 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a" status: 404 len: 111 microversion: 2.1 time: 0.052049 Apr 02 21:04:43.066374 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1761/3846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:43 2022] GET /compute/v2.1/servers/38215506-1d7a-4c7d-a1ac-044505a7d57a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:43.749373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:43.758707 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b68f1d1-6884-4d79-9e2e-acfe24723ec7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 1.199675 Apr 02 21:04:43.768488 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2086/3847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:42 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:43.883222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2285d0cc-4222-4721-978c-13579056fcc8 req-2272286a-360b-4e90-9ce3-7a088af5b91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-unplugged", "status": "completed", "tag": "9c1b477f-22c8-4a4c-b760-ba163a584bc7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:43.894025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2285d0cc-4222-4721-978c-13579056fcc8 req-2272286a-360b-4e90-9ce3-7a088af5b91b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:43.895234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2285d0cc-4222-4721-978c-13579056fcc8 req-2272286a-360b-4e90-9ce3-7a088af5b91b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:43.914185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:43.914996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:43.918148 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2285d0cc-4222-4721-978c-13579056fcc8 req-2272286a-360b-4e90-9ce3-7a088af5b91b service nova] Creating event network-vif-unplugged:9c1b477f-22c8-4a4c-b760-ba163a584bc7 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:43.924533 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2285d0cc-4222-4721-978c-13579056fcc8 req-2272286a-360b-4e90-9ce3-7a088af5b91b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045091 Apr 02 21:04:43.925462 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1762/3848] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:43.931654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:43.932610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:43.933578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:43.934212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.169107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84f3b369-3204-4f05-8aca-88a60fb64a91 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: .version_select at 0x7f54c7fd40d0>, body: {"keypair": {"name": "tempest-keypair-1542094113"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:44.186071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-84f3b369-3204-4f05-8aca-88a60fb64a91 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:44.197669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-84f3b369-3204-4f05-8aca-88a60fb64a91 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:44.346179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:44.354491 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-320941f7-d761-4614-90c9-15ce55410f0b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 200 len: 1496 microversion: 2.1 time: 0.444188 Apr 02 21:04:44.355591 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2087/3849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:43 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 1496 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:44.367960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:44.376209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:44.393633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.394094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.394896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.395351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.450687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lazy-loading 'flavor' on Instance uuid 945e2822-5cfd-4165-9cf4-3d1f493dea62 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:04:44.561902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-84f3b369-3204-4f05-8aca-88a60fb64a91 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:44.570896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-84f3b369-3204-4f05-8aca-88a60fb64a91 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:44.601441 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84f3b369-3204-4f05-8aca-88a60fb64a91 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.498865 Apr 02 21:04:44.611301 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1763/3850] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:04:44 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:44.622365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:44.624199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:44.643925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.644821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.645777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.646379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.668115 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] HTTP exception thrown: Instance 259abe5f-f848-4966-b186-a747835eab18 could not be found. Apr 02 21:04:44.672902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Returning 404 to user: Instance 259abe5f-f848-4966-b186-a747835eab18 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:44.674417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-226ab13f-c7e4-4396-80fa-1e05f1fa3d1d tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "DELETE /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 404 len: 111 microversion: 2.1 time: 0.061789 Apr 02 21:04:44.677179 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1764/3851] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:04:44 2022] DELETE /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:44.687871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3fde7ee7-4335-46c3-98b2-de3fbaa8ae68 req-bf567ff3-a5f3-410a-abe2-c9aa3e89e105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db18096f-bb45-4197-adab-83d481a03a2c", "name": "network-vif-deleted", "tag": "9c1b477f-22c8-4a4c-b760-ba163a584bc7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:44.709505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3fde7ee7-4335-46c3-98b2-de3fbaa8ae68 req-bf567ff3-a5f3-410a-abe2-c9aa3e89e105 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.710832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3fde7ee7-4335-46c3-98b2-de3fbaa8ae68 req-bf567ff3-a5f3-410a-abe2-c9aa3e89e105 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.728511 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3fde7ee7-4335-46c3-98b2-de3fbaa8ae68 req-bf567ff3-a5f3-410a-abe2-c9aa3e89e105 service nova] Creating event network-vif-deleted:9c1b477f-22c8-4a4c-b760-ba163a584bc7 for instance db18096f-bb45-4197-adab-83d481a03a2c on nch1-master-1 Apr 02 21:04:44.735073 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3fde7ee7-4335-46c3-98b2-de3fbaa8ae68 req-bf567ff3-a5f3-410a-abe2-c9aa3e89e105 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056392 Apr 02 21:04:44.735567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1765/3852] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:44.753647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:44.754354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] [instance: 259abe5f-f848-4966-b186-a747835eab18] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:44.762592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.763055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.763835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.769625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.786273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] HTTP exception thrown: Instance 259abe5f-f848-4966-b186-a747835eab18 could not be found. Apr 02 21:04:44.787125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] Returning 404 to user: Instance 259abe5f-f848-4966-b186-a747835eab18 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:44.788143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3dbae41d-5a92-4dc8-86a5-0d0f5ce75fc0 tempest-AttachVolumeTestJSON-889852705 tempest-AttachVolumeTestJSON-889852705-project] 10.222.0.18 "GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18" status: 404 len: 111 microversion: 2.1 time: 0.038759 Apr 02 21:04:44.789282 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1766/3853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:44 2022] GET /compute/v2.1/servers/259abe5f-f848-4966-b186-a747835eab18 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:44.794901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:44.795833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:44.803266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.803912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.805417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.806159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.921077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-151e6273-2d66-4858-9ca5-e1a7d311fd88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/action" status: 202 len: 0 microversion: 2.20 time: 0.563661 Apr 02 21:04:44.925142 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2088/3854] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:04:44 2022] POST /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:04:44.933284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:44.934996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:44.944537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.945579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:44.946813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:44.947793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:45.142882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:45.157854 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5a5193c7-459e-4de8-9cd4-58e7a943838a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.366821 Apr 02 21:04:45.160739 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1767/3855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:44 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:45.375702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:45.376337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:45.396903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:45.399708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:45.401960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:45.405856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:45.441447 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] HTTP exception thrown: Instance db18096f-bb45-4197-adab-83d481a03a2c could not be found. Apr 02 21:04:45.442819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Returning 404 to user: Instance db18096f-bb45-4197-adab-83d481a03a2c could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:04:45.446513 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3083700-9867-4dc2-98b8-1784ac9eec0a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 404 len: 111 microversion: 2.1 time: 0.072220 Apr 02 21:04:45.452781 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1768/3856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:45 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:04:45.630536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:45.642637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:45.647883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:45.655044 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef0a5825-3533-4793-a075-20e134fd200f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.727670 Apr 02 21:04:45.666346 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2089/3857] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:44 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:46.185515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:46.186854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:46.200602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:46.202590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:46.205137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:46.206411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:46.675097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:46.675741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:46.689861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:46.690328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:46.691162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:46.691598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:46.796962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:46.808094 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b855559f-f333-4618-8258-e44e81bb9e65 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.632670 Apr 02 21:04:46.809549 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1769/3858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:46 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:47.099196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:47.118410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:47.120332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:47.122346 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f081e407-3d5e-467b-9bde-c31862748dd3 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.452543 Apr 02 21:04:47.135649 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2090/3859] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:46 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:04:47.826658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:47.827858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:47.837295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:47.841558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:47.846728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:47.847307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:48.142446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:48.143682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:48.155416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:48.156139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:48.157217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:48.158209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:48.505263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:48.536364 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17182786-5c22-4f9c-9f45-d498fe9a6f94 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.704528 Apr 02 21:04:48.539438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1770/3860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:47 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:48.717064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:48.728556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:48.730076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:48.738820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ed93d73-1c76-43b6-9935-8d7445ea2b63 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.593490 Apr 02 21:04:48.740948 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2091/3861] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:48 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:04:48.867006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-156347069", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e11fe41-71ae-4517-9435-793475d4d7b5"}], "security_groups": [{"name": "tempest-securitygroup--1056244659"}], "key_name": "tempest-keypair-1542094113", "user_data": "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:49.102147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] validate_networks() for [('8e11fe41-71ae-4517-9435-793475d4d7b5', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:04:49.557232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:49.558435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:49.568159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:49.568830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:49.570390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:49.572336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:50.084753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:50.093553 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85fb415f-b5c4-4e6a-844a-3885ae95fc54 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.541762 Apr 02 21:04:50.109289 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2092/3862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:49 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:50.120633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:50.121566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:50.143823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:50.153156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:50.154304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:50.154921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:50.397489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:04:50.398771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:04:50.399684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:04:50.401018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:04:50.401696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:04:50.426684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:50.427149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:50.427978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:50.428795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:50.452917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:50.460971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:50.490312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:04:50.494820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:04:50.576216 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d3c278f-2eac-4f12-82cf-6f7e4c84215f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.716487 Apr 02 21:04:50.577664 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1771/3863] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:04:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:04:50.587888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08fb1108-7ae2-4be4-8e21-97f5b19d5f46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:50.588967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-08fb1108-7ae2-4be4-8e21-97f5b19d5f46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:50.674648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-08fb1108-7ae2-4be4-8e21-97f5b19d5f46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:50.682332 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08fb1108-7ae2-4be4-8e21-97f5b19d5f46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1241 microversion: 2.1 time: 0.098778 Apr 02 21:04:50.696837 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1772/3864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:50 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:50.797979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:50.823444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:50.825072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:50.836825 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f028c64d-11c0-4130-9b68-291b7ee89bd5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.725852 Apr 02 21:04:50.839179 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2093/3865] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:50 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:51.117436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:51.118230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:51.139328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:51.147221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:51.151279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:51.155992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:51.701948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:51.702901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:51.718284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:51.723562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:51.727505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:51.733514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:51.749045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:51.756795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca319f5e-bd93-4452-b5b5-e98ec8a90202 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.644557 Apr 02 21:04:51.764828 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1773/3866] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:51 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:51.856211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:51.857178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:51.869268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:51.873437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:51.874530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:51.875210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:51.954933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:51.966071 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1277baa7-25b2-40da-9b03-b46b82a69bf3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1237 microversion: 2.1 time: 0.268649 Apr 02 21:04:51.978154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2094/3867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:51 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1237 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:52.384714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:52.403647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:52.405312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:52.406540 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21dd5e18-8fc4-422d-af3c-097dd192ab0f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.555226 Apr 02 21:04:52.407136 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1774/3868] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:51 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:52.774467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:52.775313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:52.790939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:52.793576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:52.795708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:52.797625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:52.985462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:52.986151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:53.006019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:53.009586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:53.011562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:53.012861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:53.081115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:53.098939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2a84b278-8e8d-40f9-8a66-6f55b8e68eff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.327864 Apr 02 21:04:53.100063 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2095/3869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:52 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:53.208374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:53.225642 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ef7554f-a4cd-47ca-95d4-5796ffabd576 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1299 microversion: 2.1 time: 0.244442 Apr 02 21:04:53.232866 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1775/3870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:52 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:04:53.425407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:53.426679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:53.432971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:53.433801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:53.434881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:53.435546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:53.651828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:53.662086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:53.669973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:53.672291 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc2ffc7d-c5d8-4f09-8d73-1104b35a117b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.250887 Apr 02 21:04:53.674689 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2096/3871] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:53 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:54.116851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:54.117608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:54.124551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:54.124939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:54.126286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:54.126739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:54.252140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:54.252978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:54.266270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:54.268981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:54.272491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:54.273129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:54.722881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:54.733384 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ac69f05-3c86-4f50-a55a-ca8cc1ca6405 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.621185 Apr 02 21:04:54.737314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1776/3872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:54 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:54.768569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:54.769772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:54.786837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:54.787976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:54.790545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:54.791249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:54.849314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:54.864086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4184bce-1a46-4fbc-b0d9-30ffefd3af8a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.624491 Apr 02 21:04:54.865113 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2097/3873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:54 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:55.119333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-114340081", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "f586152a-990b-40c9-8526-6fd404717ef3"}, {"uuid": "29461d6a-57f0-42a8-887c-5bb0eba05a47"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:55.230970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] validate_networks() for [('f586152a-990b-40c9-8526-6fd404717ef3', None, None, None, None, None), ('29461d6a-57f0-42a8-887c-5bb0eba05a47', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:04:55.369995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:55.385976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:55.388842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:55.390484 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8dd912ca-320d-4ac0-8db7-715ce1b67e03 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.650527 Apr 02 21:04:55.392081 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1777/3874] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:54 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:55.755080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:55.755718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:55.779875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:55.781610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:55.786705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:55.788204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:56.473229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:56.483923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b524a72-8a1c-40ef-9456-de6d135d227b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.733791 Apr 02 21:04:56.485607 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1778/3875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:55 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:56.491988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:56.493011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:56.508107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:56.514438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:56.515311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:56.515767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:56.637684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:04:56.638100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:04:56.638585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:04:56.639002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:04:56.639432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:04:56.667609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:56.668119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:56.673439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:56.677588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:56.763713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Getting quotas for project 6ae16de34fd342cda85aa2bd981452c4. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:04:56.778129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Getting quotas for user 437b151556e04bdfa22a80b72f34c088 and project 6ae16de34fd342cda85aa2bd981452c4. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:04:56.825982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:04:56.828768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:04:56.981421 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a4cf41b8-4319-4c33-806a-7212535014ce tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.869645 Apr 02 21:04:56.982135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2098/3876] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:04:56.991510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:56.992166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:57.011516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:57.012587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:57.013561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:57.014175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:57.354517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:57.375093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:57.377056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:57.378839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a9d5e94-08f3-47d1-9ef3-dac68167c79a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.395788 Apr 02 21:04:57.392073 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2099/3877] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:56 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:57.397462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cc0b2f30-1669-42d6-b442-cb3c9b3b53d8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:57.398085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cc0b2f30-1669-42d6-b442-cb3c9b3b53d8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:57.503037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cc0b2f30-1669-42d6-b442-cb3c9b3b53d8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:57.532419 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cc0b2f30-1669-42d6-b442-cb3c9b3b53d8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1212 microversion: 2.1 time: 0.137815 Apr 02 21:04:57.534492 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2100/3878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:57 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:57.549937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:57.550579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:57.571660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:57.572428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:57.573834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:57.574485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:57.800112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:57.811396 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-10507b43-3ad0-4634-9715-4a47a154cb6e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 1.322816 Apr 02 21:04:57.812267 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1779/3879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:56 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:57.957992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:57.972241 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4668bd85-5125-4739-a7e5-317cca636e8e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.436470 Apr 02 21:04:57.975084 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2101/3880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:57 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:57.991314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-74af9ab4-b0ad-4ffd-9995-b8c7c4391734 req-b8ad1c69-64dc-4170-a2cb-f6633b86b857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58df85ac-b402-424d-8354-fc927aad0d32", "tag": "d4d64426-ae59-4e94-a2da-c586004c8607"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:04:58.007320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-74af9ab4-b0ad-4ffd-9995-b8c7c4391734 req-b8ad1c69-64dc-4170-a2cb-f6633b86b857 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.012809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-74af9ab4-b0ad-4ffd-9995-b8c7c4391734 req-b8ad1c69-64dc-4170-a2cb-f6633b86b857 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.049809 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-74af9ab4-b0ad-4ffd-9995-b8c7c4391734 req-b8ad1c69-64dc-4170-a2cb-f6633b86b857 service nova] Creating event network-changed:d4d64426-ae59-4e94-a2da-c586004c8607 for instance 58df85ac-b402-424d-8354-fc927aad0d32 on nch2-master-1 Apr 02 21:04:58.056437 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-74af9ab4-b0ad-4ffd-9995-b8c7c4391734 req-b8ad1c69-64dc-4170-a2cb-f6633b86b857 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069098 Apr 02 21:04:58.057736 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1780/3881] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:04:58.398068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:58.398699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:58.408766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.412358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.416496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.420420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.549813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:58.550541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:58.564447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.570277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.571665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.572944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.807656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:58.819475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:58.821587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e41079db-f237-45a4-b1e5-cfa6398e04d5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1264 microversion: 2.1 time: 0.274268 Apr 02 21:04:58.836466 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1781/3882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:58 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1264 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:58.843175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:58.845072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:58.846528 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca0e9bf5-5b3c-4bd5-aca8-2bec01d6eacb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.452854 Apr 02 21:04:58.847125 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2102/3883] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:04:58 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:04:58.858035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:58.858866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:58.875570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.876906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.879255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:58.882424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:58.992577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:58.993313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:59.007435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:59.012965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:59.014532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:59.022271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:59.429448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:04:59.439891 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-03eab09f-b668-4e42-bec1-b4bc41f6212f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.600828 Apr 02 21:04:59.448974 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1782/3884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:58 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:04:59.842213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:04:59.842915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:04:59.854114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:59.857393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:04:59.864283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:04:59.866261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:00.001897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:00.011060 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ea87acb-14b1-4c9a-983d-c022c849a9b0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1270 microversion: 2.1 time: 0.173424 Apr 02 21:05:00.026707 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1783/3885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:59 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:00.052120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:00.053202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:00.069922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:00.070759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:00.071837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:00.072777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:00.411753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:00.424133 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90a9b9db-b71d-4a7b-9cd8-6e0bd2aa05fe tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 1.435268 Apr 02 21:05:00.436337 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2103/3886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:04:58 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:00.461389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:00.462010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:00.471557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:00.472024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:00.472851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:00.473298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:00.635131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:00.650764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:00.664858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:00.672727 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e3dd2a87-3c38-46e5-9cf2-ab687ffe13f7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.642291 Apr 02 21:05:00.673453 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1784/3887] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:00 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:00.872590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:00.881713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfc76e6d-3d5f-4d45-8990-0282bc3a0a76 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.424069 Apr 02 21:05:00.887865 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2104/3888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:00 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:01.035923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:01.036603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:01.055226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:01.055774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:01.059297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:01.061033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:01.218792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:01.226958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8e4da3af-2456-4877-b6af-cb7dc7b16261 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1270 microversion: 2.1 time: 0.195899 Apr 02 21:05:01.227565 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1785/3889] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:01 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:01.448806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:01.455262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:01.475833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:01.477959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:01.479668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:01.481655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:01.693461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:01.694889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:01.728890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:01.731644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:01.746160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:01.746800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:01.990032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:02.001168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:02.003716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:02.004995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5dcd3620-8b5b-47eb-817d-85fe7537b6c9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1744 microversion: 2.20 time: 0.317618 Apr 02 21:05:02.006113 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1786/3890] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:01 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1744 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:02.012475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:02.013317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:02.020589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:02.021060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:02.021851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:02.022805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:02.039668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:02.055826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c69a83eb-1ad1-4911-9e49-410947879d96 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.617825 Apr 02 21:05:02.056835 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2105/3891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:01 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:02.246922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:02.247726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:02.257621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:02.258375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:02.260039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:02.260694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:02.302890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:02.317307 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2906584e-355a-425a-bf41-6083cb992bc6 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.306827 Apr 02 21:05:02.319715 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1787/3892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:02 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:02.588604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:02.599646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d747ad3-0af4-445b-b1f2-009abb702e9b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1312 microversion: 2.1 time: 0.358907 Apr 02 21:05:02.601300 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2106/3893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:02 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:03.025275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:03.026239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:03.033693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.034401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.035390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.035837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.077530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:03.078664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:03.094119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.094915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.096985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.099827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.369280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:03.382551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:03.394899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:03.399672 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-33d92fea-3ea2-4662-86ca-660aa5380a3d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1744 microversion: 2.20 time: 0.378797 Apr 02 21:05:03.400288 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1788/3894] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:03 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1744 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:03.420358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:03.424933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:03.432414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.433169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.434178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.434626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.509188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:03.535391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c1d4076-daf6-4262-8311-adf5390fa22e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1514 microversion: 2.1 time: 0.461731 Apr 02 21:05:03.537105 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2107/3895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:03 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:03.600784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:03.623931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:03.624602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:03.633058 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6803f896-ead1-4058-abc7-0c1702ad78fd tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.229470 Apr 02 21:05:03.634018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1789/3896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:03 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:03.634161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.634489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.635362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:03.635816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:03.875866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:03.883986 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4603a72-0a7c-43d8-b47f-9be7f86432e4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.271586 Apr 02 21:05:03.894896 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2108/3897] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:03 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:04.170231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-35b23780-09ca-45f6-8b5f-44e21f5f85ac req-763b4572-ec11-4152-a799-7f72a503c682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "name": "network-vif-plugged", "status": "completed", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:04.192694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-35b23780-09ca-45f6-8b5f-44e21f5f85ac req-763b4572-ec11-4152-a799-7f72a503c682 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.193670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-35b23780-09ca-45f6-8b5f-44e21f5f85ac req-763b4572-ec11-4152-a799-7f72a503c682 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.224011 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-35b23780-09ca-45f6-8b5f-44e21f5f85ac req-763b4572-ec11-4152-a799-7f72a503c682 service nova] Creating event network-vif-plugged:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:05:04.231663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-35b23780-09ca-45f6-8b5f-44e21f5f85ac req-763b4572-ec11-4152-a799-7f72a503c682 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068125 Apr 02 21:05:04.233017 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1790/3898] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:04.307733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7a4fe74a-3c8f-46ce-8397-37eb34808f6e req-86eed136-6c9c-42c0-bc8d-e152c581b366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da37dfd0-c659-4274-8d98-acbbe82db587", "tag": "3ed90c57-8d97-4048-b9af-fc0bea1656f4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:04.321003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7a4fe74a-3c8f-46ce-8397-37eb34808f6e req-86eed136-6c9c-42c0-bc8d-e152c581b366 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.325799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7a4fe74a-3c8f-46ce-8397-37eb34808f6e req-86eed136-6c9c-42c0-bc8d-e152c581b366 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.346161 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7a4fe74a-3c8f-46ce-8397-37eb34808f6e req-86eed136-6c9c-42c0-bc8d-e152c581b366 service nova] Creating event network-changed:3ed90c57-8d97-4048-b9af-fc0bea1656f4 for instance da37dfd0-c659-4274-8d98-acbbe82db587 on nch1-master-1 Apr 02 21:05:04.354463 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7a4fe74a-3c8f-46ce-8397-37eb34808f6e req-86eed136-6c9c-42c0-bc8d-e152c581b366 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052772 Apr 02 21:05:04.355570 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2109/3899] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:04.423231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:04.430382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:04.437122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.437964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.439303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.439955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.555125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:04.556554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:04.566222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.566773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.568037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.568747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.881955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:04.883750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:04.897533 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70cf0898-e1a9-442c-a6bb-3d5c56f32f9b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1520 microversion: 2.1 time: 0.348240 Apr 02 21:05:04.898335 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2110/3900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:04 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:04.902079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:04.905197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:04.906347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:04.906929 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cd96a6f-d50f-449d-ae80-89fadbe55ceb tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1744 microversion: 2.20 time: 0.489424 Apr 02 21:05:04.907087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:04.920443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.922625 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1791/3901] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:04 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1744 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:04.923793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.926837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.927302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.941783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:04.943394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:04.952863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.953322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:04.954286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:04.957521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:05.275052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:05.290358 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd48f3e2-ab80-44dd-9204-7cc2c3696a78 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.361555 Apr 02 21:05:05.296228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:05.303221 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1792/3902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:04 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:05.311076 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1610f82b-c093-4b1e-afdd-3a755529424c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.404346 Apr 02 21:05:05.312061 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2111/3903] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:04 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:05.915118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:05.915747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:05.929173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:05.929741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:05.929939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:05.930671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:05.932166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:05.935353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:05.945865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:05.946690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:05.947745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:05.949356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.246543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:06.262916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:06.265061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:06.266412 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf0245ad-d45b-4cf3-b917-7fe6b7b2715f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.342024 Apr 02 21:05:06.273674 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2112/3904] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:05 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:06.283909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-bea7228b-0310-40ea-bb0e-095faa105754 req-e793493a-8f35-4b4c-b75b-23e25f7562d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58df85ac-b402-424d-8354-fc927aad0d32", "name": "network-vif-plugged", "status": "completed", "tag": "d4d64426-ae59-4e94-a2da-c586004c8607"}, {"server_uuid": "d783ddb6-bc96-4d25-9003-8c587ffefaec", "name": "network-vif-unplugged", "status": "completed", "tag": "40619b23-550c-41ce-a969-700e42af64d7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:06.306226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bea7228b-0310-40ea-bb0e-095faa105754 req-e793493a-8f35-4b4c-b75b-23e25f7562d0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:06.306329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bea7228b-0310-40ea-bb0e-095faa105754 req-e793493a-8f35-4b4c-b75b-23e25f7562d0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.321694 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-bea7228b-0310-40ea-bb0e-095faa105754 req-e793493a-8f35-4b4c-b75b-23e25f7562d0 service nova] Creating event network-vif-plugged:d4d64426-ae59-4e94-a2da-c586004c8607 for instance 58df85ac-b402-424d-8354-fc927aad0d32 on nch2-master-1 Apr 02 21:05:06.323857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-bea7228b-0310-40ea-bb0e-095faa105754 req-e793493a-8f35-4b4c-b75b-23e25f7562d0 service nova] Creating event network-vif-unplugged:40619b23-550c-41ce-a969-700e42af64d7 for instance d783ddb6-bc96-4d25-9003-8c587ffefaec on nch2-master-1 Apr 02 21:05:06.335625 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-bea7228b-0310-40ea-bb0e-095faa105754 req-e793493a-8f35-4b4c-b75b-23e25f7562d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.058544 Apr 02 21:05:06.337095 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2113/3905] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:06.344949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:06.347157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:06.356100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:06.358410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.363717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:06.364718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.387598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:06.397581 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd91972d-06ec-4375-b351-e03ca4dbbbe4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1520 microversion: 2.1 time: 0.486019 Apr 02 21:05:06.398398 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1793/3906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:05 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:06.403816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:06.404666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:06.414291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:06.415614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.416919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:06.417369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.731388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:06.739087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b81e34e-e711-4c62-ade1-3de1cdbfa050 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.339498 Apr 02 21:05:06.739685 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1794/3907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:06 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:06.754938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:06.759714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e2dea871-4d75-4c39-a095-effbfaaebd7f req-34cdde37-2734-48ab-a103-f3f6b0f03aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da37dfd0-c659-4274-8d98-acbbe82db587", "tag": "de499a6a-bf1d-4c94-8fd3-69e07ebfa1b0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:06.774199 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dfcb1c26-2a83-491c-b5b6-86e3fd020b20 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.435596 Apr 02 21:05:06.782918 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2114/3908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:06 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:06.785091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e2dea871-4d75-4c39-a095-effbfaaebd7f req-34cdde37-2734-48ab-a103-f3f6b0f03aad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:06.787307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e2dea871-4d75-4c39-a095-effbfaaebd7f req-34cdde37-2734-48ab-a103-f3f6b0f03aad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:06.813540 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e2dea871-4d75-4c39-a095-effbfaaebd7f req-34cdde37-2734-48ab-a103-f3f6b0f03aad service nova] Creating event network-changed:de499a6a-bf1d-4c94-8fd3-69e07ebfa1b0 for instance da37dfd0-c659-4274-8d98-acbbe82db587 on nch1-master-1 Apr 02 21:05:06.820658 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e2dea871-4d75-4c39-a095-effbfaaebd7f req-34cdde37-2734-48ab-a103-f3f6b0f03aad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079606 Apr 02 21:05:06.821868 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1795/3909] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:07.293129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:07.293855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:07.312209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.312791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.313809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.315728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.417357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:07.419099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:07.430348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.434727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.437200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.438666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.823038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:07.833414 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b59b3a33-e6d1-4745-99a0-0b423aaeaf33 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1520 microversion: 2.1 time: 0.419574 Apr 02 21:05:07.842346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:07.845973 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1796/3910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:07 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:07.854674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:07.854674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:07.858490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:07.865374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:07.866742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e66ff18a-9134-425e-bf81-f6f65699b312 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.579532 Apr 02 21:05:07.875523 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2115/3911] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:07 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:07.881726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:07.883659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:07.886115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.887339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.888540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.891593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.895320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.897617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:07.917286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:07.919549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:08.246137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:08.255732 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-522c8265-0cfa-4c97-bd2c-cd47230038a8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1367 microversion: 2.1 time: 0.408629 Apr 02 21:05:08.258581 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1797/3912] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:07 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:08.862406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:08.863752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:08.882871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:08.883588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:08.884714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:08.885377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.056016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:09.070814 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-025ab033-1a81-4ad1-84d6-6a690b4c8825 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 1.193879 Apr 02 21:05:09.073338 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2116/3913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:07 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:09.084589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:09.089084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:09.107746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:09.108543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.111478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:09.112128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.240163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:09.254370 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24689285-d0a5-46eb-ac8b-35403df4438d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1520 microversion: 2.1 time: 0.395520 Apr 02 21:05:09.260236 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1798/3914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:08 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:09.283231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:09.283878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:09.295291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:09.297188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.298007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:09.298464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.604444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:09.627663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c3217ee-bb6d-4157-b691-0caa921efe80 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1558 microversion: 2.1 time: 0.350376 Apr 02 21:05:09.628259 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1799/3915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:09 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1558 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:09.655391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:09.655926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:09.670666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:09.671130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.671946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:09.672389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:09.777752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:09.791016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:09.794643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:09.796584 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7939183-1d87-4dbb-9c46-4c6bfea71263 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.720759 Apr 02 21:05:09.797647 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2117/3916] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:09 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:09.847017 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7591c65f-ff9a-4ad7-bf88-5080f3a0c4b9 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.202771 Apr 02 21:05:09.857020 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1800/3917] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:05:09 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:10.091982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:10.093294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:10.117531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:10.118513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:10.124869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:10.126588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:10.278256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:10.279590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:10.288986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:10.289828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:10.290902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:10.291575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:10.683966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:10.708623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1e4e5ff-279d-46a6-a4e1-798a81053db8 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.621891 Apr 02 21:05:10.714834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2118/3918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:10 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:10.818233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:10.818975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:10.851442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:10.857145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:10.858616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:10.859094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:11.772215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:11.800391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:11.806133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:11.811835 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-433db2a2-9abc-477b-96a7-11c78faa0ad6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.998212 Apr 02 21:05:11.813371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2119/3919] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:10 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:11.825171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:11.826390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:11.842287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:11.843477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:11.844627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:11.845287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:11.999278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:12.027154 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74621a53-0ad7-4665-8bae-125387d4a377 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1520 microversion: 2.1 time: 1.755639 Apr 02 21:05:12.027753 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1801/3920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:10 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1520 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:12.041032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1cf20f5c-f6b1-4e36-bb94-8582795b22cc tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Action: 'create', calling method: .version_select at 0x7f54d4aff4c0>, body: {"keypair": {"name": "tempest-keypair-1949193056"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:12.089044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1cf20f5c-f6b1-4e36-bb94-8582795b22cc tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Getting quotas for project fad5516982b843a9a35e49795fda0844. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:12.103381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1cf20f5c-f6b1-4e36-bb94-8582795b22cc tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Getting quotas for user ee1c48c096304c819e0eac11e84aef26 and project fad5516982b843a9a35e49795fda0844. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:12.124899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:12.135212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa8ed88c-9b64-45cc-a27c-d72ba80da77e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.319721 Apr 02 21:05:12.136733 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2120/3921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:11 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:12.185351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ec24b0c9-82e2-47da-b8f4-74d145147045 req-e9fd1cb3-0c1f-45b9-976c-d3eb060647dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d783ddb6-bc96-4d25-9003-8c587ffefaec", "name": "network-vif-plugged", "status": "completed", "tag": "40619b23-550c-41ce-a969-700e42af64d7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:12.207869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ec24b0c9-82e2-47da-b8f4-74d145147045 req-e9fd1cb3-0c1f-45b9-976c-d3eb060647dd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:12.208923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ec24b0c9-82e2-47da-b8f4-74d145147045 req-e9fd1cb3-0c1f-45b9-976c-d3eb060647dd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:12.249156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ec24b0c9-82e2-47da-b8f4-74d145147045 req-e9fd1cb3-0c1f-45b9-976c-d3eb060647dd service nova] Creating event network-vif-plugged:40619b23-550c-41ce-a969-700e42af64d7 for instance d783ddb6-bc96-4d25-9003-8c587ffefaec on nch2-master-1 Apr 02 21:05:12.258410 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ec24b0c9-82e2-47da-b8f4-74d145147045 req-e9fd1cb3-0c1f-45b9-976c-d3eb060647dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075963 Apr 02 21:05:12.260836 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2121/3922] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:12.595074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1cf20f5c-f6b1-4e36-bb94-8582795b22cc tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Getting quotas for project fad5516982b843a9a35e49795fda0844. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:12.603440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1cf20f5c-f6b1-4e36-bb94-8582795b22cc tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Getting quotas for user ee1c48c096304c819e0eac11e84aef26 and project fad5516982b843a9a35e49795fda0844. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:12.624682 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1cf20f5c-f6b1-4e36-bb94-8582795b22cc tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.588383 Apr 02 21:05:12.625789 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1802/3923] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 21:05:12 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 591 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:05:12.733815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4f52f72c-6d58-44a2-bb33-9d02cf1662d7 req-b8d2db81-a8e9-4006-a213-71a78c8c611c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58df85ac-b402-424d-8354-fc927aad0d32", "tag": "d4d64426-ae59-4e94-a2da-c586004c8607"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:12.748678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4f52f72c-6d58-44a2-bb33-9d02cf1662d7 req-b8d2db81-a8e9-4006-a213-71a78c8c611c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:12.749490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4f52f72c-6d58-44a2-bb33-9d02cf1662d7 req-b8d2db81-a8e9-4006-a213-71a78c8c611c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:12.768268 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4f52f72c-6d58-44a2-bb33-9d02cf1662d7 req-b8d2db81-a8e9-4006-a213-71a78c8c611c service nova] Creating event network-changed:d4d64426-ae59-4e94-a2da-c586004c8607 for instance 58df85ac-b402-424d-8354-fc927aad0d32 on nch2-master-1 Apr 02 21:05:12.776220 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4f52f72c-6d58-44a2-bb33-9d02cf1662d7 req-b8d2db81-a8e9-4006-a213-71a78c8c611c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049944 Apr 02 21:05:12.782694 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2122/3924] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:05:12.836632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:12.837862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:12.869684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:12.872760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:12.889080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:12.890593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:13.046353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:13.047014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:13.059956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:13.060426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:13.064676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:13.065156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:13.393673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:13.421299 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f88d409-5381-421d-9158-7d7bec1da133 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1520 microversion: 2.1 time: 0.381138 Apr 02 21:05:13.422393 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2123/3925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:13 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:13.437659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:13.438610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:13.456146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:13.456362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:13.458299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:13.461738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:13.535572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:13.547538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:13.567677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:13.581208 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71b8f2ba-a02a-4f95-a497-a4661e0b7da8 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.753556 Apr 02 21:05:13.581825 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1803/3926] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:12 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:13.831896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:13.848770 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dfc189b0-5438-49a8-b962-1a4138fceb07 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.425221 Apr 02 21:05:13.851800 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2124/3927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:13 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:14.438966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:14.439603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:14.462136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:14.462603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:14.463500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:14.463950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:14.599726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:14.600686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:14.616760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:14.617640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:14.618714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:14.619448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:14.884565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:14.894001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:14.903526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:14.905881 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec8a506b-4db5-431c-9051-42ac543db5e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.310071 Apr 02 21:05:14.907815 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2125/3928] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:14 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:14.914826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:14.921615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:14.928999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:14.930019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:14.931083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:14.931762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:15.108603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:15.108603 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-badcd38d-7d6e-4536-af06-68be431d349a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1505 microversion: 2.1 time: 0.653167 Apr 02 21:05:15.108603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1804/3929] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:14 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1505 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:15.123023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:15.127730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:15.139775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:15.143408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:15.144296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:15.145142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:15.198280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:15.209563 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f6fbcad-42f6-4f8a-a469-783cc963304c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.300071 Apr 02 21:05:15.213055 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2126/3930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:14 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:15.787059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:15.795410 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b23d7408-035d-4fc2-81ea-d9040a51172a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 200 len: 1505 microversion: 2.1 time: 0.688863 Apr 02 21:05:15.796156 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1805/3931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:15 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:15.814374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:15.814884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:15.823055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:15.824303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:15.825337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:15.827330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:15.898195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:05:15.928145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:15.930439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:15.944595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:15.946418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:15.947515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:15.949924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:16.086144 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0712abcc-ccb6-4a4b-8378-c413e84e7293 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 204 len: 0 microversion: 2.1 time: 0.278002 Apr 02 21:05:16.086968 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2127/3932] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:05:15 2022] DELETE /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:05:16.229327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:16.232111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:16.262537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:16.263973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:16.271486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:16.275138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:16.310718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:16.334360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:16.336405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:16.338356 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62b6e9ad-c410-4290-a223-0f90d8bb9c53 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.415169 Apr 02 21:05:16.340480 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1806/3933] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:15 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:16.346105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-723947003", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "a152d338-1362-4112-aded-4ce4e8c5efcf"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:16.447361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] validate_networks() for [('a152d338-1362-4112-aded-4ce4e8c5efcf', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:05:16.606648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:16.615309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3345174d-8455-4d66-a6b4-a8717b23e3f0 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.392642 Apr 02 21:05:16.616491 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2128/3934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:16 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:16.939022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b6017333-c86a-4675-9c5c-0c7b6280b4ef req-3bc12f97-7c92-495d-81e4-aaead7291b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da37dfd0-c659-4274-8d98-acbbe82db587", "name": "network-vif-plugged", "status": "completed", "tag": "3ed90c57-8d97-4048-b9af-fc0bea1656f4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:16.960578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b6017333-c86a-4675-9c5c-0c7b6280b4ef req-3bc12f97-7c92-495d-81e4-aaead7291b2a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:16.961570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b6017333-c86a-4675-9c5c-0c7b6280b4ef req-3bc12f97-7c92-495d-81e4-aaead7291b2a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:16.978846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b6017333-c86a-4675-9c5c-0c7b6280b4ef req-3bc12f97-7c92-495d-81e4-aaead7291b2a service nova] Creating event network-vif-plugged:3ed90c57-8d97-4048-b9af-fc0bea1656f4 for instance da37dfd0-c659-4274-8d98-acbbe82db587 on nch1-master-1 Apr 02 21:05:16.986903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b6017333-c86a-4675-9c5c-0c7b6280b4ef req-3bc12f97-7c92-495d-81e4-aaead7291b2a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052579 Apr 02 21:05:16.991635 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2129/3935] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:05:17.000754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1750670994", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5ad59ca6-db0d-408a-9756-69cb5adb69bd"}, {"port": "9465817e-88a8-48ec-b330-f9aafa60b53e", "tag": "port-1"}, {"port": "7374b67b-9bb7-474a-b2c1-f4e86b602226", "tag": "port-2"}, {"uuid": "ade7b0c7-9d28-49c6-8944-213c1ff76706", "tag": "net-1"}, {"uuid": "ade7b0c7-9d28-49c6-8944-213c1ff76706"}, {"uuid": "a6c70d63-32ca-4127-ab6e-1a01ed6bf503", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a6c70d63-32ca-4127-ab6e-1a01ed6bf503", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4745418f-c52c-437e-a1b1-9414ea2b7f8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "afc1ced9-2e41-456b-991e-0deebbfcdc27", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "353e1bda-2e9a-4abd-84bc-8d3fc2f65146", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1871652605"}], "key_name": "tempest-keypair-1949193056", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:17.206019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] validate_networks() for [('5ad59ca6-db0d-408a-9756-69cb5adb69bd', None, None, None, None, None), (None, None, '9465817e-88a8-48ec-b330-f9aafa60b53e', None, None, None), (None, None, '7374b67b-9bb7-474a-b2c1-f4e86b602226', None, None, None), ('ade7b0c7-9d28-49c6-8944-213c1ff76706', None, None, None, None, None), ('ade7b0c7-9d28-49c6-8944-213c1ff76706', None, None, None, None, None), ('a6c70d63-32ca-4127-ab6e-1a01ed6bf503', '10.2.2.100', None, None, None, None), ('a6c70d63-32ca-4127-ab6e-1a01ed6bf503', '10.2.2.200', None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:05:17.302447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:05:17.302903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:05:17.303396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:05:17.303816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:05:17.304239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:05:17.318083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:17.319908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:17.321040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:17.321718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:17.343920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Getting quotas for project 7f1a5e5adf8141058ce50ee9295e57cc. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:17.350453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Getting quotas for user 5331b96019b4418a8aa6a1facd9e1c06 and project 7f1a5e5adf8141058ce50ee9295e57cc. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:17.368236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:05:17.371225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:05:17.478936 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b06936dd-2bb6-4023-bcce-84c3f37d45da tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137035 Apr 02 21:05:17.481975 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1807/3936] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:05:17.498476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:17.499417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:17.511899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:17.512724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:17.513841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:17.514685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:17.908097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:17.921550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:17.924900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:17.938957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13ea9b05-33e0-4675-9ebc-4781c4d37398 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.455444 Apr 02 21:05:17.939573 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1808/3937] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:17 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:17.951855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c23e12e7-4ad3-4bf4-bae9-cbac1abd462f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:17.953116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c23e12e7-4ad3-4bf4-bae9-cbac1abd462f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:18.082562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c23e12e7-4ad3-4bf4-bae9-cbac1abd462f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:18.095653 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c23e12e7-4ad3-4bf4-bae9-cbac1abd462f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1217 microversion: 2.1 time: 0.149924 Apr 02 21:05:18.096760 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1809/3938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:17 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:18.109621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:18.110422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:18.124056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:18.128021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:18.129077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:18.132160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:18.497022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:18.511794 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81c857fa-51d4-46cc-b19e-7040c2da8efc tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.410763 Apr 02 21:05:18.514255 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1810/3939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:18 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:18.737195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-93cf76cc-8979-4c1e-8e61-32d633df6af6 req-a385272a-d81e-47c0-ae61-5f531f5abde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d783ddb6-bc96-4d25-9003-8c587ffefaec", "name": "network-vif-deleted", "tag": "40619b23-550c-41ce-a969-700e42af64d7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:18.759212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-93cf76cc-8979-4c1e-8e61-32d633df6af6 req-a385272a-d81e-47c0-ae61-5f531f5abde0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:18.760210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-93cf76cc-8979-4c1e-8e61-32d633df6af6 req-a385272a-d81e-47c0-ae61-5f531f5abde0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:18.795129 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-93cf76cc-8979-4c1e-8e61-32d633df6af6 req-a385272a-d81e-47c0-ae61-5f531f5abde0 service nova] Creating event network-vif-deleted:40619b23-550c-41ce-a969-700e42af64d7 for instance d783ddb6-bc96-4d25-9003-8c587ffefaec on nch2-master-1 Apr 02 21:05:18.809547 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-93cf76cc-8979-4c1e-8e61-32d633df6af6 req-a385272a-d81e-47c0-ae61-5f531f5abde0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083150 Apr 02 21:05:18.810732 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1811/3940] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:05:18.959566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:18.960308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:18.969007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:18.969412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:18.970228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:18.970677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:19.333652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:19.347327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:19.351173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:19.352710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5ea0583-ed02-4efa-8a9d-3dc62422da76 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.397916 Apr 02 21:05:19.366133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1812/3941] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:18 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:19.378295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:19.378974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:19.391307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:19.391774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:19.393174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:19.393174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:19.556134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:19.568741 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d3aaea6-ddc5-4906-a7de-c1c1a791945f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1287 microversion: 2.1 time: 0.198288 Apr 02 21:05:19.571924 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1813/3942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:19 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1287 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:19.582368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b52fe9b5-898d-4658-aa71-7630176e2cc6 req-7866076e-f8b9-4774-9e91-13acf2b25f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da37dfd0-c659-4274-8d98-acbbe82db587", "name": "network-vif-plugged", "status": "completed", "tag": "de499a6a-bf1d-4c94-8fd3-69e07ebfa1b0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:19.597535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b52fe9b5-898d-4658-aa71-7630176e2cc6 req-7866076e-f8b9-4774-9e91-13acf2b25f5c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:19.600953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b52fe9b5-898d-4658-aa71-7630176e2cc6 req-7866076e-f8b9-4774-9e91-13acf2b25f5c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:19.629431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b52fe9b5-898d-4658-aa71-7630176e2cc6 req-7866076e-f8b9-4774-9e91-13acf2b25f5c service nova] Creating event network-vif-plugged:de499a6a-bf1d-4c94-8fd3-69e07ebfa1b0 for instance da37dfd0-c659-4274-8d98-acbbe82db587 on nch1-master-1 Apr 02 21:05:19.640422 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b52fe9b5-898d-4658-aa71-7630176e2cc6 req-7866076e-f8b9-4774-9e91-13acf2b25f5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066747 Apr 02 21:05:19.641106 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1814/3943] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:19.654529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:19.655590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:19.663895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:19.664775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:19.666558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:19.673326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.350063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:20.368260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1381bdc9-66e2-4727-8173-dfcca5845f88 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.718689 Apr 02 21:05:20.373467 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1815/3944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:19 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:20.383581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:20.384229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:20.401372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:20.401372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.401372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:20.401372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.724562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:20.739219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:20.742223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:20.744389 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0200c9a9-edfb-4168-8a65-6f18d128273f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.372354 Apr 02 21:05:20.757568 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1816/3945] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:20 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:20.763850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:20.764798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:20.779477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:20.780403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.781383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:20.784296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.902718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:20.923845 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d6cf839-04d3-46d7-a98f-c4498189c7ab tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1275 microversion: 2.1 time: 0.164669 Apr 02 21:05:20.933462 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1817/3946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:20 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:20.936001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:05:20.936557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:05:20.937125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:05:20.937675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:05:20.938192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:05:20.958941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:20.959800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.960885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:20.961732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:20.988591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Getting quotas for project fad5516982b843a9a35e49795fda0844. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:20.994913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Getting quotas for user ee1c48c096304c819e0eac11e84aef26 and project fad5516982b843a9a35e49795fda0844. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:21.209809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:05:21.218928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4745418f-c52c-437e-a1b1-9414ea2b7f8a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='afc1ced9-2e41-456b-991e-0deebbfcdc27',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='353e1bda-2e9a-4abd-84bc-8d3fc2f65146',volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:05:21.391398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:21.392711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:21.418517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:21.420916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:21.423604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:21.425081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:21.853097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:21.866213 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-609d4c1e-e978-47b9-b678-ec2d9cc512fb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1333 microversion: 2.1 time: 0.478765 Apr 02 21:05:21.866972 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1818/3947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:21 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1333 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:21.872302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:21.873884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:21.890418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:21.892520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:21.895945 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.901939 Apr 02 21:05:21.896608 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2130/3948] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Apr 2 21:05:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 4904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 21:05:21.901993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:21.902710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:21.909874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-252e1085-f309-4da7-8ef0-197e02ece51e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:21.911282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-252e1085-f309-4da7-8ef0-197e02ece51e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:22.013132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-252e1085-f309-4da7-8ef0-197e02ece51e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.029878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-252e1085-f309-4da7-8ef0-197e02ece51e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.036683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-252e1085-f309-4da7-8ef0-197e02ece51e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.043939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-252e1085-f309-4da7-8ef0-197e02ece51e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1286 microversion: 2.32 time: 0.136276 Apr 02 21:05:22.045001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2131/3949] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:21 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:22.059653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:22.062462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:22.073213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:22.074915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:22.075947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:22.076830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:22.282835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.291198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.293338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.294575 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4f17e8b-48b1-4415-a419-3064856725f2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.426560 Apr 02 21:05:22.295158 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1819/3950] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:21 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:22.355429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:22.364517 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f9617d8d-865a-485a-b0f0-69ca1c4a4bbb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1317 microversion: 2.1 time: 0.317506 Apr 02 21:05:22.367690 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2132/3951] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:22 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:22.609675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a39a5d62-a9ec-4ce5-996b-4e588c7f2b5c req-e5f59c48-a967-4aa0-a254-3122d05d1ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7f0d67-0f7d-4175-8e4a-2dc61e583745", "tag": "b0dbd78a-90ff-4260-85f6-5039e1755013"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:22.636731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a39a5d62-a9ec-4ce5-996b-4e588c7f2b5c req-e5f59c48-a967-4aa0-a254-3122d05d1ff0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:22.637195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a39a5d62-a9ec-4ce5-996b-4e588c7f2b5c req-e5f59c48-a967-4aa0-a254-3122d05d1ff0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:22.685686 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a39a5d62-a9ec-4ce5-996b-4e588c7f2b5c req-e5f59c48-a967-4aa0-a254-3122d05d1ff0 service nova] Creating event network-changed:b0dbd78a-90ff-4260-85f6-5039e1755013 for instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 on nch2-master-1 Apr 02 21:05:22.703669 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a39a5d62-a9ec-4ce5-996b-4e588c7f2b5c req-e5f59c48-a967-4aa0-a254-3122d05d1ff0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100050 Apr 02 21:05:22.704878 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1820/3952] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:22.883613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:22.884602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:22.896182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:22.900445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:22.902886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:22.903443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.064012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37cd4acd-c128-4522-9a56-0aa4dd8cc396 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:23.072499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37cd4acd-c128-4522-9a56-0aa4dd8cc396 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:23.168897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.181733 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73d77e8e-dd74-4822-a9f2-c7fe0c54a4c4 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1670 microversion: 2.1 time: 0.301960 Apr 02 21:05:23.193336 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2133/3953] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:22 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1670 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:23.200151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:23.200740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:23.210518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.210986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.211861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.212312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.270259 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36e2ce54-0d21-42bb-a87f-d61d506e3272 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587/ips" status: 200 len: 181 microversion: 2.1 time: 0.074609 Apr 02 21:05:23.271277 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2134/3954] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:05:23 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587/ips => generated 181 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:05:23.277805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37cd4acd-c128-4522-9a56-0aa4dd8cc396 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.286852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:23.287848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:23.290383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37cd4acd-c128-4522-9a56-0aa4dd8cc396 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.292438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37cd4acd-c128-4522-9a56-0aa4dd8cc396 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.294016 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37cd4acd-c128-4522-9a56-0aa4dd8cc396 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1286 microversion: 2.32 time: 0.234536 Apr 02 21:05:23.295688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.299145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.303278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.304024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.306018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1821/3955] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:23 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:23.319253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:23.320155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:23.327891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.328724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.329752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.330466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.403103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:05:23.628177 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4924135-82bb-452e-8f84-4bf6b5bdf89e tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "DELETE /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 204 len: 0 microversion: 2.1 time: 0.348372 Apr 02 21:05:23.629688 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2135/3956] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:05:23 2022] DELETE /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:05:23.638166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:23.641517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:23.660045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.660543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.662128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.662587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.746712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.756282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.760229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.773454 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a7e5788-800f-4094-b998-526540fd824e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.462901 Apr 02 21:05:23.774061 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1822/3957] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:23 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:23.782178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:23.784149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:23.790492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.792988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.794014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:23.794667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:23.917887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:23.927914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30320dd1-a3b5-4a2d-a3eb-72b0d9504f03 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1317 microversion: 2.1 time: 0.294006 Apr 02 21:05:23.938732 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2136/3958] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:23 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:24.127205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:24.135741 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6293332-ea9e-42c7-99e7-f765cc41eaaa tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1676 microversion: 2.1 time: 0.357268 Apr 02 21:05:24.150785 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1823/3959] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:23 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1676 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:24.314628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:24.315578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:24.327178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:24.328975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:24.330862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:24.331788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:24.486712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:24.503439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:24.508272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:24.509961 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cf6a060-9a08-495b-bfe9-b70b63cd9018 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1584 microversion: 2.32 time: 0.199741 Apr 02 21:05:24.523431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2137/3960] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:24 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1584 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:24.792818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:24.793468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:24.808584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:24.809098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:24.809922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:24.810359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:24.946605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:24.947955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:24.959650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:24.981971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:24.989540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:24.992684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:25.163449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.175184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.177403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.180936 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf8625c5-a1bb-43e2-8f42-4805a41a3166 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.393628 Apr 02 21:05:25.194748 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1824/3961] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:24 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:25.202640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:25.205339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:25.212338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:25.213506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:25.215741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:25.216389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:25.538717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.551467 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0adff57-5baf-4cd0-b8e0-7a9faf340652 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1676 microversion: 2.1 time: 0.355240 Apr 02 21:05:25.554482 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1825/3962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:25 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1676 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:25.567183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:25.568063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:25.582052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.587293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:25.589595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:25.591761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:25.592002 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dbb868f9-e70a-485b-b783-d8f47960fc41 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1317 microversion: 2.1 time: 0.650656 Apr 02 21:05:25.592626 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2138/3963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:24 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:25.594742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:25.701946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.715461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.717563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:25.719257 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6880c70-f24b-46d7-9d76-d230543a7485 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1594 microversion: 2.32 time: 0.163339 Apr 02 21:05:25.720631 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1826/3964] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:25 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:26.203682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:26.204297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:26.229368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.230685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.231852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.235758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.572867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:26.573568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:26.597620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.597620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.597620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.597620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.889466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:26.901342 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e7e5add-a36f-4f4e-8f08-b7a7aedfe225 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1676 microversion: 2.1 time: 0.333143 Apr 02 21:05:26.905470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:26.914801 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1827/3965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:26 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1676 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:26.917639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:26.920040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:26.921356 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d59dbc94-0217-4596-bc52-98494f5a8772 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.722082 Apr 02 21:05:26.932078 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2139/3966] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:26 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:26.932279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:26.932279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:26.938784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:26.939567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:26.961687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.963048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.964795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.965301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.969737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.985092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:26.990343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:26.997721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:27.445648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:27.461707 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04caacea-539d-4e57-ae4f-4f3a1b45c8a3 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1317 microversion: 2.1 time: 0.541970 Apr 02 21:05:27.462395 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1828/3967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:26 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:27.489530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3c8712ba-1578-429c-8735-3c346cab8f74 req-639ceb06-ef0a-4168-9031-919b18b6a701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f0d67-0f7d-4175-8e4a-2dc61e583745", "name": "network-vif-plugged", "status": "completed", "tag": "b0dbd78a-90ff-4260-85f6-5039e1755013"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:27.517533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3c8712ba-1578-429c-8735-3c346cab8f74 req-639ceb06-ef0a-4168-9031-919b18b6a701 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:27.517973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3c8712ba-1578-429c-8735-3c346cab8f74 req-639ceb06-ef0a-4168-9031-919b18b6a701 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:27.571542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3c8712ba-1578-429c-8735-3c346cab8f74 req-639ceb06-ef0a-4168-9031-919b18b6a701 service nova] Creating event network-vif-plugged:b0dbd78a-90ff-4260-85f6-5039e1755013 for instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 on nch2-master-1 Apr 02 21:05:27.586378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3c8712ba-1578-429c-8735-3c346cab8f74 req-639ceb06-ef0a-4168-9031-919b18b6a701 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119818 Apr 02 21:05:27.596367 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1829/3968] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:27.624721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f7931565-d5af-48ac-8f47-58fbf8ac2457 req-9a7c2458-5f1d-4ab1-8380-2b4f01806a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da37dfd0-c659-4274-8d98-acbbe82db587", "name": "network-vif-deleted", "tag": "3ed90c57-8d97-4048-b9af-fc0bea1656f4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:27.646387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7931565-d5af-48ac-8f47-58fbf8ac2457 req-9a7c2458-5f1d-4ab1-8380-2b4f01806a28 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:27.650821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7931565-d5af-48ac-8f47-58fbf8ac2457 req-9a7c2458-5f1d-4ab1-8380-2b4f01806a28 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:27.702117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f7931565-d5af-48ac-8f47-58fbf8ac2457 req-9a7c2458-5f1d-4ab1-8380-2b4f01806a28 service nova] Creating event network-vif-deleted:3ed90c57-8d97-4048-b9af-fc0bea1656f4 for instance da37dfd0-c659-4274-8d98-acbbe82db587 on nch1-master-1 Apr 02 21:05:27.724044 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f7931565-d5af-48ac-8f47-58fbf8ac2457 req-9a7c2458-5f1d-4ab1-8380-2b4f01806a28 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125157 Apr 02 21:05:27.727394 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1830/3969] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:27.934535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:27.934535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:27.940735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:27.948248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:27.950022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:27.954866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:27.955445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:27.957392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:27.961488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:27.965222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2adf7a0b-ef5b-4a38-ad06-f6dda9966d5e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1662 microversion: 2.32 time: 1.039850 Apr 02 21:05:27.965824 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2140/3970] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:26 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1662 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:27.977123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:27.977123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:28.003042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:28.003835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:28.004864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:28.005300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:28.298306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:28.314317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a16098e4-b232-4c0c-87f3-c16041dfaf63 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1496 microversion: 2.1 time: 0.386619 Apr 02 21:05:28.314924 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1831/3971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:27 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1496 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:28.431466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:28.460286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:28.462175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:28.464348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed3ebbe4-1898-40ac-9d6e-3f2a29638253 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1739 microversion: 2.20 time: 0.493282 Apr 02 21:05:28.476780 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2141/3972] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:27 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1739 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:28.477794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:28.478783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:28.484890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:28.485354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:28.486154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:28.486608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:28.850160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:28.863502 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d947cdb-c15c-4c57-bb2e-b687ff281582 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1317 microversion: 2.1 time: 0.387062 Apr 02 21:05:28.864803 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1832/3973] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:28 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:28.989901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:28.992796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:29.002502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.003318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.004373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.013211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.333181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:29.334192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:29.342196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.342839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.344062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.344700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.434257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.435399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.437548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lazy-loading 'fault' on Instance uuid da37dfd0-c659-4274-8d98-acbbe82db587 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:05:29.516761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:29.532253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:29.534202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:29.543069 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5b15cf4-0c0b-488a-9f11-d8d852804020 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1709 microversion: 2.32 time: 0.563430 Apr 02 21:05:29.543690 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2142/3974] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:28 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1709 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:29.551641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:29.552514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:29.569412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.570139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.571128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.571742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.597931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '437b151556e04bdfa22a80b72f34c088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ae16de34fd342cda85aa2bd981452c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:29.608089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7191b36a-2cd5-492f-b7b5-1bdbf6bf1ceb tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 200 len: 1302 microversion: 2.1 time: 0.279278 Apr 02 21:05:29.609641 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1833/3975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:29 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 1302 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:29.883850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:29.885246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:29.896639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.897374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.898364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:29.899138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:29.996278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.005501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.008225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.008225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a3e4ba92-d7ac-4991-9094-833786163c80 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1721 microversion: 2.20 time: 0.463246 Apr 02 21:05:30.008777 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2143/3976] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:29 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:30.023414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-68847853-302e-443d-b789-4130cee9b052 req-aaebbcda-fa71-4145-8dfc-66f3098513a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da37dfd0-c659-4274-8d98-acbbe82db587", "name": "network-vif-deleted", "tag": "de499a6a-bf1d-4c94-8fd3-69e07ebfa1b0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:30.046679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-68847853-302e-443d-b789-4130cee9b052 req-aaebbcda-fa71-4145-8dfc-66f3098513a3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.047122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-68847853-302e-443d-b789-4130cee9b052 req-aaebbcda-fa71-4145-8dfc-66f3098513a3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.065797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-68847853-302e-443d-b789-4130cee9b052 req-aaebbcda-fa71-4145-8dfc-66f3098513a3 service nova] Creating event network-vif-deleted:de499a6a-bf1d-4c94-8fd3-69e07ebfa1b0 for instance da37dfd0-c659-4274-8d98-acbbe82db587 on nch1-master-1 Apr 02 21:05:30.072180 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-68847853-302e-443d-b789-4130cee9b052 req-aaebbcda-fa71-4145-8dfc-66f3098513a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062244 Apr 02 21:05:30.074053 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2144/3977] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:30.096443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.107906 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6241f725-1319-48ac-8d34-be881217a1f0 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1506 microversion: 2.1 time: 0.228527 Apr 02 21:05:30.110644 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1834/3978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:29 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:30.129032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:30.129800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:30.139918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.141073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.141998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.142580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.563468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:30.564276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:30.572016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.572493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.573532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.574151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.730733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.741351 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c210819b-8553-4372-a9e2-abdcc6cb4f89 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1506 microversion: 2.1 time: 0.616945 Apr 02 21:05:30.742691 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2145/3979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:30 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:30.748470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:30.749370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:30.750172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.757445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.758223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.759230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.760259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.768575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.770830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:30.773114 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a9e14ae1-f1e8-4982-a68a-fcfb81e6fa43 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1697 microversion: 2.32 time: 0.214249 Apr 02 21:05:30.786729 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1835/3980] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:30 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1697 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:30.790048 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] HTTP exception thrown: Instance da37dfd0-c659-4274-8d98-acbbe82db587 could not be found. Apr 02 21:05:30.792888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Returning 404 to user: Instance da37dfd0-c659-4274-8d98-acbbe82db587 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:05:30.793969 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-253a53b5-382e-462e-ba7b-b121471cb07c tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 404 len: 111 microversion: 2.1 time: 0.049750 Apr 02 21:05:30.794822 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2146/3981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:30 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:05:30.797894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:30.799706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:30.807285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.808093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.809794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.810576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.890640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e574a509-8b9c-4d61-ba64-07536e86502c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "PUT /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1078 microversion: 2.1 time: 0.102445 Apr 02 21:05:30.891661 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1836/3982] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:05:30 2022] PUT /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1078 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:30.906699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:30.907403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:30.923327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.923949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:30.924948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:30.925406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.027768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:31.028388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:31.043045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.043505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.044436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.045216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.310555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:31.324966 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e77290d9-2e4e-4c79-959d-fff9f84ca979 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1504 microversion: 2.1 time: 0.421971 Apr 02 21:05:31.326138 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2147/3983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:30 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:31.368283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:31.369626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:31.370423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:31.386444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:31.388946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:31.391701 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9094a618-cb42-4c6b-a528-e4e62ac8f1e0 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1721 microversion: 2.20 time: 0.368425 Apr 02 21:05:31.393049 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1837/3984] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:31 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1721 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:31.395995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.396499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.397335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.397783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.793939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:31.794616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:31.802149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.802719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.803735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.804358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.886362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:31.895749 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4dfdf4cf-a5a1-4d9b-930b-3ebdec44503b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1504 microversion: 2.1 time: 0.549671 Apr 02 21:05:31.897057 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2148/3985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:31 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:31.913341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:31.916540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:31.923196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.923881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:31.924957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:31.925607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.025880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:32.039410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:32.041611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:32.043068 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f7a46eb1-504e-4812-9d08-0466194a3c1d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1744 microversion: 2.32 time: 0.253898 Apr 02 21:05:32.044322 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1838/3986] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:31 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1744 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:32.075943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:05:32.076526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:05:32.077097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:05:32.077583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:05:32.078069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:05:32.165555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:32.173498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.173900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.174837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.175598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.215802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cd28142-d8b1-4ec7-8548-3ca4fd1f173e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "POST /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745/action" status: 202 len: 1110 microversion: 2.1 time: 0.306677 Apr 02 21:05:32.217396 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2149/3987] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:05:31 2022] POST /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745/action => generated 1110 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 02 21:05:32.230871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:32.231814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:32.241702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.242177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.242988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.243446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.412314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:32.412953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:32.421957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.422516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.423561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.424255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.495530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:32.506387 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34ce1d8c-d53e-4ccc-b232-6320439fc360 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.279492 Apr 02 21:05:32.507243 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1839/3988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:32 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:32.941885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f7b361f1-8a2f-4e07-8647-0466dc96f699 req-a6235b18-0b4e-4cec-8273-230d156c2328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "name": "network-vif-unplugged", "status": "completed", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:32.960429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7b361f1-8a2f-4e07-8647-0466dc96f699 req-a6235b18-0b4e-4cec-8273-230d156c2328 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:32.961670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7b361f1-8a2f-4e07-8647-0466dc96f699 req-a6235b18-0b4e-4cec-8273-230d156c2328 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:32.990662 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f7b361f1-8a2f-4e07-8647-0466dc96f699 req-a6235b18-0b4e-4cec-8273-230d156c2328 service nova] Creating event network-vif-unplugged:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:05:33.004123 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f7b361f1-8a2f-4e07-8647-0466dc96f699 req-a6235b18-0b4e-4cec-8273-230d156c2328 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069118 Apr 02 21:05:33.005379 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1840/3989] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:33.066221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:33.067900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:33.084928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:33.085451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:33.086298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:33.086953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:33.246845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:33.271136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:33.273140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:33.274451 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-52d6a2be-2fec-486d-83f1-6e2ff277cbc7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1721 microversion: 2.20 time: 0.866132 Apr 02 21:05:33.275128 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2150/3990] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:32 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1721 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:33.322391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:33.333555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:33.335313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:33.336908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee524cf3-7c1a-4975-afcb-5200c5457d16 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1791 microversion: 2.32 time: 0.278469 Apr 02 21:05:33.348947 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1841/3991] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:33 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1791 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:33.528297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:33.529962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:33.537094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:33.537771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:33.539029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:33.540614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.029679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.047632 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b70c7b5-26c7-4bae-9e55-d5af6d70ed17 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.526119 Apr 02 21:05:34.058068 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2151/3992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:33 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:34.294464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:34.295013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:34.302138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.302752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.303386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.303837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.358712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:34.359328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:34.372097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.372596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.373398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.378510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.472911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.487941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.489817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.491643 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f4b75480-4270-4057-97b8-0beabbd11342 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1664 microversion: 2.20 time: 0.201753 Apr 02 21:05:34.492961 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1842/3993] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:34 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:34.519148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e69b880-61ea-4a88-8197-f35a7b853345"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:34.522510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:34.533720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.534362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.535248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.536383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.834933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.861904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.864119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:34.866273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa33677b-726a-4cd7-895c-7f7f1942f720 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1838 microversion: 2.32 time: 0.514900 Apr 02 21:05:34.868133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2152/3994] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:34 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1838 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:34.873471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:34.874160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:34.881795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.882544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.884046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.884848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.924163 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] HTTP exception thrown: Instance da37dfd0-c659-4274-8d98-acbbe82db587 could not be found. Apr 02 21:05:34.924990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Returning 404 to user: Instance da37dfd0-c659-4274-8d98-acbbe82db587 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:05:34.926039 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4e8e3cb-7e5b-43ec-bd54-1522fea8cb5b tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "DELETE /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 404 len: 111 microversion: 2.1 time: 0.056385 Apr 02 21:05:34.930775 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2153/3995] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:05:34 2022] DELETE /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:05:34.937627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:34.938396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: da37dfd0-c659-4274-8d98-acbbe82db587] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:34.945399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5a93ac74-a42d-4761-9d34-53f86e3dcb68 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.438790 Apr 02 21:05:34.946037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1843/3996] 10.222.0.18 () {62 vars in 1363 bytes} [Sat Apr 2 21:05:34 2022] POST /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-volume_attachments => generated 188 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:05:34.950808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.952171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.953300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.953816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.973219 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] HTTP exception thrown: Instance da37dfd0-c659-4274-8d98-acbbe82db587 could not be found. Apr 02 21:05:34.973915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Returning 404 to user: Instance da37dfd0-c659-4274-8d98-acbbe82db587 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:05:34.974901 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-190d7ea4-2e24-48a8-b852-fd1630c38bb5 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587" status: 404 len: 111 microversion: 2.1 time: 0.042131 Apr 02 21:05:34.975542 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2154/3997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:34 2022] GET /compute/v2.1/servers/da37dfd0-c659-4274-8d98-acbbe82db587 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:05:34.985419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:34.985659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:34.992154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.992759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:34.993982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:34.994513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.011679 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] HTTP exception thrown: Instance db18096f-bb45-4197-adab-83d481a03a2c could not be found. Apr 02 21:05:35.012583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Returning 404 to user: Instance db18096f-bb45-4197-adab-83d481a03a2c could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:05:35.013843 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c8f3e9f1-ee75-45a1-b004-f47fb0a57614 tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "DELETE /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 404 len: 111 microversion: 2.1 time: 0.033851 Apr 02 21:05:35.015155 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1844/3998] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:05:34 2022] DELETE /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:05:35.027627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:35.027627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] [instance: db18096f-bb45-4197-adab-83d481a03a2c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:35.032383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.033108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.033901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.034509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.051759 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] HTTP exception thrown: Instance db18096f-bb45-4197-adab-83d481a03a2c could not be found. Apr 02 21:05:35.052381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] Returning 404 to user: Instance db18096f-bb45-4197-adab-83d481a03a2c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:05:35.053787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-029e1dc7-364c-4fab-a39a-1cd001d4692a tempest-ServersTestMultiNic-1818660293 tempest-ServersTestMultiNic-1818660293-project] 10.222.0.18 "GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c" status: 404 len: 111 microversion: 2.1 time: 0.034562 Apr 02 21:05:35.054409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2155/3999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:35 2022] GET /compute/v2.1/servers/db18096f-bb45-4197-adab-83d481a03a2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:05:35.069068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:35.069697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:35.090047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.090047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.090047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.090047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.098500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:35.099074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:35.115320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.115939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.119440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.119972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.507133 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-volume_attachments/1e69b880-61ea-4a88-8197-f35a7b853345" status: 202 len: 0 microversion: 2.20 time: 0.414736 Apr 02 21:05:35.510605 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2156/4000] 10.222.0.18 () {60 vars in 1456 bytes} [Sat Apr 2 21:05:35 2022] DELETE /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-volume_attachments/1e69b880-61ea-4a88-8197-f35a7b853345 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:05:35.608738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:35.609554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:35.623667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.624137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.624969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.661190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.855786 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-caf05e5a-d16a-4532-8bd0-85627d2c83fc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "POST /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/action" status: 202 len: 0 microversion: 2.20 time: 0.253026 Apr 02 21:05:35.857387 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2157/4001] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:05:35 2022] POST /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:05:35.869053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-188dba5a-fb34-4f42-a7e6-a6a489312141 req-43b9f42b-9849-45cc-b469-5b2b4d5dce31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "9aa225bb-5f59-4695-9481-c8b83a23a8f6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:35.886332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-188dba5a-fb34-4f42-a7e6-a6a489312141 req-43b9f42b-9849-45cc-b469-5b2b4d5dce31 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.887854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-188dba5a-fb34-4f42-a7e6-a6a489312141 req-43b9f42b-9849-45cc-b469-5b2b4d5dce31 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.902695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:35.914850 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49f5e05c-15c9-4281-a0cc-24e24a07ef6f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.854287 Apr 02 21:05:35.927094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1845/4002] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:35 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:35.931186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-188dba5a-fb34-4f42-a7e6-a6a489312141 req-43b9f42b-9849-45cc-b469-5b2b4d5dce31 service nova] Creating event network-changed:9aa225bb-5f59-4695-9481-c8b83a23a8f6 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:35.933999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:35.934620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:35.943545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.944326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.945188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-188dba5a-fb34-4f42-a7e6-a6a489312141 req-43b9f42b-9849-45cc-b469-5b2b4d5dce31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086179 Apr 02 21:05:35.945610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.946267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.947729 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2158/4003] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:35.957849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:35.968914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:35.987877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.988346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:35.989389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:35.989713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:36.311683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:36.315897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:36.325499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:36.330912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:36.335839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22e42dc9-e7b3-4058-ae87-dcc4112541a9 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1838 microversion: 2.32 time: 0.383796 Apr 02 21:05:36.340118 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2159/4004] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:35 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1838 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:36.343054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:36.345991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:36.348256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9bb4b022-11a7-46c1-90ee-73246b26be8d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1672 microversion: 2.20 time: 0.420104 Apr 02 21:05:36.349681 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1846/4005] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:35 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1672 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:36.935017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:36.939265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:36.951153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:36.951899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:36.953180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:36.953714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:37.293136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.302079 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-75393f77-359d-4ffd-a580-1adefe809cc1 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.374407 Apr 02 21:05:37.315519 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2160/4006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:36 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:37.360932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:37.374376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:37.376481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:37.377324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:37.384687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:37.385574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:37.386658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:37.387617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:37.413165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:37.414715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:37.417326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:37.417967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:37.830674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.839263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.840821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.842035 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2e7f4fd-1ad2-48c4-a4e3-ed83e97c3ada tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1672 microversion: 2.20 time: 0.476311 Apr 02 21:05:37.842605 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2161/4007] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:37 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1672 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:37.894315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.932061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.933932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:37.957875 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8f1040b7-6065-4825-ad91-17c9f724d1ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.601260 Apr 02 21:05:37.959217 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1847/4008] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:37 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:38.012131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-83140a8c-eb2a-477f-9c89-dcc5ffe19502 req-2e549131-97f0-449c-88e5-17d9aa22d227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "9465817e-88a8-48ec-b330-f9aafa60b53e"}, {"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "7374b67b-9bb7-474a-b2c1-f4e86b602226"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:38.023237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-83140a8c-eb2a-477f-9c89-dcc5ffe19502 req-2e549131-97f0-449c-88e5-17d9aa22d227 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.024677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-83140a8c-eb2a-477f-9c89-dcc5ffe19502 req-2e549131-97f0-449c-88e5-17d9aa22d227 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:38.044055 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-83140a8c-eb2a-477f-9c89-dcc5ffe19502 req-2e549131-97f0-449c-88e5-17d9aa22d227 service nova] Creating event network-changed:9465817e-88a8-48ec-b330-f9aafa60b53e for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:38.045108 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-83140a8c-eb2a-477f-9c89-dcc5ffe19502 req-2e549131-97f0-449c-88e5-17d9aa22d227 service nova] Creating event network-changed:7374b67b-9bb7-474a-b2c1-f4e86b602226 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:38.051684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-83140a8c-eb2a-477f-9c89-dcc5ffe19502 req-2e549131-97f0-449c-88e5-17d9aa22d227 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043662 Apr 02 21:05:38.053515 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2162/4009] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:38.319370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:38.320157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:38.328607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.329075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:38.330306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.330306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:38.767746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:38.787677 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a505f47-5b19-44c2-84a6-163492786c56 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.471826 Apr 02 21:05:38.788859 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1848/4010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:38 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:38.861501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:38.862222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:38.879537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.880197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:38.880878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.881550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:38.977396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:38.978088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:38.996386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.996878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:38.997884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:38.998523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:39.646326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:39.656299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:39.659057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:39.660472 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8fff927f-32d9-47c8-802c-91d2f0eed290 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.803276 Apr 02 21:05:39.661238 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2163/4011] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:38 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:39.724295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:39.733566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:39.735442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:39.736753 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31cdce78-0a33-41d9-9914-663ac3e09c70 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.763300 Apr 02 21:05:39.748759 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1849/4012] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:38 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:39.805466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:39.806375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:39.813320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:39.814020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:39.814993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:39.815602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:40.195694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f5f256d4-2dba-4fd5-a500-73ee0b360df4 req-36076dc7-dbb7-4e93-b372-ebb17f328f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "a43c7f16-83a8-4758-918d-0bd3f2393170"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:40.219954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f5f256d4-2dba-4fd5-a500-73ee0b360df4 req-36076dc7-dbb7-4e93-b372-ebb17f328f2e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:40.226559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f5f256d4-2dba-4fd5-a500-73ee0b360df4 req-36076dc7-dbb7-4e93-b372-ebb17f328f2e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:40.245398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:40.259098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f5f256d4-2dba-4fd5-a500-73ee0b360df4 req-36076dc7-dbb7-4e93-b372-ebb17f328f2e service nova] Creating event network-changed:a43c7f16-83a8-4758-918d-0bd3f2393170 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:40.260807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-086bcae0-37f9-4f30-9587-2ff1b5d17d49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.458970 Apr 02 21:05:40.261937 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2164/4013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:39 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:40.280553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f5f256d4-2dba-4fd5-a500-73ee0b360df4 req-36076dc7-dbb7-4e93-b372-ebb17f328f2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100509 Apr 02 21:05:40.281180 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1850/4014] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:40.679883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:40.681886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:40.692983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:40.694198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:40.695545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:40.696566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:40.766601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:40.773027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:40.783024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:40.784649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:40.785908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:40.786589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:41.160339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.172181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.184843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.192507 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ce356da7-fd0f-4ea6-ac83-20b38766688e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.437611 Apr 02 21:05:41.194915 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1851/4015] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:40 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:41.279575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:41.280430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:41.289992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:41.295201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:41.296306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:41.297070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:41.582847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.594535 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eeb6721d-bd06-491c-8fbb-1ba4ef340693 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.319976 Apr 02 21:05:41.598176 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1852/4016] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:41 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:41.701492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.715091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.718340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:41.725123 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a97cf29-d3b4-4635-b3ae-3e046de1f657 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 1.048974 Apr 02 21:05:41.739268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2165/4017] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:40 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:42.218612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:42.219472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:42.237912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:42.239371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:42.240211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:42.241655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:42.323994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-96295e2c-68c9-42b6-a8dd-a6fdd37b6b89 req-b5ddb153-2acb-4724-b2cc-0c7f373903b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "f4c519a1-4b21-4dac-b3f9-1667e9aca676"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:42.349348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96295e2c-68c9-42b6-a8dd-a6fdd37b6b89 req-b5ddb153-2acb-4724-b2cc-0c7f373903b3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:42.351056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96295e2c-68c9-42b6-a8dd-a6fdd37b6b89 req-b5ddb153-2acb-4724-b2cc-0c7f373903b3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:42.391196 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-96295e2c-68c9-42b6-a8dd-a6fdd37b6b89 req-b5ddb153-2acb-4724-b2cc-0c7f373903b3 service nova] Creating event network-changed:f4c519a1-4b21-4dac-b3f9-1667e9aca676 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:42.411390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-96295e2c-68c9-42b6-a8dd-a6fdd37b6b89 req-b5ddb153-2acb-4724-b2cc-0c7f373903b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091047 Apr 02 21:05:42.425155 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2166/4018] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:42.616288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:42.617173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:42.634060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:42.634523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:42.643469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:42.643939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:42.971643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:42.996560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:43.009829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:43.010891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5146a3cc-87ab-4afd-86a6-fe90ae7caea8 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.399422 Apr 02 21:05:43.013727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2167/4019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:42 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:43.016089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:43.017626 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ce8f704-da48-430e-807d-606eee90b9e1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.808153 Apr 02 21:05:43.036299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1853/4020] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:42 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:43.038572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:43.039732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:43.047427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:43.048272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:43.049276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:43.049993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:43.568240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:43.609674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:43.613287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:43.619114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bcb376c1-a137-4d99-998f-212847b0b011 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.602758 Apr 02 21:05:43.624766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2168/4021] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:43 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:44.030350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:44.030992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:44.044332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:44.045127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:44.053365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:44.053919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:44.067744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:44.068276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:44.069227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:44.069706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:44.075719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:44.076916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:44.581156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:44.591461 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc52d401-6a79-4c7b-a8df-f6fb98ce1934 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.565447 Apr 02 21:05:44.596691 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1854/4022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:44 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:44.651382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:44.652316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:44.675415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:44.675890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:44.676745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:44.677600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:44.981870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:44.999475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:45.001265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:45.002542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-106fa92a-e2b1-4d21-b655-a7cad19589ce tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.355983 Apr 02 21:05:45.003412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1855/4023] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:44 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:45.008175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0b2008ab-4b0e-49c4-9f3a-3599b00d8cdb req-cd9ee886-a5e7-4e52-a97e-002e9c350e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "adcb837b-7ab2-4b3e-98c2-1a56402cc8a9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:45.035464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0b2008ab-4b0e-49c4-9f3a-3599b00d8cdb req-cd9ee886-a5e7-4e52-a97e-002e9c350e5e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:45.038115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0b2008ab-4b0e-49c4-9f3a-3599b00d8cdb req-cd9ee886-a5e7-4e52-a97e-002e9c350e5e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:45.067148 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0b2008ab-4b0e-49c4-9f3a-3599b00d8cdb req-cd9ee886-a5e7-4e52-a97e-002e9c350e5e service nova] Creating event network-changed:adcb837b-7ab2-4b3e-98c2-1a56402cc8a9 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:45.078338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:45.078959 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0b2008ab-4b0e-49c4-9f3a-3599b00d8cdb req-cd9ee886-a5e7-4e52-a97e-002e9c350e5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073807 Apr 02 21:05:45.081619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1856/4024] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:45.116588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:45.119225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:45.123569 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1763eee8-f861-46a1-9f2e-e1f07ee16c8c tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 1.083651 Apr 02 21:05:45.124499 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2169/4025] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:44 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:45.586154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:45.587179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:45.594445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:45.595350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:45.596266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:45.599410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:45.621860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:45.625616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:45.667117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:45.678905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d39cc1c-ecdb-481f-9622-7b47706e0bc8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/ips" status: 200 len: 151 microversion: 2.1 time: 0.099593 Apr 02 21:05:45.679194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:45.687496 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1857/4026] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:05:45 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/ips => generated 151 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:45.692682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:45.698591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:46.024863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:46.028513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:46.051855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:46.054862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:46.058828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:46.062054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:46.363491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:46.371716 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-378a2cda-62a9-4fb1-ac5f-8926abfb05af tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.759447 Apr 02 21:05:46.372321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2170/4027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:45 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:46.384880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:46.389353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:46.390071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:46.408687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:46.413500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:46.418807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:46.419768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:46.421374 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a8321e7-c94f-43bf-8aff-2450064334b5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.401710 Apr 02 21:05:46.437885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1858/4028] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:46 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:46.438370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:46.438370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:46.987697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:47.000189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:47.001924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:47.008935 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f11cf1c3-12a7-4ea9-8da3-738983b05c7f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.635453 Apr 02 21:05:47.013361 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2171/4029] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:46 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:47.132051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-7629e946-4360-4277-85d3-e137d0f8e6c5 req-83378660-4682-48c0-9eb2-149816f391ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "54ba32fa-f94c-4790-91a7-b7d8bc9665c3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:47.157829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7629e946-4360-4277-85d3-e137d0f8e6c5 req-83378660-4682-48c0-9eb2-149816f391ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.165393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7629e946-4360-4277-85d3-e137d0f8e6c5 req-83378660-4682-48c0-9eb2-149816f391ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:47.198596 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-7629e946-4360-4277-85d3-e137d0f8e6c5 req-83378660-4682-48c0-9eb2-149816f391ad service nova] Creating event network-changed:54ba32fa-f94c-4790-91a7-b7d8bc9665c3 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:05:47.206117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-7629e946-4360-4277-85d3-e137d0f8e6c5 req-83378660-4682-48c0-9eb2-149816f391ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089263 Apr 02 21:05:47.207137 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1859/4030] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:47.396467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:47.399552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:47.419832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.424366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:47.425826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.428930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:47.449033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:47.450368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:47.472097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.473560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:47.475764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.480662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:47.818234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:47.828223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:47.837494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:47.842455 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61e24b7c-43a0-4f87-96ca-a138b8d2717c tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.398364 Apr 02 21:05:47.844140 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1860/4031] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:47 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:47.858645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53932f9c-8a1a-44d4-851d-4805a7def1fe"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:47.861316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:47.877058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.877912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:47.880576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:47.888621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:48.128625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:48.146165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5948d40-daa8-4aa9-a082-439d15c64bbd tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.757895 Apr 02 21:05:48.148251 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2172/4032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:47 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:48.165631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:48.166531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:48.173528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:48.177866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:48.178946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:48.179657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:48.341457 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-326328cc-4d29-4f42-b30f-0e1ae11d8281 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490456 Apr 02 21:05:48.346823 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1861/4033] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:05:47 2022] POST /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:48.767604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:48.801024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:48.806393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:48.820860 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11738967-dd57-4461-aaf7-0429048f05b1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.671118 Apr 02 21:05:48.828293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2173/4034] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:48 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:48.863584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:48.864776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:48.874275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:48.874997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:48.876037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:48.876669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:49.165036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:49.165900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:49.178745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:49.179815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:49.194500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:49.195371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:49.271346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:49.281375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:49.283331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:49.284761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47da9a48-b23c-4d0c-91cd-2901ff2fa0e6 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.427346 Apr 02 21:05:49.289539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1862/4035] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:48 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:49.847239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:49.850442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:49.865619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:49.875319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:49.876344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:49.882586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:50.043431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.064842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4900bc7e-1b08-445a-9136-baafbc674121 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.901832 Apr 02 21:05:50.067618 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2174/4036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:49 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:50.307935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:50.314574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:50.327892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.338288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.338840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:50.339820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.340534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:50.341189 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e30d90a2-f765-4085-9082-294bc3b09007 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.497929 Apr 02 21:05:50.342873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:50.343506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:50.359347 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1863/4037] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:49 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:50.913698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.933066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.935042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:50.938188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a074c39-3720-419c-aec2-034d38f97488 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.634697 Apr 02 21:05:50.960870 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2175/4038] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:50 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:51.087458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:51.089371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:51.106203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:51.107042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:51.108073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:51.108840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:51.320605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:51.332230 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a46c0ec-f095-4efc-ab0a-085020b6ac05 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.249138 Apr 02 21:05:51.339939 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1864/4039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:51 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:51.360931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:51.361643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:51.371727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:51.372375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:51.375729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:51.376198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:51.964768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:51.966003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:51.986064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:51.988215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:51.990473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:51.994074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:52.293755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.311526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.313147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.314353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ae1e2e7-1799-4835-b353-830e25919b6d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.356848 Apr 02 21:05:52.315103 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1865/4040] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:51 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:52.359401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:52.360250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:52.366520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:52.366977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:52.367939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:52.368673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:52.582064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.594059 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42d88581-c017-4d81-b07e-8995f4e0f26a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.238702 Apr 02 21:05:52.595501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1866/4041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:52 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:52.649709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.662396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.664000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:52.665131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a4c51ed9-ffc3-499f-9c39-788a73d73b4b tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 1.309120 Apr 02 21:05:52.665692 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2176/4042] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:51 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:52.970029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-006e745d-57bb-40fe-bbc2-27255616ef2d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: .version_select at 0x7f54d4bc35e0>, body: {"keypair": {"name": "tempest-keypair-426645117"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:52.984767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-006e745d-57bb-40fe-bbc2-27255616ef2d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:52.990237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-006e745d-57bb-40fe-bbc2-27255616ef2d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:53.140934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-006e745d-57bb-40fe-bbc2-27255616ef2d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:53.146716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-006e745d-57bb-40fe-bbc2-27255616ef2d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:53.165196 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-006e745d-57bb-40fe-bbc2-27255616ef2d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.198910 Apr 02 21:05:53.171341 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1867/4043] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:05:52 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:53.334638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:53.335258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:53.343058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:53.343570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:53.344300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:53.344942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:53.614397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:53.615128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:53.622016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:53.622960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:53.624198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:53.625106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:53.779884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:53.795363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:53.797350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:53.799183 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e78e1995-2318-4adf-a3bc-90c79efbae88 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.468535 Apr 02 21:05:53.810699 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2177/4044] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:53 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:53.817257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:53.818791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:53.827925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:53.828772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:53.830204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:53.830867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:53.856140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:53.867537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-150ab048-01de-4334-a596-a5cfe706119e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.259487 Apr 02 21:05:53.869285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1868/4045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:53 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:54.519986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:54.532222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:54.548416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:54.550981 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afbf2ad2-dda9-4552-8a5f-445bd2bdfab0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.738968 Apr 02 21:05:54.552021 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2178/4046] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:53 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:54.819280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:54.820036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:54.840318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:54.840656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:54.841193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:54.841647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:54.886126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:54.886743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:54.896370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:54.897110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:54.898807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:54.901607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.249542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:55.259363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5603f3b4-4c1b-4d0d-97c0-31cb103dd163 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.378250 Apr 02 21:05:55.263016 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2179/4047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:54 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:55.573732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:55.575237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:55.583926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:55.584699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.585687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:55.595342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.596541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:55.606187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:55.611233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:55.620316 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a384d011-8dc2-4ddb-9b56-518d54357cd2 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.799559 Apr 02 21:05:55.621064 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1869/4048] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:54 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:55.844134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:55.847627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:55.848915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Searching by: {'deleted': False, 'project_id': 'a5aab95c86ad418185090595372fd48c'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:05:55.856414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:55.857167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.858225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:55.858903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.886630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:05:55.917780 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9ff718c-547e-4821-89dc-a965e1eb216b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.077416 Apr 02 21:05:55.919051 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1870/4049] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:05:55 2022] GET /compute/v2.1/servers => generated 333 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:55.934127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:55.939976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:55.942306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Searching by: {'deleted': False, 'project_id': 'a5aab95c86ad418185090595372fd48c'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:05:55.950445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:55.951456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.952629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:55.953314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:55.999614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:05:56.011136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:56.040806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:56.042939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:56.046404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:56.049712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.050977 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-91482270-a668-40a7-aa27-b0768fce0207 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.484872 Apr 02 21:05:56.051683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.054173 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2180/4050] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:55 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:05:56.181195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-336781998", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e11fe41-71ae-4517-9435-793475d4d7b5"}], "security_groups": [{"name": "tempest-securitygroup--41689239"}], "key_name": "tempest-keypair-426645117", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:05:56.298566 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee4b6652-6471-44c0-a4ef-5ad5443cf724 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.371314 Apr 02 21:05:56.299438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1871/4051] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:05:55 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:56.304757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:56.306749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] validate_networks() for [('8e11fe41-71ae-4517-9435-793475d4d7b5', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:05:56.308127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:56.318190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.319123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.320119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.320778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.679031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:56.692386 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b1871afa-8485-4a5a-8caf-ea5c43ba83d5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.391472 Apr 02 21:05:56.693021 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1872/4052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:56 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:56.698129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-362041d3-9367-4f9d-b08d-42c101195576 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:56.712061 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-362041d3-9367-4f9d-b08d-42c101195576 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017959 Apr 02 21:05:56.717058 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1873/4053] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:05:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:05:56.723581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:56.725247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:56.733467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.734939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.735937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.737369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.824600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:05:56.825000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:05:56.825480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:05:56.825892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:05:56.826671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:05:56.846641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.847570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.848750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:56.849472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:56.873619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:05:56.879864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:05:56.895664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:05:56.898652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:05:56.953600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a56ee511-3d6a-4c25-ad0c-b7c3d1cb4d32 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.776855 Apr 02 21:05:56.959697 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2181/4054] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:05:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:05:56.965713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd3dc9e9-85c2-4597-be4e-bcddc78b720c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:56.966644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd3dc9e9-85c2-4597-be4e-bcddc78b720c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:57.033233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd3dc9e9-85c2-4597-be4e-bcddc78b720c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.040820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd3dc9e9-85c2-4597-be4e-bcddc78b720c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1240 microversion: 2.1 time: 0.079672 Apr 02 21:05:57.042779 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2182/4055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:56 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:57.051530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.065011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.066490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:57.066897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.067254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:57.071184 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9e0228a-79f0-46ab-9a9f-defcb428faf5 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.352253 Apr 02 21:05:57.071770 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1874/4056] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:56 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:57.079969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.081969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.085444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.086056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.088955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:57.093243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:57.100677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.101277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.102182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.102737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.128621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:05:57.277900 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79ecd2ae-264d-47d7-a5e2-c6063c97735c tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 204 len: 0 microversion: 2.1 time: 0.224106 Apr 02 21:05:57.279358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2183/4057] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:05:57 2022] DELETE /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:05:57.293636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:57.294726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:57.303095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.303785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.304889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.305536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.504703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.513960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3253b9f2-c0db-45cb-ba70-17e52a0c731b tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1700 microversion: 2.1 time: 0.229030 Apr 02 21:05:57.514574 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2184/4058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:57 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1700 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:57.552849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.563109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.567329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.571981 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89b884f5-7412-47f9-812e-bff072c52596 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.494362 Apr 02 21:05:57.572674 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1875/4059] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:57 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:57.712557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:57.714682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:57.724490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.725474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.726393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:57.727099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:57.948317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:57.964084 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3046be2c-e8f7-45a5-bf2c-a085a20301ac tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.257618 Apr 02 21:05:57.964931 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2185/4060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:57 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:58.061094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:58.062392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:58.071061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.071609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.073296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.073785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.093580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:58.094303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:58.105832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.108380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.114738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.115256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.194545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:58.206770 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bf2c124d-db43-49c9-b837-35dc6896d771 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1292 microversion: 2.1 time: 0.151373 Apr 02 21:05:58.209114 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1876/4061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:58 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:58.348157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:58.360572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:58.362670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:58.364387 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76e8f9db-f860-4c66-acc0-34b273ba1e93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.275182 Apr 02 21:05:58.365684 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2186/4062] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:58 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:58.533145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:58.533766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:58.545254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.545739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.546556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.547010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.591797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:58.593023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:58.600107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.601902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.605836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.607681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.802326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:58.810097 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d8c4fd7-104c-46a2-9ca8-f9f95c3aa467 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1700 microversion: 2.1 time: 0.281429 Apr 02 21:05:58.811568 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1877/4063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:58 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1700 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:58.980825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:58.981601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:58.991636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:58.992547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:58.993601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.004687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.065336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.079125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.081911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.083074 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61a89e6c-3a49-48b1-b46c-ae16a7cfb363 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.495780 Apr 02 21:05:59.100419 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2187/4064] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:58 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:05:59.225442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:59.226301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:59.233753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.234451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.235434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.236050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.342529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.353430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6271ba9d-f678-4779-8e31-b84e1388a8d1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1298 microversion: 2.1 time: 0.132013 Apr 02 21:05:59.372369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2188/4065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:59 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1298 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:05:59.386454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:59.389476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:59.396168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.405283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.406799 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07910e8e-cd85-4535-81ff-21eac4dc5652 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1515 microversion: 2.1 time: 0.428425 Apr 02 21:05:59.407451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.414015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.414659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.418109 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1878/4066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:58 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1515 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:05:59.823151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.828548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:05:59.829337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:05:59.835010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.836659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:05:59.838766 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2de2de5a-5c01-4544-89b5-0e66604396fd tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.458663 Apr 02 21:05:59.844681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.845083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.845887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:05:59.846340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:05:59.852363 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2189/4067] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:05:59 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:06:00.108418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:00.109983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:00.127988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.127988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.136973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.140547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.263391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:00.282073 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5d43f15-4a6e-4cf8-a5c8-dfdb373793c7 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1700 microversion: 2.1 time: 0.454021 Apr 02 21:06:00.282813 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1879/4068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:05:59 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1700 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:00.378721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:00.379440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:00.397796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.398436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.400649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.401986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.545467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:00.556046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:00.558658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:00.560104 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f7b0927-8be4-4dd9-b48f-78ea6834c79f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.456577 Apr 02 21:06:00.572750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2190/4069] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:00 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:00.580197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:00.581185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:00.587922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.588718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.589783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.590439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.949273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:00.959581 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1bce0898-ffb2-4c87-9d90-b387edb0ba45 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.385116 Apr 02 21:06:00.960030 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2191/4070] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:00 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:00.967154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:00.967773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:00.975207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.977159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:00.978122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:00.979321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:01.365057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:01.378101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:01.380342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:01.381872 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-01e7f4ea-daa9-4608-b85a-25cecb7f1750 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.419117 Apr 02 21:06:01.382454 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2192/4071] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:00 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:01.395547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:01.402971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:01.420397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:01.420898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:01.433625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:01.435852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:01.448195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:01.464266 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31e1ca29-2e09-4df9-96eb-39762a98bfa3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 1.092359 Apr 02 21:06:01.465687 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1880/4072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:00 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:01.548284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:01.555862 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f45eae01-2d59-4856-9951-49012e410e04 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1633 microversion: 2.1 time: 0.168140 Apr 02 21:06:01.560636 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2193/4073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:01 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1633 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:01.579701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:01.580744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:01.588025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:01.588725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:01.589914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:01.590680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:01.665076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4184a88f-7e11-4ef6-921f-b8d4dc5dec1a req-8576fbb9-8b33-4556-a09f-1bbaa6eee430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffaf327-24f7-4378-ae51-a4bd58d135df", "tag": "19ccd802-b62f-4e90-8658-35f9abd17342"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:01.678383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4184a88f-7e11-4ef6-921f-b8d4dc5dec1a req-8576fbb9-8b33-4556-a09f-1bbaa6eee430 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:01.681142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4184a88f-7e11-4ef6-921f-b8d4dc5dec1a req-8576fbb9-8b33-4556-a09f-1bbaa6eee430 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:01.708837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4184a88f-7e11-4ef6-921f-b8d4dc5dec1a req-8576fbb9-8b33-4556-a09f-1bbaa6eee430 service nova] Creating event network-changed:19ccd802-b62f-4e90-8658-35f9abd17342 for instance 0ffaf327-24f7-4378-ae51-a4bd58d135df on nch1-master-1 Apr 02 21:06:01.718533 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4184a88f-7e11-4ef6-921f-b8d4dc5dec1a req-8576fbb9-8b33-4556-a09f-1bbaa6eee430 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058519 Apr 02 21:06:01.719856 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2194/4074] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:01.987398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:01.989056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:02.015785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.017800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.019613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.020299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.341470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:02.363100 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5cd79aaf-eec3-403e-b21a-4dbb11430d23 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.383413 Apr 02 21:06:02.364102 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2195/4075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:01 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:02.371400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d79035a0-d237-4954-a6bf-cf534d7b61f6 req-766d7f54-6ce1-4f00-bcdc-1b97ce938afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6072d790-7f5b-42a2-b398-e5521af36a5c", "name": "network-vif-deleted", "tag": "b0b07539-5b31-495b-ae92-64bd4e85ef91"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:02.399375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d79035a0-d237-4954-a6bf-cf534d7b61f6 req-766d7f54-6ce1-4f00-bcdc-1b97ce938afa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.401509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d79035a0-d237-4954-a6bf-cf534d7b61f6 req-766d7f54-6ce1-4f00-bcdc-1b97ce938afa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.424565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:02.428482 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d79035a0-d237-4954-a6bf-cf534d7b61f6 req-766d7f54-6ce1-4f00-bcdc-1b97ce938afa service nova] Creating event network-vif-deleted:b0b07539-5b31-495b-ae92-64bd4e85ef91 for instance 6072d790-7f5b-42a2-b398-e5521af36a5c on nch1-master-1 Apr 02 21:06:02.440413 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d79035a0-d237-4954-a6bf-cf534d7b61f6 req-766d7f54-6ce1-4f00-bcdc-1b97ce938afa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074720 Apr 02 21:06:02.445159 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2196/4076] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:02.452174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:02.452808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:02.459137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:02.459444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:02.460408 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d2f8d7a9-1059-453d-b476-95e19a3f672f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.884813 Apr 02 21:06:02.474028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.477194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.478150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.479249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.481109 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1881/4077] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:01 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:02.488201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:02.488869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:02.509067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.511575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.513468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.515623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.929958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:02.938574 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f04bb961-229d-404d-967c-2046c40e63fc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.456267 Apr 02 21:06:02.944502 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1882/4078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:02 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:02.966640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:02.967386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:02.980602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.984235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:02.985420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:02.986005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:03.093309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:03.094013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:03.094710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lazy-loading 'fault' on Instance uuid 6072d790-7f5b-42a2-b398-e5521af36a5c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:06:03.280298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3fba445dba44b79a1e912e2cf10c905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5aab95c86ad418185090595372fd48c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:03.288285 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d52fa5e1-470d-4b8a-9a5a-dbd48494c953 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 200 len: 1359 microversion: 2.1 time: 0.339807 Apr 02 21:06:03.293206 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1883/4079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:02 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:03.379467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:03.380513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:03.393508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:03.394263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:03.395316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:03.397559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:03.632503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:03.647266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:03.653349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:03.654857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aff5653e-53e6-4c98-9ed2-a5d06e6398a7 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 1.208290 Apr 02 21:06:03.658002 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2197/4080] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:02 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:03.664668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:03.666339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:03.697246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:03.698593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:03.701350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:03.703500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:03.954251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:03.963992 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17f4ba0b-aa23-4cda-990c-fc6f7a086939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.588327 Apr 02 21:06:03.972532 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1884/4081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:03 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:03.977668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:03.985787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:03.997726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.000287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.003716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.004356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.295529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:04.315773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:04.317604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:04.318783 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48465df0-96e5-40e3-b93d-61d0fe909663 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.659593 Apr 02 21:06:04.330610 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2198/4082] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:03 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:04.341383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-85e3c4e7-62f8-4429-b89d-9d0756a9fdc6 req-d18daf2d-3fff-4254-95b9-5f0b2767d843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "name": "network-vif-plugged", "status": "completed", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:04.356969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-85e3c4e7-62f8-4429-b89d-9d0756a9fdc6 req-d18daf2d-3fff-4254-95b9-5f0b2767d843 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.357426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-85e3c4e7-62f8-4429-b89d-9d0756a9fdc6 req-d18daf2d-3fff-4254-95b9-5f0b2767d843 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.375056 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-85e3c4e7-62f8-4429-b89d-9d0756a9fdc6 req-d18daf2d-3fff-4254-95b9-5f0b2767d843 service nova] Creating event network-vif-plugged:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:06:04.394728 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-85e3c4e7-62f8-4429-b89d-9d0756a9fdc6 req-d18daf2d-3fff-4254-95b9-5f0b2767d843 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062847 Apr 02 21:06:04.395553 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2199/4083] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:04.401620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:04.409184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] [instance: 6072d790-7f5b-42a2-b398-e5521af36a5c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:04.421575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.422037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.433168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.434751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.471338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] HTTP exception thrown: Instance 6072d790-7f5b-42a2-b398-e5521af36a5c could not be found. Apr 02 21:06:04.471966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Returning 404 to user: Instance 6072d790-7f5b-42a2-b398-e5521af36a5c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:06:04.472954 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-75d099c1-99b9-4901-b0d3-63771de79085 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c" status: 404 len: 111 microversion: 2.1 time: 0.075987 Apr 02 21:06:04.491675 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2200/4084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:04 2022] GET /compute/v2.1/servers/6072d790-7f5b-42a2-b398-e5521af36a5c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:06:04.512392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c391ed73-443c-4fd0-971f-c37b08175f55 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] Calling method '.version_select at 0x7f54c7d41040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:04.563273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c391ed73-443c-4fd0-971f-c37b08175f55 tempest-ServersTestJSON-1990069574 tempest-ServersTestJSON-1990069574-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048420459" status: 202 len: 0 microversion: 2.1 time: 0.066616 Apr 02 21:06:04.566341 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2201/4085] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:06:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048420459 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:06:04.637221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:04.657619 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0519113b-5122-4c4f-aecb-63bf041de2fe tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.683689 Apr 02 21:06:04.668209 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1885/4086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:03 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:04.676596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:04.677385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:04.689628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.690103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.690902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:04.691598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:04.987743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:04.989285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:05.001054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:05.002064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:05.004586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:05.006669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:05.071111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.081512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.083102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.084296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8564ca3-7ce2-4293-abb4-0769e853934d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.411793 Apr 02 21:06:05.085059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2202/4087] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:04 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:05.345729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:05.346364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:05.359506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:05.359967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:05.361036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:05.361720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:05.463531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.477255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12f176af-9f66-4d42-804f-b12fa2a32939 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.493457 Apr 02 21:06:05.478372 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1886/4088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:04 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:05.674648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:05.675385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:05.684645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:05.685113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:05.685907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:05.686359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:05.798696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.820834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.823487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:05.825483 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b6f6c08-5642-45a1-992e-df21f65f8bfe tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.491364 Apr 02 21:06:05.827109 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2203/4089] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:05 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:06.070786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:06.082239 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-148b2f2d-6cac-484c-a3ce-72762fef5f8e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.411239 Apr 02 21:06:06.083579 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1887/4090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:05 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:06.111341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:06.112267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:06.138938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:06.141044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:06.142610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:06.146743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:06.496829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:06.498892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:06.510446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:06.511216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:06.512261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:06.513537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:06.895092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:06.906962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:06.908782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:06.910124 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8066e21-8d27-4582-9e63-69f907ae178f tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1730 microversion: 2.20 time: 0.810826 Apr 02 21:06:06.920167 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2204/4091] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:06 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1730 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:06.928640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:06.929028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:06.936846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:06.943870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6269cfb-6ec0-4e01-8621-08e201be1eb9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.449965 Apr 02 21:06:06.945002 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1888/4092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:06 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:06.962723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:06.966787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:06.968673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:06.969370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:07.101139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:07.101766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:07.111362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:07.111837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:07.112669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:07.113115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:07.496650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:07.527241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:07.531389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:07.536406 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bcf08c9d-6ed5-483a-8413-5f8d47535c61 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.614842 Apr 02 21:06:07.547147 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2205/4093] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:06 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:07.931681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:07.932973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:07.953676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:07.957961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:07.961478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:07.963905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:07.975968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:07.984881 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a784a251-783f-4e2b-8db8-0d2dfbc9bbc0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.888307 Apr 02 21:06:07.986915 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1889/4094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:07 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:07.996432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:07.997090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:08.007771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:08.008240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:08.009089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:08.011566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:08.482315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:08.483137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:08.491510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5dbf307b-c612-4db0-97ac-3e8802a2c6e4 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.503507 Apr 02 21:06:08.493216 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1890/4095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:07 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:08.515096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:08.521512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:08.527391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7908b950-86e5-4348-8720-ee385a02a56a tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1717 microversion: 2.20 time: 0.600991 Apr 02 21:06:08.542088 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2206/4096] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:07 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1717 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:06:08.564933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:08.566603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:08.578593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:08.581131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:08.585463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:08.587412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:09.003024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:09.003840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:09.017996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:09.018823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:09.019844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:09.020477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:09.115523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:09.128925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:09.141692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:09.144671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e81a1d78-6c30-4e0b-8d3f-899e3da137f0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.584163 Apr 02 21:06:09.145324 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1891/4097] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:08 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:09.518647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:09.522591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:09.532892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:09.534069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:09.535878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:09.537062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:09.832366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:09.852638 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9251ac63-6c69-4ac1-9ccd-f9ce8b8aed98 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.852714 Apr 02 21:06:09.857000 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2207/4098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:08 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:10.026838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:10.045098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd8867e2-c344-436f-9361-82e5d870c8b9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.533674 Apr 02 21:06:10.049538 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1892/4099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:09 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:10.165259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:10.166684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:10.183012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:10.184562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:10.185700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:10.188676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:10.825666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:10.838785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:10.840540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:10.842789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b46a031e-fccb-4ae8-879c-8a79a323b57f tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.681664 Apr 02 21:06:10.843200 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2208/4100] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:10 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:10.874753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:10.875923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:10.883391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:10.884113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:10.885666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:10.886113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:11.066707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:11.067670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:11.081213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:11.082336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:11.085912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:11.086847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:11.087073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:11.097064 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-413b8036-3ee5-4588-85ed-3fb45450f1e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.227240 Apr 02 21:06:11.107215 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1893/4101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:10 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:11.467726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:11.497536 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-927276dd-25a1-4bc3-bd63-6cf182d2a49a tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.435956 Apr 02 21:06:11.511362 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2209/4102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:11 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:11.864754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:11.865387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:11.883072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:11.883726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:11.885340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:11.885813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:12.115755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:12.116484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:12.128581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:12.129107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:12.132389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:12.136358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:12.355016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:12.379119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:12.383438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:12.388261 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-029df5d4-741c-4936-bba8-229e600c98e6 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.528921 Apr 02 21:06:12.390376 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1894/4103] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:11 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:12.519592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:12.521693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:12.551833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:12.552671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:12.553655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:12.554266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:12.710115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:12.721446 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-239f1d4b-5b99-4006-95c3-4a9d262b45ff tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.608676 Apr 02 21:06:12.724518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2210/4104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:12 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:12.858595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5e531960-5456-45f6-b77e-5d9fdbc30037 req-5311f9fb-f363-4d98-a1e1-70ae6d19c2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "a43c7f16-83a8-4758-918d-0bd3f2393170"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:12.879956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5e531960-5456-45f6-b77e-5d9fdbc30037 req-5311f9fb-f363-4d98-a1e1-70ae6d19c2b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:12.881362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5e531960-5456-45f6-b77e-5d9fdbc30037 req-5311f9fb-f363-4d98-a1e1-70ae6d19c2b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:12.921427 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5e531960-5456-45f6-b77e-5d9fdbc30037 req-5311f9fb-f363-4d98-a1e1-70ae6d19c2b2 service nova] Creating event network-vif-plugged:a43c7f16-83a8-4758-918d-0bd3f2393170 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:12.934984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:12.940056 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5e531960-5456-45f6-b77e-5d9fdbc30037 req-5311f9fb-f363-4d98-a1e1-70ae6d19c2b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085700 Apr 02 21:06:12.943727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2211/4105] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:12.948372 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd871899-739e-4680-8ac7-1bd995ecaf3b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.433152 Apr 02 21:06:12.950660 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1895/4106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:12 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:13.407954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:13.409102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:13.423513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:13.424617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:13.425865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:13.426548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:13.738483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:13.739345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:13.751724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:13.752233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:13.757823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:13.759948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:14.464177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:14.477702 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9397fa86-32b5-49cc-9527-d73a10550e46 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.743057 Apr 02 21:06:14.483822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1896/4107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:13 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:14.549355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:14.550116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:14.581847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:14.582548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:14.583341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:14.591781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:14.593018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:14.603694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:14.620231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:14.623874 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2aba4cf0-64b2-4eca-9a14-e28617cadd47 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 1.219769 Apr 02 21:06:14.625648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2212/4108] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:13 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:14.942985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:14.952612 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-03c3e2f9-e0fa-477c-b9b4-0755dc8ae800 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.467297 Apr 02 21:06:14.954765 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1897/4109] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:14 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:15.034623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-380ccb19-6e4c-43cf-9c69-c090fb2b8109 req-07d9a948-b891-4585-aea6-c1a50892a74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffaf327-24f7-4378-ae51-a4bd58d135df", "name": "network-vif-plugged", "status": "completed", "tag": "19ccd802-b62f-4e90-8658-35f9abd17342"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "7374b67b-9bb7-474a-b2c1-f4e86b602226"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:15.047641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-380ccb19-6e4c-43cf-9c69-c090fb2b8109 req-07d9a948-b891-4585-aea6-c1a50892a74a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:15.049468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-380ccb19-6e4c-43cf-9c69-c090fb2b8109 req-07d9a948-b891-4585-aea6-c1a50892a74a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:15.082395 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-380ccb19-6e4c-43cf-9c69-c090fb2b8109 req-07d9a948-b891-4585-aea6-c1a50892a74a service nova] Creating event network-vif-plugged:19ccd802-b62f-4e90-8658-35f9abd17342 for instance 0ffaf327-24f7-4378-ae51-a4bd58d135df on nch1-master-1 Apr 02 21:06:15.087384 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-380ccb19-6e4c-43cf-9c69-c090fb2b8109 req-07d9a948-b891-4585-aea6-c1a50892a74a service nova] Creating event network-vif-plugged:7374b67b-9bb7-474a-b2c1-f4e86b602226 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:15.111742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-380ccb19-6e4c-43cf-9c69-c090fb2b8109 req-07d9a948-b891-4585-aea6-c1a50892a74a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081509 Apr 02 21:06:15.113920 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2213/4110] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:15.500631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:15.501930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:15.523525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:15.532933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:15.534381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:15.534838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:15.650740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:15.651258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:15.658877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:15.659617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:15.660740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:15.661426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:16.064694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:16.100958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-665ef452-42d9-4ab6-abd0-d89be525e5b4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1364 microversion: 2.1 time: 0.604370 Apr 02 21:06:16.101619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1898/4111] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:15 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1364 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:16.123072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:16.123877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:16.145571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:16.146041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:16.146911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:16.147404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:16.279342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:16.294464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:16.298006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:16.299903 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d688554a-dbdb-42f9-bef1-44bbd97d649d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.660392 Apr 02 21:06:16.304967 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2214/4112] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:15 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:16.538228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:16.548913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4ab587c-1666-47c5-9923-7695637f10d9 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.446175 Apr 02 21:06:16.557798 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1899/4113] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:16 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:17.121000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:17.122259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:17.135684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.138826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.148292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.148959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.192071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-433d6bd7-e8d5-4cc4-ad67-5dcfba3e4bc4 req-f2240a09-57af-429d-82c7-7da2921d4ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "9aa225bb-5f59-4695-9481-c8b83a23a8f6"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "f4c519a1-4b21-4dac-b3f9-1667e9aca676"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:17.209239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-433d6bd7-e8d5-4cc4-ad67-5dcfba3e4bc4 req-f2240a09-57af-429d-82c7-7da2921d4ab0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.210924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-433d6bd7-e8d5-4cc4-ad67-5dcfba3e4bc4 req-f2240a09-57af-429d-82c7-7da2921d4ab0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.231325 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-433d6bd7-e8d5-4cc4-ad67-5dcfba3e4bc4 req-f2240a09-57af-429d-82c7-7da2921d4ab0 service nova] Creating event network-vif-plugged:9aa225bb-5f59-4695-9481-c8b83a23a8f6 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:17.231841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-433d6bd7-e8d5-4cc4-ad67-5dcfba3e4bc4 req-f2240a09-57af-429d-82c7-7da2921d4ab0 service nova] Creating event network-vif-plugged:f4c519a1-4b21-4dac-b3f9-1667e9aca676 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:17.242810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-433d6bd7-e8d5-4cc4-ad67-5dcfba3e4bc4 req-f2240a09-57af-429d-82c7-7da2921d4ab0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054434 Apr 02 21:06:17.243771 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1900/4114] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:17.324013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:17.324800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:17.333333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.333804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.334599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.335048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.439774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:17.452049 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56a9415a-2a8d-45a3-a9e6-9f0264a4fdb7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1554 microversion: 2.1 time: 0.336965 Apr 02 21:06:17.453324 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2215/4115] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:17 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:17.473766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:17.481475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:17.488108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.488915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.489889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.490491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.653970 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cef704c1-8ea7-45e5-ba0f-ffe23679a2ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184119 Apr 02 21:06:17.655163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2216/4116] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:06:17 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:17.690043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:17.694016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:17.717695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.718481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:17.720558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:17.721364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:18.365310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:18.378158 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b29d8190-5e79-436f-84b0-5738c593bc51 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.721499 Apr 02 21:06:18.379145 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2217/4117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:17 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:18.503555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:18.529451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:18.532339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:18.534357 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc0abd57-aa77-47bc-a097-b02745c327ee tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 1.215499 Apr 02 21:06:18.535826 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1901/4118] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:17 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:19.286266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2eadfc53-04b5-4d86-9ada-29b8fc1ae6da req-92f4b1d7-0590-4c6d-a9e6-21a8dd113dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "54ba32fa-f94c-4790-91a7-b7d8bc9665c3"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "adcb837b-7ab2-4b3e-98c2-1a56402cc8a9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:19.297082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2eadfc53-04b5-4d86-9ada-29b8fc1ae6da req-92f4b1d7-0590-4c6d-a9e6-21a8dd113dc0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:19.297898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2eadfc53-04b5-4d86-9ada-29b8fc1ae6da req-92f4b1d7-0590-4c6d-a9e6-21a8dd113dc0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:19.321698 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2eadfc53-04b5-4d86-9ada-29b8fc1ae6da req-92f4b1d7-0590-4c6d-a9e6-21a8dd113dc0 service nova] Creating event network-vif-plugged:54ba32fa-f94c-4790-91a7-b7d8bc9665c3 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:19.322212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2eadfc53-04b5-4d86-9ada-29b8fc1ae6da req-92f4b1d7-0590-4c6d-a9e6-21a8dd113dc0 service nova] Creating event network-vif-plugged:adcb837b-7ab2-4b3e-98c2-1a56402cc8a9 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:19.367015 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2eadfc53-04b5-4d86-9ada-29b8fc1ae6da req-92f4b1d7-0590-4c6d-a9e6-21a8dd113dc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084340 Apr 02 21:06:19.371465 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2218/4119] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:19.395147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:19.396280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:19.403164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:19.417572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:19.418720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:19.421814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:19.558524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:19.561596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:19.577377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:19.578122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:19.579356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:19.580080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:19.841474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:19.868773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0885d1d1-6dd2-4b00-ba6b-aafa36cf9ba2 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.476085 Apr 02 21:06:19.891391 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1902/4120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:19 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:20.401900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:20.422876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:20.425161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:20.427251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2a6a06f9-36ac-4b99-8a0c-7c8370f0a62e tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 0.875597 Apr 02 21:06:20.428579 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2219/4121] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:19 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:20.898771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:20.899383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:20.906980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:20.907639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:20.908632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:20.909266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:21.069418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:21.080878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c1f5e50-4a6b-434d-86f8-3074649058db tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.185930 Apr 02 21:06:21.081788 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1903/4122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:20 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:21.253911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4c1db5e1-83d2-4942-86a7-230e670193a9 req-92d083b4-9a5f-42ee-9852-c2e1b08d4cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffaf327-24f7-4378-ae51-a4bd58d135df", "tag": "19ccd802-b62f-4e90-8658-35f9abd17342"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:21.263944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4c1db5e1-83d2-4942-86a7-230e670193a9 req-92d083b4-9a5f-42ee-9852-c2e1b08d4cf7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:21.264398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4c1db5e1-83d2-4942-86a7-230e670193a9 req-92d083b4-9a5f-42ee-9852-c2e1b08d4cf7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:21.276844 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4c1db5e1-83d2-4942-86a7-230e670193a9 req-92d083b4-9a5f-42ee-9852-c2e1b08d4cf7 service nova] Creating event network-changed:19ccd802-b62f-4e90-8658-35f9abd17342 for instance 0ffaf327-24f7-4378-ae51-a4bd58d135df on nch1-master-1 Apr 02 21:06:21.282126 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4c1db5e1-83d2-4942-86a7-230e670193a9 req-92d083b4-9a5f-42ee-9852-c2e1b08d4cf7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032815 Apr 02 21:06:21.282942 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2220/4123] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:21.391474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-4de6b14e-bcc2-40df-beb1-690a92c2f409 req-fe506865-c9d9-49f6-a1d0-5229d4def69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-plugged", "status": "completed", "tag": "9465817e-88a8-48ec-b330-f9aafa60b53e"}, {"server_uuid": "2b7f0d67-0f7d-4175-8e4a-2dc61e583745", "name": "network-vif-plugged", "status": "completed", "tag": "b0dbd78a-90ff-4260-85f6-5039e1755013"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:21.407794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4de6b14e-bcc2-40df-beb1-690a92c2f409 req-fe506865-c9d9-49f6-a1d0-5229d4def69c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:21.408648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4de6b14e-bcc2-40df-beb1-690a92c2f409 req-fe506865-c9d9-49f6-a1d0-5229d4def69c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:21.429520 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4de6b14e-bcc2-40df-beb1-690a92c2f409 req-fe506865-c9d9-49f6-a1d0-5229d4def69c service nova] Creating event network-vif-plugged:9465817e-88a8-48ec-b330-f9aafa60b53e for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:21.430482 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4de6b14e-bcc2-40df-beb1-690a92c2f409 req-fe506865-c9d9-49f6-a1d0-5229d4def69c service nova] Creating event network-vif-plugged:b0dbd78a-90ff-4260-85f6-5039e1755013 for instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 on nch2-master-1 Apr 02 21:06:21.438788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-4de6b14e-bcc2-40df-beb1-690a92c2f409 req-fe506865-c9d9-49f6-a1d0-5229d4def69c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051035 Apr 02 21:06:21.448767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:21.450632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:21.455546 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1904/4124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:21.462322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:21.463048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:21.464402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:21.465144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:22.106160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:22.107271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:22.130176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:22.131517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:22.137795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:22.140841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:22.561888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:22.577178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:22.599582 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7cb41c9a-e0bd-4032-82a2-5bb80b8bcf0f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1521 microversion: 2.1 time: 0.503538 Apr 02 21:06:22.600710 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1905/4125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:22 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:22.608674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:22.612390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:22.613822 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4ffba76-c9b2-4165-93a8-0fc0bb603600 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 1.170978 Apr 02 21:06:22.621677 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2221/4126] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:21 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:06:23.623904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:23.626848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:23.648800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:23.653735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:23.678723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:23.679654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:23.681601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:23.683066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:23.686825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:23.688031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:23.688180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:23.714470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:24.402310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:24.426897 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d41d9f08-cee4-4ad4-be7c-7b3687496c95 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1506 microversion: 2.1 time: 0.801977 Apr 02 21:06:24.428508 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1906/4127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:23 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:24.473088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:24.473862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:24.498013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:24.500861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:24.504980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:24.510300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:25.342722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:25.365816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:25.379995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c57388e-48ee-4c23-95bd-272a0a3160ed tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 200 len: 1506 microversion: 2.1 time: 0.933273 Apr 02 21:06:25.380671 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1907/4128] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:24 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 1506 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:25.400929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:25.401092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:25.401732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:25.404439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:25.407624 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e3f402c-4bfd-486a-b0ed-a736f7fb6615 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1880 microversion: 2.32 time: 1.771258 Apr 02 21:06:25.408936 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2222/4129] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:23 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1880 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:25.428292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:25.428734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:25.429578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:25.430034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:25.517958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:06:25.677238 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6d39e03b-a207-42a1-aeb8-f9b2a4d37cba tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 204 len: 0 microversion: 2.1 time: 0.280561 Apr 02 21:06:25.678997 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1908/4130] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:06:25 2022] DELETE /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:06:25.946837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-281327292", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "a152d338-1362-4112-aded-4ce4e8c5efcf"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:26.038859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] validate_networks() for [('a152d338-1362-4112-aded-4ce4e8c5efcf', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:06:26.431578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:26.432315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:26.442831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:26.443304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:26.444113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:26.444597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:26.967158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:06:26.968104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:06:26.969183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:06:26.969939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:06:26.970535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:06:26.989736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:26.990199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:26.991225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:26.991826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:27.018098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Getting quotas for project 7f1a5e5adf8141058ce50ee9295e57cc. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:27.028400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Getting quotas for user 5331b96019b4418a8aa6a1facd9e1c06 and project 7f1a5e5adf8141058ce50ee9295e57cc. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:27.043328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:06:27.046253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:06:27.111589 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4f5a69f-178b-4441-8c3a-73c94fe18ac5 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171391 Apr 02 21:06:27.113312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2223/4131] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:06:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:06:27.129175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4f24667-49d3-44bb-bd1c-5300562a30ca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:27.130265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4f24667-49d3-44bb-bd1c-5300562a30ca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:27.311799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4f24667-49d3-44bb-bd1c-5300562a30ca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:27.324292 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4f24667-49d3-44bb-bd1c-5300562a30ca tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1217 microversion: 2.1 time: 0.201218 Apr 02 21:06:27.324977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2224/4132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:27 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:27.633627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:27.643222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:27.658633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:27.659999 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23f92f32-9b25-4445-ad37-09ee3bd04fdb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2831 microversion: 2.32 time: 1.236655 Apr 02 21:06:27.660596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1909/4133] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:26 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2831 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:27.685035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:27.685653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:27.694391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:27.696989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:27.699029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:27.701206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:27.751606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f23cb3f-e2df-455a-87bf-93e7c90dd81f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Action: 'create', calling method: .version_select at 0x7f54d4995430>, body: {"keypair": {"name": "tempest-keypair-151584740"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:27.794167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-7f23cb3f-e2df-455a-87bf-93e7c90dd81f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Getting quotas for project 76098fb9c22b4f84bb0afb2bbe66e858. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:27.810573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-7f23cb3f-e2df-455a-87bf-93e7c90dd81f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Getting quotas for user e5d1c36098a14436a0a10f4fb9937bf1 and project 76098fb9c22b4f84bb0afb2bbe66e858. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:28.487044 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7884eeef-9fec-4a52-808f-5f1b6b9f1751 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.807128 Apr 02 21:06:28.488011 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2225/4134] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Apr 2 21:06:27 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2/os-interface => generated 1830 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:28.502673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:28.503407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:28.515654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:28.516701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:28.518504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-7f23cb3f-e2df-455a-87bf-93e7c90dd81f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Getting quotas for project 76098fb9c22b4f84bb0afb2bbe66e858. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:28.520238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:28.523616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:28.525874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-7f23cb3f-e2df-455a-87bf-93e7c90dd81f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Getting quotas for user e5d1c36098a14436a0a10f4fb9937bf1 and project 76098fb9c22b4f84bb0afb2bbe66e858. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:28.551380 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f23cb3f-e2df-455a-87bf-93e7c90dd81f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.42 time: 0.801332 Apr 02 21:06:28.552866 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1910/4135] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 21:06:27 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 806 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 02 21:06:28.713945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:28.726194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae3180ab-93f5-48bc-a525-85d7e75d769e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1269 microversion: 2.1 time: 0.233412 Apr 02 21:06:28.728935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2226/4136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:28 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:28.808062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-621c1532-bfb5-4dab-8a00-daf603595907 req-3fa064f3-17f1-44c6-8140-2d697d6415f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7f0d67-0f7d-4175-8e4a-2dc61e583745", "name": "network-vif-deleted", "tag": "b0dbd78a-90ff-4260-85f6-5039e1755013"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:28.823125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-621c1532-bfb5-4dab-8a00-daf603595907 req-3fa064f3-17f1-44c6-8140-2d697d6415f9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:28.832835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-621c1532-bfb5-4dab-8a00-daf603595907 req-3fa064f3-17f1-44c6-8140-2d697d6415f9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:28.870601 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-621c1532-bfb5-4dab-8a00-daf603595907 req-3fa064f3-17f1-44c6-8140-2d697d6415f9 service nova] Creating event network-vif-deleted:b0dbd78a-90ff-4260-85f6-5039e1755013 for instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 on nch2-master-1 Apr 02 21:06:28.884572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-621c1532-bfb5-4dab-8a00-daf603595907 req-3fa064f3-17f1-44c6-8140-2d697d6415f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078496 Apr 02 21:06:28.885348 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2227/4137] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:29.020866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9198b02b-fa02-4e85-953f-d424756e9356 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Action: 'create', calling method: .version_select at 0x7f54d4cf2a60>, body: {"keypair": {"name": "tempest-keypair-302907406"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:29.066232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9198b02b-fa02-4e85-953f-d424756e9356 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:29.088932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9198b02b-fa02-4e85-953f-d424756e9356 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for user 8c887a3020eb4d0fbf93b55a1aba87a8 and project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:29.477209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9198b02b-fa02-4e85-953f-d424756e9356 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:29.487347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9198b02b-fa02-4e85-953f-d424756e9356 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for user 8c887a3020eb4d0fbf93b55a1aba87a8 and project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:29.520275 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9198b02b-fa02-4e85-953f-d424756e9356 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.873823 Apr 02 21:06:29.520992 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1911/4138] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:06:28 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:29.748795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:29.749510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:29.759254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:29.765151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:29.766352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:29.766975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:30.019084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:30.036980 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4aece602-8612-4c42-8da5-3d1e770fe3a6 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1275 microversion: 2.1 time: 0.292931 Apr 02 21:06:30.043390 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2228/4139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:29 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1275 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:30.640053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b392e373-ef71-4e48-9df3-338ab59314da req-f10286ac-d560-45bb-b398-a3c9b7e0ac7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "tag": "9aa225bb-5f59-4695-9481-c8b83a23a8f6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:30.658110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b392e373-ef71-4e48-9df3-338ab59314da req-f10286ac-d560-45bb-b398-a3c9b7e0ac7b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:30.658641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b392e373-ef71-4e48-9df3-338ab59314da req-f10286ac-d560-45bb-b398-a3c9b7e0ac7b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:30.681132 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b392e373-ef71-4e48-9df3-338ab59314da req-f10286ac-d560-45bb-b398-a3c9b7e0ac7b service nova] Creating event network-changed:9aa225bb-5f59-4695-9481-c8b83a23a8f6 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:06:30.687538 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b392e373-ef71-4e48-9df3-338ab59314da req-f10286ac-d560-45bb-b398-a3c9b7e0ac7b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052351 Apr 02 21:06:30.688495 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1912/4140] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:31.058894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:31.059533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:31.070604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:31.071106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:31.071918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:31.072378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:32.155151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:32.168901 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5bde54a4-3367-4528-b992-fbd7ce0c4f3c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 1.108866 Apr 02 21:06:32.180272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2229/4141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:31 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:33.189041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:33.189759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:33.203843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:33.204748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:33.205733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:33.206346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:33.601668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-17b28031-6ee7-451f-9bc8-6a32a2cb130c req-2e71a4a0-6288-4c6d-a238-a71b887069b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ea6559-70e5-4edb-a7fd-354622b98a51", "tag": "61a9dbf1-d7f6-4ddd-af09-5187f7bcca4a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:33.631399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:33.656809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-17b28031-6ee7-451f-9bc8-6a32a2cb130c req-2e71a4a0-6288-4c6d-a238-a71b887069b4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:33.656809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-17b28031-6ee7-451f-9bc8-6a32a2cb130c req-2e71a4a0-6288-4c6d-a238-a71b887069b4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:33.661228 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-640b0a7e-b4f0-407d-9931-ee26cecb852b tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 0.477424 Apr 02 21:06:33.662628 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1913/4142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:33 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:33.673093 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-17b28031-6ee7-451f-9bc8-6a32a2cb130c req-2e71a4a0-6288-4c6d-a238-a71b887069b4 service nova] Creating event network-changed:61a9dbf1-d7f6-4ddd-af09-5187f7bcca4a for instance b4ea6559-70e5-4edb-a7fd-354622b98a51 on nch1-master-1 Apr 02 21:06:33.678608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-17b28031-6ee7-451f-9bc8-6a32a2cb130c req-2e71a4a0-6288-4c6d-a238-a71b887069b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084169 Apr 02 21:06:33.679787 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2230/4143] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:33.709810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-267636648", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4ddecd24-a294-4bc2-af54-c9e8165b2234"}, {"port": "a1133854-4680-4b8a-a3a0-c552bb06f10b", "tag": "port-1"}, {"port": "f2e2e42a-9a29-4609-a3e3-c32b9a7d602b", "tag": "port-2"}, {"uuid": "f76a4a04-78ab-412e-b7f3-dab2f53bf154", "tag": "net-1"}, {"uuid": "f76a4a04-78ab-412e-b7f3-dab2f53bf154"}, {"uuid": "32fe859b-79f2-47de-9367-aa2bcd861a1d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "32fe859b-79f2-47de-9367-aa2bcd861a1d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2391b2a9-e519-4491-b2dd-b9c8719a7a94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9dd7dd0d-7620-4ade-ae79-7c552f2cc060", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fbf32828-fb67-44ff-90ac-f60db7ea410b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2032650790"}], "key_name": "tempest-keypair-151584740", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:33.869750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] validate_networks() for [('4ddecd24-a294-4bc2-af54-c9e8165b2234', None, None, None, None, None), (None, None, 'a1133854-4680-4b8a-a3a0-c552bb06f10b', None, None, None), (None, None, 'f2e2e42a-9a29-4609-a3e3-c32b9a7d602b', None, None, None), ('f76a4a04-78ab-412e-b7f3-dab2f53bf154', None, None, None, None, None), ('f76a4a04-78ab-412e-b7f3-dab2f53bf154', None, None, None, None, None), ('32fe859b-79f2-47de-9367-aa2bcd861a1d', '10.2.2.100', None, None, None, None), ('32fe859b-79f2-47de-9367-aa2bcd861a1d', '10.2.2.200', None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:06:34.259454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1110410267", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "34e42b06-bf12-4208-8eb7-5b6548299214"}], "security_groups": [{"name": "tempest-securitygroup--465276332"}], "key_name": "tempest-keypair-302907406", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:34.401938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] validate_networks() for [('34e42b06-bf12-4208-8eb7-5b6548299214', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:06:35.478000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:35.492798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for user 8c887a3020eb4d0fbf93b55a1aba87a8 and project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: dict_keys(['metadata_items']) {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:35.507426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:06:35.507847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:06:35.508589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:06:35.509564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:06:35.510211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:06:35.520359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:35.520847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:35.521694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:35.522150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:35.543215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:35.548809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Getting quotas for user 8c887a3020eb4d0fbf93b55a1aba87a8 and project 9d575ad1b73d40c4a8a1c7e0455886ce. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:35.563568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:06:35.566687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:06:35.616069 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de76cbd1-c71f-46c9-820d-2974a321144e tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.361802 Apr 02 21:06:35.617104 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2231/4144] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:06:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:06:35.628564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:35.629661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:35.637745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:35.638488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:35.640787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:35.641645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:35.983472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:35.994920 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cec2523-b13c-4f19-b97d-7b0a64777391 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 0.376308 Apr 02 21:06:35.996754 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2232/4145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:35 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:36.002380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac572777-9344-46ec-89f8-d4b0bdf75acc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:36.003183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac572777-9344-46ec-89f8-d4b0bdf75acc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:36.095261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac572777-9344-46ec-89f8-d4b0bdf75acc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:36.104547 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac572777-9344-46ec-89f8-d4b0bdf75acc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1277 microversion: 2.1 time: 0.106471 Apr 02 21:06:36.106303 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2233/4146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:35 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:36.556740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:06:36.557214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:06:36.557695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:06:36.558278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:06:36.558697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:06:36.568103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:36.568591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:36.569449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:36.569901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:36.589033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Getting quotas for project 76098fb9c22b4f84bb0afb2bbe66e858. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:36.594475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Getting quotas for user e5d1c36098a14436a0a10f4fb9937bf1 and project 76098fb9c22b4f84bb0afb2bbe66e858. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:36.772476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:06:36.777029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2391b2a9-e519-4491-b2dd-b9c8719a7a94',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9dd7dd0d-7620-4ade-ae79-7c552f2cc060',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbf32828-fb67-44ff-90ac-f60db7ea410b',volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:06:37.014723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:37.015576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:37.035467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:37.036139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:37.037128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:37.038562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:37.243603 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f442a8e-488a-415a-92e3-27de4974481d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 3.538359 Apr 02 21:06:37.244612 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1914/4147] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Apr 2 21:06:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 3540 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 21:06:37.251025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:37.251656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:37.259171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:37.259871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:37.261048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:37.261668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:37.373064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:37.387570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ba7f87f-a4a4-4125-b985-ae6c54faed46 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 0.376966 Apr 02 21:06:37.393111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:37.397892 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2234/4148] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:37 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:37.414138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e46ab846-bbbc-4a04-9371-285d9a26fd09 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1335 microversion: 2.1 time: 0.168130 Apr 02 21:06:37.415299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1915/4149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:37 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1335 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:37.426610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c190bb1-8ac9-4b53-b926-6a0aececd995 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:37.427459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c190bb1-8ac9-4b53-b926-6a0aececd995 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:37.518437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c190bb1-8ac9-4b53-b926-6a0aececd995 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:37.536291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c190bb1-8ac9-4b53-b926-6a0aececd995 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:37.541399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c190bb1-8ac9-4b53-b926-6a0aececd995 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:37.548625 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c190bb1-8ac9-4b53-b926-6a0aececd995 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1284 microversion: 2.42 time: 0.146407 Apr 02 21:06:37.549370 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2235/4150] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:37 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:38.415139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:38.416536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:38.433825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:38.434550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:38.435520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:38.436134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:38.437041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:38.438043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:38.463555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:38.464529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:38.465642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:38.466499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:38.773875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:38.782563 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4dfd1de-18ae-4a30-8c70-e7d0f8648a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.353958 Apr 02 21:06:38.783800 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2236/4151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:38 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:38.789249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:38.790691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:38.797676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:38.798593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:38.799639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:38.800297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:38.913954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:38.924649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:38.926685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:38.928512 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0abfe2ab-c6f1-4b03-bced-a3448fabed4c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1574 microversion: 2.42 time: 0.143414 Apr 02 21:06:38.929480 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2237/4152] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:38 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:39.199441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:39.210375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-979d8da1-6564-4cfb-ae53-788aafded5fc tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 0.799494 Apr 02 21:06:39.221903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1916/4153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:38 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:39.807925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:39.810746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:39.825603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e2262e9e-d59b-469f-9e6b-405560c7eec3 req-7c87bad6-7aae-4646-b4cf-eb0670f45aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d56e21-a208-414f-8764-6698a043fac9", "tag": "af08ef28-22d4-4530-afd8-560f19818230"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:39.858371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:39.861214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:39.865880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:39.866377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:39.867055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e2262e9e-d59b-469f-9e6b-405560c7eec3 req-7c87bad6-7aae-4646-b4cf-eb0670f45aaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:39.868126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e2262e9e-d59b-469f-9e6b-405560c7eec3 req-7c87bad6-7aae-4646-b4cf-eb0670f45aaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:39.908822 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e2262e9e-d59b-469f-9e6b-405560c7eec3 req-7c87bad6-7aae-4646-b4cf-eb0670f45aaf service nova] Creating event network-changed:af08ef28-22d4-4530-afd8-560f19818230 for instance 99d56e21-a208-414f-8764-6698a043fac9 on nch2-master-1 Apr 02 21:06:39.922135 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e2262e9e-d59b-469f-9e6b-405560c7eec3 req-7c87bad6-7aae-4646-b4cf-eb0670f45aaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101141 Apr 02 21:06:39.926446 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1917/4154] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:39.951036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:39.951668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:39.959971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:39.960889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:39.961906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:39.962625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:40.101915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:40.114908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:40.119091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:40.120861 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ed76fe8-3243-4634-8df8-3b1a8acef316 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1592 microversion: 2.42 time: 0.174648 Apr 02 21:06:40.121915 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1918/4155] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:39 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1592 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:06:40.231551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:40.232174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:40.243936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:40.244686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:40.245830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:40.247072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:40.481231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:40.489084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:40.491216 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c4fd261-64a7-4162-9874-19918ec4488a tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.694456 Apr 02 21:06:40.493576 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2238/4156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:39 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:40.502127 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7309f418-7b68-4819-a75a-6f3f33c75371 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 0.275485 Apr 02 21:06:40.502927 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1919/4157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:40 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:41.141198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:41.141829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:41.158454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.158917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.160007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.160612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.254804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e47cdfff-adfb-4a12-a177-067ba7fa81f1 req-796685d5-39fb-4582-9e7c-a93af561cc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ea6559-70e5-4edb-a7fd-354622b98a51", "name": "network-vif-plugged", "status": "completed", "tag": "61a9dbf1-d7f6-4ddd-af09-5187f7bcca4a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:41.270659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e47cdfff-adfb-4a12-a177-067ba7fa81f1 req-796685d5-39fb-4582-9e7c-a93af561cc5d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.271053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e47cdfff-adfb-4a12-a177-067ba7fa81f1 req-796685d5-39fb-4582-9e7c-a93af561cc5d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.294230 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e47cdfff-adfb-4a12-a177-067ba7fa81f1 req-796685d5-39fb-4582-9e7c-a93af561cc5d service nova] Creating event network-vif-plugged:61a9dbf1-d7f6-4ddd-af09-5187f7bcca4a for instance b4ea6559-70e5-4edb-a7fd-354622b98a51 on nch1-master-1 Apr 02 21:06:41.309606 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e47cdfff-adfb-4a12-a177-067ba7fa81f1 req-796685d5-39fb-4582-9e7c-a93af561cc5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058546 Apr 02 21:06:41.310259 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1920/4158] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:41.511830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:41.512851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:41.520478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.521019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.522802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.522802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.624986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:41.637498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:41.639435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:41.641524 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cb1c03e9-7469-4d32-ab39-db1018f2a28d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1660 microversion: 2.42 time: 0.504635 Apr 02 21:06:41.655551 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2239/4159] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:41 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1660 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:41.660932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:41.661786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:41.668606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.669367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.670372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:41.671025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:41.683610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:41.691470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6ed9d9c-fe40-47ef-a048-1c4326c8d1f7 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.184384 Apr 02 21:06:41.692309 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1921/4160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:41 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:41.929220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:41.943170 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f81ea09f-c7ca-484c-81df-37e2eccc9fff tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1317 microversion: 2.1 time: 0.286064 Apr 02 21:06:41.943777 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2240/4161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:41 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:42.662663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:42.665497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:42.673435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:42.674100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:42.675070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:42.675676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:42.710659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:42.712002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:42.725521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:42.726525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:42.729508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:42.730502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:42.960220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:42.974327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:42.977782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:42.978869 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8adfb1fc-94ee-4867-94b2-1ba9a7551d79 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1754 microversion: 2.42 time: 0.321968 Apr 02 21:06:42.979779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1922/4162] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:42 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1754 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:42.985465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:42.986289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:43.006060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.013123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.013996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.014453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.092940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:43.102656 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3fb7456a-bdf1-44e6-b971-39c7008d14ea tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.397089 Apr 02 21:06:43.108905 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2241/4163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:42 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:43.281009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:43.296681 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db25b703-b577-4c00-8ac1-10b1fd8092eb tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1506 microversion: 2.1 time: 0.315355 Apr 02 21:06:43.298782 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1923/4164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:42 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:43.317093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:43.317767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:43.328505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.329020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.330099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.331242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.601203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:43.610212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a4c6027-b203-406e-ae62-dbae8339962f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1506 microversion: 2.1 time: 0.298156 Apr 02 21:06:43.611236 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2242/4165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:43 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:43.626447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:43.627903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:43.634270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.634724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.635497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.635938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.704758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aee8f753-bb51-49e5-b3c2-cc1d49e8abec tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "PUT /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1078 microversion: 2.1 time: 0.082284 Apr 02 21:06:43.712667 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1924/4166] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:06:43 2022] PUT /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1078 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:43.720743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:43.721374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:43.729908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.730367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:43.731160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:43.731607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.000150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:44.001241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:44.033002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.033652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.034501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.034950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.049068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:44.059381 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e921d97d-1a7e-4533-9b22-5a93487e2013 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1504 microversion: 2.1 time: 0.343654 Apr 02 21:06:44.062455 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2243/4167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:43 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:44.083597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:44.084345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:44.106561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.110121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.111390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.113041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.358262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:44.371315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:44.373510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:44.374966 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eda747c5-5a38-4809-9891-ee55be51c59d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1789 microversion: 2.42 time: 0.379792 Apr 02 21:06:44.375757 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1925/4168] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:43 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1789 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:44.385166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:44.386261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:44.394220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.395077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.396102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.396717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.463239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:44.473584 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d5c84a6-84a2-459a-aa2e-23a7d04df31e tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1504 microversion: 2.1 time: 0.397979 Apr 02 21:06:44.474767 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2244/4169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:44 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:44.492345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:44.496354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:44.507502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.509518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.511351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.512073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.609566 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e83feded-9532-4f78-ba0f-322a12f6773c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "PUT /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1080 microversion: 2.1 time: 0.123174 Apr 02 21:06:44.611254 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2245/4170] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:06:44 2022] PUT /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1080 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:44.625741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:44.627552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:44.628355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:44.635800 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57585046-4e70-4919-859d-6d8d5d8d2a8d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.258753 Apr 02 21:06:44.637188 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1926/4171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:44 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:44.638700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.639169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.639970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:44.641098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:44.996854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:45.006552 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9899af3a-24f8-4282-9d29-9ba1b39a364d tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1506 microversion: 2.1 time: 0.384878 Apr 02 21:06:45.007912 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2246/4172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:44 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:45.026509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:45.028025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:45.039860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.040677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.042091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.042715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.400105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:45.401070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:45.417161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.420139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.422134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.423073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.435788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:45.455491 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f92985a9-7844-42f1-95cd-af48639bbb99 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1506 microversion: 2.1 time: 0.429482 Apr 02 21:06:45.469373 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1927/4173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:45 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:45.475286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:45.483385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:45.496042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.499847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.500738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.501193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.550054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:06:45.695323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8d077305-f708-49d1-9a67-6b7cc7f90586 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 204 len: 0 microversion: 2.1 time: 0.223666 Apr 02 21:06:45.696042 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1928/4174] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:06:45 2022] DELETE /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:06:45.719799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:45.720752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:45.733331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.734214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.735355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.736018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.840237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:45.861494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:45.863115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:45.864334 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b954341-cff3-4ecd-916d-6387a3984cd6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1836 microversion: 2.42 time: 0.470862 Apr 02 21:06:45.864935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2247/4175] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:45 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1836 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:45.887381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:45.888278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:45.901087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.902153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.903313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:45.909969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:45.946902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:06:46.049183 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Instance is already in deleting state, ignoring this request Apr 02 21:06:46.050136 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b6403200-64b8-4a59-9323-040ee7535023 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 204 len: 0 microversion: 2.1 time: 0.174320 Apr 02 21:06:46.053975 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2248/4176] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:06:45 2022] DELETE /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:06:46.069387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:46.069643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:46.086684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:46.087266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:46.088132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:46.088647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:46.329566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:46.341908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc9524fb-1392-4123-8196-b0219ef86c90 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.644390 Apr 02 21:06:46.346771 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1929/4177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:45 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:46.606992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:46.616333 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-84cc5d55-9dc3-4dfe-ac4b-9cc30a840d04 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1512 microversion: 2.1 time: 0.556765 Apr 02 21:06:46.618849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2249/4178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:46 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:46.697006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b4715199-be3c-4d6a-9dc2-e0f7a99dedb0 req-85e9d3cf-35ec-42d6-926c-698851a1de5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:46.714997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b4715199-be3c-4d6a-9dc2-e0f7a99dedb0 req-85e9d3cf-35ec-42d6-926c-698851a1de5f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:46.718093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b4715199-be3c-4d6a-9dc2-e0f7a99dedb0 req-85e9d3cf-35ec-42d6-926c-698851a1de5f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:46.737768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b4715199-be3c-4d6a-9dc2-e0f7a99dedb0 req-85e9d3cf-35ec-42d6-926c-698851a1de5f service nova] Creating event network-changed:5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:46.763577 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b4715199-be3c-4d6a-9dc2-e0f7a99dedb0 req-85e9d3cf-35ec-42d6-926c-698851a1de5f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069645 Apr 02 21:06:46.764844 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1930/4179] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:46.886350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:46.886935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:46.899648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:46.900108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:46.907297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:46.908012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:47.280938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:47.298223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:47.299769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:47.301185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81473e7c-f435-4a4a-bb96-c1f999b8014f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1836 microversion: 2.42 time: 0.421564 Apr 02 21:06:47.301757 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2250/4180] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:46 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1836 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:47.362763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:47.364280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:47.372573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:47.373389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:47.374429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:47.375115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:47.561486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2bb58f8c-062e-4682-9f2a-585e5dec6a55 req-b0d4b64a-ccef-4ac0-95a3-84217dbc90e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d56e21-a208-414f-8764-6698a043fac9", "name": "network-vif-plugged", "status": "completed", "tag": "af08ef28-22d4-4530-afd8-560f19818230"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:47.578073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2bb58f8c-062e-4682-9f2a-585e5dec6a55 req-b0d4b64a-ccef-4ac0-95a3-84217dbc90e4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:47.578526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2bb58f8c-062e-4682-9f2a-585e5dec6a55 req-b0d4b64a-ccef-4ac0-95a3-84217dbc90e4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:47.598606 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2bb58f8c-062e-4682-9f2a-585e5dec6a55 req-b0d4b64a-ccef-4ac0-95a3-84217dbc90e4 service nova] Creating event network-vif-plugged:af08ef28-22d4-4530-afd8-560f19818230 for instance 99d56e21-a208-414f-8764-6698a043fac9 on nch2-master-1 Apr 02 21:06:47.609257 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2bb58f8c-062e-4682-9f2a-585e5dec6a55 req-b0d4b64a-ccef-4ac0-95a3-84217dbc90e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055765 Apr 02 21:06:47.610139 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2251/4181] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:47.636819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:47.637791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:47.653383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:47.654125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:47.655039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:47.657487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:48.061833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:48.074786 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0716e3e5-d5ac-4bb5-a923-44458f4e09d7 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1512 microversion: 2.1 time: 0.442982 Apr 02 21:06:48.077607 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2252/4182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:47 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:48.326195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:48.327558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:48.336668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:48.338607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:48.341209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:48.342170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:48.847697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:48.859507 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e15eaafd-1e65-4716-bd38-62bbd4806a6f tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 1.502656 Apr 02 21:06:48.860112 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1931/4183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:47 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:48.870639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-390da76b-72d7-40d6-a664-7f910bf1990c req-2f0c9b60-ba1b-44c4-9cbe-033b530e08f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "a1133854-4680-4b8a-a3a0-c552bb06f10b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:48.892539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-390da76b-72d7-40d6-a664-7f910bf1990c req-2f0c9b60-ba1b-44c4-9cbe-033b530e08f6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:48.893611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-390da76b-72d7-40d6-a664-7f910bf1990c req-2f0c9b60-ba1b-44c4-9cbe-033b530e08f6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:48.918945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-390da76b-72d7-40d6-a664-7f910bf1990c req-2f0c9b60-ba1b-44c4-9cbe-033b530e08f6 service nova] Creating event network-changed:a1133854-4680-4b8a-a3a0-c552bb06f10b for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:48.924986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-390da76b-72d7-40d6-a664-7f910bf1990c req-2f0c9b60-ba1b-44c4-9cbe-033b530e08f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062062 Apr 02 21:06:48.925920 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1932/4184] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:49.095877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:49.096995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:49.104268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:49.105098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:49.106128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:49.106786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:49.225718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:49.248844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:49.254390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:49.256135 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee20ea9c-0e54-4a6a-9990-d176680567e8 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1857 microversion: 2.42 time: 0.937558 Apr 02 21:06:49.257395 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2253/4185] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:48 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1857 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:49.829425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5331b96019b4418a8aa6a1facd9e1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f1a5e5adf8141058ce50ee9295e57cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:49.842660 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eb83dc50-2857-421f-9d6b-735da60e3e49 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 200 len: 1512 microversion: 2.1 time: 0.750598 Apr 02 21:06:49.857158 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1933/4186] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:49 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 1512 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:06:49.884049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:49.884841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:49.902141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:49.902492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:49.904002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:49.906830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:49.923282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fb1d7fc8-0222-498b-9473-9fd815237ee1 req-1d90e33e-fc45-4fae-9dfa-ad6d6fd755f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ea6559-70e5-4edb-a7fd-354622b98a51", "name": "network-vif-deleted", "tag": "61a9dbf1-d7f6-4ddd-af09-5187f7bcca4a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:49.960501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fb1d7fc8-0222-498b-9473-9fd815237ee1 req-1d90e33e-fc45-4fae-9dfa-ad6d6fd755f3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:49.962224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fb1d7fc8-0222-498b-9473-9fd815237ee1 req-1d90e33e-fc45-4fae-9dfa-ad6d6fd755f3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.024753 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fb1d7fc8-0222-498b-9473-9fd815237ee1 req-1d90e33e-fc45-4fae-9dfa-ad6d6fd755f3 service nova] Creating event network-vif-deleted:61a9dbf1-d7f6-4ddd-af09-5187f7bcca4a for instance b4ea6559-70e5-4edb-a7fd-354622b98a51 on nch1-master-1 Apr 02 21:06:50.050867 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fb1d7fc8-0222-498b-9473-9fd815237ee1 req-1d90e33e-fc45-4fae-9dfa-ad6d6fd755f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134905 Apr 02 21:06:50.051573 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1934/4187] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:50.282122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:50.283921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:50.299251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:50.301309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.302506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:50.303183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.466387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:50.488780 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef352ac0-a67f-4f0d-994e-fd24b17c2254 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1402 microversion: 2.1 time: 0.610337 Apr 02 21:06:50.510562 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2254/4188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:49 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1402 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:50.868396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:50.877382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:50.885589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: b4ea6559-70e5-4edb-a7fd-354622b98a51] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:50.910190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:50.912599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:50.913288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.914346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:50.915263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:50.916050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.921994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ede1c48-e459-41da-87e8-7be7d7d17bb1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.649928 Apr 02 21:06:50.922921 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1935/4189] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:50 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:50.948992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] HTTP exception thrown: Instance b4ea6559-70e5-4edb-a7fd-354622b98a51 could not be found. Apr 02 21:06:50.949940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Returning 404 to user: Instance b4ea6559-70e5-4edb-a7fd-354622b98a51 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:06:50.951143 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86814bb7-0463-4953-817d-c614dc669011 tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51" status: 404 len: 111 microversion: 2.1 time: 0.089293 Apr 02 21:06:50.952275 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2255/4190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:50 2022] GET /compute/v2.1/servers/b4ea6559-70e5-4edb-a7fd-354622b98a51 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:06:50.962196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:50.962614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:50.970418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:50.970821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.971903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:50.972692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:50.989316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-071085d4-9b9f-49cb-9e2a-0536720ac014 req-fcca28e2-67a6-4a90-a63b-f8e949991bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "f2e2e42a-9a29-4609-a3e3-c32b9a7d602b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:51.006350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-071085d4-9b9f-49cb-9e2a-0536720ac014 req-fcca28e2-67a6-4a90-a63b-f8e949991bb4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.009658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-071085d4-9b9f-49cb-9e2a-0536720ac014 req-fcca28e2-67a6-4a90-a63b-f8e949991bb4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.018119 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] HTTP exception thrown: Instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 could not be found. Apr 02 21:06:51.023870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Returning 404 to user: Instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:06:51.025500 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b51dd46-a7e8-4523-8337-234db7f3b34f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 404 len: 111 microversion: 2.1 time: 0.068755 Apr 02 21:06:51.029953 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1936/4191] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:06:50 2022] DELETE /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:06:51.034579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:51.037760 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-071085d4-9b9f-49cb-9e2a-0536720ac014 req-fcca28e2-67a6-4a90-a63b-f8e949991bb4 service nova] Creating event network-changed:f2e2e42a-9a29-4609-a3e3-c32b9a7d602b for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:51.039814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: 2b7f0d67-0f7d-4175-8e4a-2dc61e583745] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:51.049637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-071085d4-9b9f-49cb-9e2a-0536720ac014 req-fcca28e2-67a6-4a90-a63b-f8e949991bb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065397 Apr 02 21:06:51.052581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.053040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.053841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.054277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.055259 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2256/4192] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:51.075009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] HTTP exception thrown: Instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 could not be found. Apr 02 21:06:51.078129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Returning 404 to user: Instance 2b7f0d67-0f7d-4175-8e4a-2dc61e583745 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:06:51.080150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-adb089bc-d07c-481b-90ef-6aaeb04ceaad tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745" status: 404 len: 111 microversion: 2.1 time: 0.049020 Apr 02 21:06:51.083301 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1937/4193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:51 2022] GET /compute/v2.1/servers/2b7f0d67-0f7d-4175-8e4a-2dc61e583745 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:06:51.093187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:51.094131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:51.102386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.103125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.104116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.106444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.134830 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] HTTP exception thrown: Instance d783ddb6-bc96-4d25-9003-8c587ffefaec could not be found. Apr 02 21:06:51.135764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Returning 404 to user: Instance d783ddb6-bc96-4d25-9003-8c587ffefaec could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:06:51.136746 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e0c68d2-3353-4371-bf99-75b69e352f7f tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 404 len: 111 microversion: 2.1 time: 0.048474 Apr 02 21:06:51.140197 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2257/4194] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:06:51 2022] DELETE /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:06:51.149082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:51.149766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] [instance: d783ddb6-bc96-4d25-9003-8c587ffefaec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:51.163794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.164710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.165819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.166428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.187130 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] HTTP exception thrown: Instance d783ddb6-bc96-4d25-9003-8c587ffefaec could not be found. Apr 02 21:06:51.187746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] Returning 404 to user: Instance d783ddb6-bc96-4d25-9003-8c587ffefaec could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:06:51.188924 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8bfb9d36-5a0f-4988-8329-957a43c8e04c tempest-ServerDiskConfigTestJSON-1624868282 tempest-ServerDiskConfigTestJSON-1624868282-project] 10.222.0.18 "GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec" status: 404 len: 111 microversion: 2.1 time: 0.044746 Apr 02 21:06:51.189935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1938/4195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:51 2022] GET /compute/v2.1/servers/d783ddb6-bc96-4d25-9003-8c587ffefaec => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:06:51.506787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:51.507321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:51.517458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.519934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.521206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.521828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.942578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:51.944032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:51.952802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.953928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:51.955016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:51.956212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:52.266611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:52.281525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:52.283037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:52.284253 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12dfe10f-3a19-454e-b67f-5e28802b04c6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.346390 Apr 02 21:06:52.284870 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1939/4196] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:51 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:52.307409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:52.317739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05e51c41-e642-48ca-842b-5c0e5f4f5c46 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1589 microversion: 2.1 time: 0.815142 Apr 02 21:06:52.335284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:52.336794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:52.339893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2258/4197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:51 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1589 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:52.343799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:52.344249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:52.345189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:52.345884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:52.552927 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe36906a-e2f6-4885-86f2-d37a7ec74ba1 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221759 Apr 02 21:06:52.553811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1940/4198] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:06:52 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9/os-interface => generated 285 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:53.156266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c3f5bd60-c7de-4bed-99fd-9318193eb388 req-2709027a-395c-4a8c-b307-dc70bad47a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "7ae013e3-926a-45ea-aa70-0539b27a910a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:53.171681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c3f5bd60-c7de-4bed-99fd-9318193eb388 req-2709027a-395c-4a8c-b307-dc70bad47a85 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:53.172673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c3f5bd60-c7de-4bed-99fd-9318193eb388 req-2709027a-395c-4a8c-b307-dc70bad47a85 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:53.214467 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c3f5bd60-c7de-4bed-99fd-9318193eb388 req-2709027a-395c-4a8c-b307-dc70bad47a85 service nova] Creating event network-changed:7ae013e3-926a-45ea-aa70-0539b27a910a for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:53.220535 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c3f5bd60-c7de-4bed-99fd-9318193eb388 req-2709027a-395c-4a8c-b307-dc70bad47a85 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068420 Apr 02 21:06:53.222142 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2259/4199] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:53.310976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:53.311667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:53.330451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:53.332615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:53.333862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:53.334742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:54.135957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:54.160615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:54.166504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:54.186751 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-838a5065-d462-445b-9f0b-b5bd76297dfd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.885836 Apr 02 21:06:54.188427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1941/4200] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:53 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:55.211537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:55.212925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:55.230668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:55.231070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:55.231924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:55.232617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:55.254478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "bf93e761-9d1c-42fd-90a1-2b5196433096"}, {"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "10107d8d-9752-412f-8706-611605cd57c7"}, {"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "da097fe9-f79d-4d6d-8d6c-d413f8913252"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:55.302688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:55.303942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:55.334457 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] Creating event network-changed:bf93e761-9d1c-42fd-90a1-2b5196433096 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:55.342556 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] Creating event network-changed:10107d8d-9752-412f-8706-611605cd57c7 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:55.346036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] Creating event network-changed:da097fe9-f79d-4d6d-8d6c-d413f8913252 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:06:55.361538 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0a03665c-ebd2-474e-b2dc-89bfa32cccaf req-a2343718-00b0-413a-8da8-60091a488135 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.114166 Apr 02 21:06:55.363246 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1942/4201] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:06:55.372504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:55.374481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:55.382038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:55.382570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:55.384105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:55.384581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:55.682773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:55.699028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:55.701374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:55.703584 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ef69dab-1334-4cc7-ae3b-bd534182ca36 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.497859 Apr 02 21:06:55.705203 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2260/4202] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:55 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:55.829744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:55.840974 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37175157-c89f-4ac1-80d3-2daa6f40eb13 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1589 microversion: 2.1 time: 0.476005 Apr 02 21:06:55.843752 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1943/4203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:06:55 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1589 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:06:55.937288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e78c348e-9e1e-406c-ac98-b6336c1f7c00 req-53e1bff9-b630-4e29-8486-e774bfac9e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d56e21-a208-414f-8764-6698a043fac9", "tag": "af08ef28-22d4-4530-afd8-560f19818230"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:55.951011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e78c348e-9e1e-406c-ac98-b6336c1f7c00 req-53e1bff9-b630-4e29-8486-e774bfac9e5a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:55.951415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e78c348e-9e1e-406c-ac98-b6336c1f7c00 req-53e1bff9-b630-4e29-8486-e774bfac9e5a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:55.992895 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e78c348e-9e1e-406c-ac98-b6336c1f7c00 req-53e1bff9-b630-4e29-8486-e774bfac9e5a service nova] Creating event network-changed:af08ef28-22d4-4530-afd8-560f19818230 for instance 99d56e21-a208-414f-8764-6698a043fac9 on nch2-master-1 Apr 02 21:06:56.001799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e78c348e-9e1e-406c-ac98-b6336c1f7c00 req-53e1bff9-b630-4e29-8486-e774bfac9e5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295029 Apr 02 21:06:56.003210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2261/4204] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:06:56.724023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:56.724936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:56.734104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:56.735095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:56.736164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:56.737520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:57.629033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:57.657318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:57.665686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:57.668347 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f407cd83-2196-41de-bd7e-5952d52a81ad tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.948852 Apr 02 21:06:57.681740 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1944/4205] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:56 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:58.179539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1293981818", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "8ca290df-4a62-423c-b150-fa9a6e2d5d52"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:06:58.265274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] validate_networks() for [('8ca290df-4a62-423c-b150-fa9a6e2d5d52', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:06:58.691212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:58.692846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:58.707245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:58.708671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:58.710023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:58.711729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:58.997667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:06:58.999267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:06:59.000103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:06:59.000566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:06:59.003871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:06:59.021292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:59.021872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:59.022910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:06:59.023814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:06:59.046439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Getting quotas for project 6a2dc7aaed2f489fa941c447aa5e3aa7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:06:59.053301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Getting quotas for user d20c714151f14238a665d9760bec1d66 and project 6a2dc7aaed2f489fa941c447aa5e3aa7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:06:59.066090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:59.069842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:06:59.075706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:06:59.078949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:59.082980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:59.085846 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c95487a0-adc7-4e72-a30b-e53a4f8d0132 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.400275 Apr 02 21:06:59.087092 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1945/4206] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:58 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:06:59.150943 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42d86c10-88e3-487b-a7ba-0261e0f65b1a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.043611 Apr 02 21:06:59.152374 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2262/4207] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 21:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 21:06:59.163298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dcca3490-7813-4dd1-bb51-62ea6f1a8c93 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:06:59.165254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dcca3490-7813-4dd1-bb51-62ea6f1a8c93 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:06:59.279131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dcca3490-7813-4dd1-bb51-62ea6f1a8c93 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:59.292040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dcca3490-7813-4dd1-bb51-62ea6f1a8c93 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:59.295110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dcca3490-7813-4dd1-bb51-62ea6f1a8c93 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:06:59.296738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dcca3490-7813-4dd1-bb51-62ea6f1a8c93 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1259 microversion: 2.21 time: 0.138142 Apr 02 21:06:59.309780 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1946/4208] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:06:59 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:00.107403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:00.108246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:00.121655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:00.122660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:00.123800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:00.124616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:00.318523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:00.319857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:00.328154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:00.328658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:00.329452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:00.330087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:00.414598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:00.426233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:00.428955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:00.431323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57e41e7c-97b4-4f28-9100-a717a053b4ce tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1311 microversion: 2.21 time: 0.119678 Apr 02 21:07:00.432509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1947/4209] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:00 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:00.798362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:00.817099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:00.822434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:00.824401 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-24223ded-7043-4eee-b86f-63f4d46e8255 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.722085 Apr 02 21:07:00.837550 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2263/4210] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:00 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:01.451072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:01.452411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:01.468750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:01.469636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:01.471184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:01.471827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:01.577351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:01.592139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:01.598815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:01.604537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-15c8e24c-ac76-4f8c-97b0-162909274321 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1317 microversion: 2.21 time: 0.153377 Apr 02 21:07:01.605908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1948/4211] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:01 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:01.844612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:01.845417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:01.864699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:01.867329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:01.871272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:01.871896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:02.624205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:02.625038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:02.632347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:02.632997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:02.634011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:02.634613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:02.791027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:02.799311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:02.800558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:02.802197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:02.803631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f49cddf-0432-4563-a7c6-b138c67deb6c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.183691 Apr 02 21:07:02.804934 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1949/4212] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:02 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:02.812337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:02.814080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:02.815737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ac9f378-1082-494d-94c3-1ede0a170197 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.975279 Apr 02 21:07:02.816691 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2264/4213] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:01 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:03.828223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:03.838877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:03.841889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:03.847240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:03.856841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:03.859263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:03.861966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:03.863180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:03.863687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:03.864141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:03.864649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:03.866519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:04.254636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:04.264897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:04.268585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:04.270253 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-94e041a7-9bb1-44e9-842a-8ab28472c8b4 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.450636 Apr 02 21:07:04.271017 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1950/4214] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:03 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:04.277619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-396166ab-b95a-41d1-8387-fdd262e71964 req-bd5570e3-8de0-43ff-b985-34c5c5984750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eabcc63b-6b4b-4e0a-99aa-df1c2ab52782", "tag": "ed32f0ab-8993-4f30-99a6-612178a0337c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:04.293750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-396166ab-b95a-41d1-8387-fdd262e71964 req-bd5570e3-8de0-43ff-b985-34c5c5984750 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:04.294419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-396166ab-b95a-41d1-8387-fdd262e71964 req-bd5570e3-8de0-43ff-b985-34c5c5984750 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:04.309079 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-396166ab-b95a-41d1-8387-fdd262e71964 req-bd5570e3-8de0-43ff-b985-34c5c5984750 service nova] Creating event network-changed:ed32f0ab-8993-4f30-99a6-612178a0337c for instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 on nch1-master-1 Apr 02 21:07:04.314339 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-396166ab-b95a-41d1-8387-fdd262e71964 req-bd5570e3-8de0-43ff-b985-34c5c5984750 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041696 Apr 02 21:07:04.315512 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1951/4215] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:04.332183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:04.341919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:04.343045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:04.344415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43b3bca7-d57a-413d-a0a7-ece4d3deeca6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.512108 Apr 02 21:07:04.345270 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2265/4216] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:03 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:05.298111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:05.299572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:05.306580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:05.307187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:05.308189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:05.308788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:05.363350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:05.364013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:05.371047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:05.371506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:05.373178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:05.373628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:05.576433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:05.586111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:05.587656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:05.588866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-20912885-0bbb-4bf8-b01d-a1f1c1077cbe tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.229509 Apr 02 21:07:05.589446 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2266/4217] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:05 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:05.643673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:05.652320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:05.653891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:05.655040 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-14900cc8-5f9c-402f-97e6-6cdf8ee91d9c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.362477 Apr 02 21:07:05.655615 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1952/4218] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:05 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:06.608064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:06.608881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:06.615814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:06.616614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:06.618416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:06.619349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:06.673093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:06.673870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:06.685086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:06.685637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:06.686490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:06.686937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:06.839565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:06.849998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:06.852424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:06.853944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48f9d950-df89-4ab1-a727-cb0fe565dc2c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.250023 Apr 02 21:07:06.854522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2267/4219] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:06 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:06.956888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:06.966314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:06.967971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:06.969163 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c2c8a4e-b42b-424a-9f77-402a6a292ee6 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.300048 Apr 02 21:07:06.969732 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1953/4220] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:06 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:07.881600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:07.883975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:07.901637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:07.909939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:07.911424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:07.912338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:07.988005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:07.988786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:07.998764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:08.001883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:08.003183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:08.003694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:08.182777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:08.194233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:08.196728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:08.198126 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d0fef6a-e871-4ee0-8687-f8e536c71e86 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.214431 Apr 02 21:07:08.198883 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1954/4221] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:07 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:08.277647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:08.289764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:08.291927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:08.293860 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a762ab73-3882-4f34-81cd-1c8f472469dd tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.420218 Apr 02 21:07:08.295032 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2268/4222] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:07 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:09.216909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:09.217587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:09.229286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:09.231166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:09.232437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:09.233115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:09.313363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:09.315355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:09.323022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:09.323488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:09.324327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:09.325104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:09.541534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:09.546946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:09.557344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:09.559111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:09.560537 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29011602-8461-4c83-8e51-3e25bf2d2075 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.251262 Apr 02 21:07:09.561566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:09.563921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:09.570775 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1479e802-5eea-4733-97c3-1ec0673bb464 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.357883 Apr 02 21:07:09.572703 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1955/4223] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:09 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:09.573600 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2269/4224] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:09 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:09.581995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e84bfe34-f9b2-4665-8b3f-ab8bd1ccf4b6 req-188757f5-7236-41ee-aebf-8f911323af43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:09.591727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e84bfe34-f9b2-4665-8b3f-ab8bd1ccf4b6 req-188757f5-7236-41ee-aebf-8f911323af43 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:09.592779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e84bfe34-f9b2-4665-8b3f-ab8bd1ccf4b6 req-188757f5-7236-41ee-aebf-8f911323af43 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:09.609057 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e84bfe34-f9b2-4665-8b3f-ab8bd1ccf4b6 req-188757f5-7236-41ee-aebf-8f911323af43 service nova] Creating event network-vif-plugged:5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:09.614691 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e84bfe34-f9b2-4665-8b3f-ab8bd1ccf4b6 req-188757f5-7236-41ee-aebf-8f911323af43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039051 Apr 02 21:07:09.615314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1956/4225] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:10.580942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:10.582159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:10.590168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:10.590728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:10.590852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:10.591386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:10.592008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:10.593052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:10.602234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:10.603136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:10.604363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:10.605294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:10.802772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:10.812182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:10.814073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:10.816334 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-73d5c716-3bad-428a-860a-d7e19b3cd1a0 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.230623 Apr 02 21:07:10.817652 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1957/4226] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:10 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:10.915830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:10.925394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:10.926964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:10.928146 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c80c4916-9d1d-4424-a05e-786b7859faf9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.352308 Apr 02 21:07:10.928703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2270/4227] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:10 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:11.634625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-47aa7852-9bc5-41cb-9474-e203d8595d87 req-2907b05a-e11c-4ccd-80c0-16c4e9adb822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "a1133854-4680-4b8a-a3a0-c552bb06f10b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:11.643536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-47aa7852-9bc5-41cb-9474-e203d8595d87 req-2907b05a-e11c-4ccd-80c0-16c4e9adb822 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:11.644065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-47aa7852-9bc5-41cb-9474-e203d8595d87 req-2907b05a-e11c-4ccd-80c0-16c4e9adb822 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:11.658797 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-47aa7852-9bc5-41cb-9474-e203d8595d87 req-2907b05a-e11c-4ccd-80c0-16c4e9adb822 service nova] Creating event network-vif-plugged:a1133854-4680-4b8a-a3a0-c552bb06f10b for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:11.664011 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-47aa7852-9bc5-41cb-9474-e203d8595d87 req-2907b05a-e11c-4ccd-80c0-16c4e9adb822 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Apr 02 21:07:11.664657 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1958/4228] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:11.836272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:11.836993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:11.843746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:11.844200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:11.845015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:11.845455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:11.948885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:11.949981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:11.956703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:11.957402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:11.958246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:11.958696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:12.013607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:12.022831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:12.024393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:12.025623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77bcd19b-b7ed-432b-aa39-f5f0ef935767 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.194560 Apr 02 21:07:12.026246 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2271/4229] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:11 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:12.174181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:12.184230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:12.186370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:12.187595 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f2fda5ff-b23a-48ba-88eb-39f3bef1197c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.244150 Apr 02 21:07:12.188352 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1959/4230] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:11 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:13.046587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:13.046587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:13.053199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.053729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.054803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.055372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.207465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:13.208800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:13.214333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.217168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.217900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.218962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.219983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.225452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.228483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.229885 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-811575f2-128c-4d95-a68d-64775fab780d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.189430 Apr 02 21:07:13.232850 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2272/4231] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:13 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:13.426047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.436478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.438238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.439510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a2af7f0-9b8b-473e-adc7-2b581871fd62 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.236067 Apr 02 21:07:13.440388 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1960/4232] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:13 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:13.538110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:13.539835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:13.546167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.546565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.547351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.547801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.582013 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d003b276-e3ab-417d-8f91-78ee0b23e9cc tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047823 Apr 02 21:07:13.588658 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2273/4233] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Apr 2 21:07:13 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:13.646308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:13.647195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:13.654772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.655354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.656418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.657154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.682016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5b6c1fa9-e58b-4940-830b-e31bc7d2445b req-6874d58b-c3ce-47ab-96b0-3f69e8ee6003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "10107d8d-9752-412f-8706-611605cd57c7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:13.686057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:13.691613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5b6c1fa9-e58b-4940-830b-e31bc7d2445b req-6874d58b-c3ce-47ab-96b0-3f69e8ee6003 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.692535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5b6c1fa9-e58b-4940-830b-e31bc7d2445b req-6874d58b-c3ce-47ab-96b0-3f69e8ee6003 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.711579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5b6c1fa9-e58b-4940-830b-e31bc7d2445b req-6874d58b-c3ce-47ab-96b0-3f69e8ee6003 service nova] Creating event network-vif-plugged:10107d8d-9752-412f-8706-611605cd57c7 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:13.717770 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5b6c1fa9-e58b-4940-830b-e31bc7d2445b req-6874d58b-c3ce-47ab-96b0-3f69e8ee6003 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040691 Apr 02 21:07:13.718481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2274/4234] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:07:13.793838 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42aa9abc-9c7d-46e3-b189-b4115b1e7e4b tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 204 len: 0 microversion: 2.20 time: 0.151843 Apr 02 21:07:13.794647 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1961/4235] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:07:13 2022] DELETE /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:07:13.805319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:13.806309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:13.813662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.814118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.815173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:13.815619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:13.973826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.982610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.984207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:13.985652 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f57e8884-3379-4785-aad9-990f728ba808 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.185889 Apr 02 21:07:13.986301 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2275/4236] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:13 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:14.249555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:14.250272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:14.258057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:14.258551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:14.259352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:14.259803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:14.411075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:14.420094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:14.422021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:14.423375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b6d8f09-afe7-4c27-ab87-42b72709f2c2 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.178128 Apr 02 21:07:14.424433 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1962/4237] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:14 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:14.460582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:14.461198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:14.468204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:14.468709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:14.469484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:14.469977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:14.669815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:14.679601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:14.681439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:14.682623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c280c4e4-5fe6-4235-82a9-331d59ab729a tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.225971 Apr 02 21:07:14.683195 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2276/4238] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:14 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:15.005249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:15.006198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:15.013217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.013683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.014654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.015208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.188041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:15.206112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:15.209733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:15.213685 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d657bcd5-4048-4fcf-9da2-7a22f97704b9 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.212395 Apr 02 21:07:15.215285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1963/4239] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:14 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:15.441892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:15.442964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:15.450089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.450973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.451991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.452679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.704866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:15.705497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:15.713250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.714609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.715484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.716250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.756662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:15.774128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:15.779217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:15.779486 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56b20661-bb4a-46d0-b463-63ad1ff704b7 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.341440 Apr 02 21:07:15.780777 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2277/4240] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:15 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:15.788374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f9eb419e-c9ed-4c90-a2f3-2f74f166a03e req-bc301623-abfb-4f0b-883e-6e06d8ad6aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "7ae013e3-926a-45ea-aa70-0539b27a910a"}, {"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "f2e2e42a-9a29-4609-a3e3-c32b9a7d602b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:15.797584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f9eb419e-c9ed-4c90-a2f3-2f74f166a03e req-bc301623-abfb-4f0b-883e-6e06d8ad6aff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:15.798743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f9eb419e-c9ed-4c90-a2f3-2f74f166a03e req-bc301623-abfb-4f0b-883e-6e06d8ad6aff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:15.815671 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f9eb419e-c9ed-4c90-a2f3-2f74f166a03e req-bc301623-abfb-4f0b-883e-6e06d8ad6aff service nova] Creating event network-vif-plugged:7ae013e3-926a-45ea-aa70-0539b27a910a for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:15.816578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f9eb419e-c9ed-4c90-a2f3-2f74f166a03e req-bc301623-abfb-4f0b-883e-6e06d8ad6aff service nova] Creating event network-vif-plugged:f2e2e42a-9a29-4609-a3e3-c32b9a7d602b for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:15.824392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f9eb419e-c9ed-4c90-a2f3-2f74f166a03e req-bc301623-abfb-4f0b-883e-6e06d8ad6aff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041358 Apr 02 21:07:15.825951 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2278/4241] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:16.049099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.060821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.062707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.064122 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-474476da-dfe4-4f35-8d44-68da13046b04 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.364891 Apr 02 21:07:16.065250 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1964/4242] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:15 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:16.240489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:16.241670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:16.249228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:16.249809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:16.251089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:16.251879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:16.633597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.652660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.655852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eaa8ffe0235f4759bdb071a51ad51410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4f1507b69e40c8ace9eac029f1ced2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.657873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79b8397b-0024-45f3-b856-4427ac6dc68d tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 200 len: 1723 microversion: 2.20 time: 0.421717 Apr 02 21:07:16.658620 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2279/4243] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:16 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:16.799225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:16.800037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:16.816470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:16.817330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:16.818484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:16.818989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:16.983627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.992616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.994638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:16.997128 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b118f5d-7e97-4826-8ba4-f0bae0330ed1 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.201643 Apr 02 21:07:16.998150 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1965/4244] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:16 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:17.091058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:17.091916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:17.098364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:17.098838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:17.099652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:17.100095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:17.117256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-21d8d3ba-64a5-48d0-ac0e-342506698225 req-cda8c59a-2e65-407f-91ed-f10d1ccdd632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945e2822-5cfd-4165-9cf4-3d1f493dea62", "name": "network-vif-deleted", "tag": "9c6822bb-be50-4c34-94cb-f822e9b46f02"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:17.138613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-21d8d3ba-64a5-48d0-ac0e-342506698225 req-cda8c59a-2e65-407f-91ed-f10d1ccdd632 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:17.142350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-21d8d3ba-64a5-48d0-ac0e-342506698225 req-cda8c59a-2e65-407f-91ed-f10d1ccdd632 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:17.178431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-21d8d3ba-64a5-48d0-ac0e-342506698225 req-cda8c59a-2e65-407f-91ed-f10d1ccdd632 service nova] Creating event network-vif-deleted:9c6822bb-be50-4c34-94cb-f822e9b46f02 for instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 on nch1-master-1 Apr 02 21:07:17.198120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-21d8d3ba-64a5-48d0-ac0e-342506698225 req-cda8c59a-2e65-407f-91ed-f10d1ccdd632 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085533 Apr 02 21:07:17.199275 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1966/4245] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:17.398566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:17.411564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:17.414102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:17.415376 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90ea8e45-70c6-46e4-b336-1ed5196d3faf tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.331906 Apr 02 21:07:17.416214 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2280/4246] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:17 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:17.680338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:17.681491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:17.693237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:17.695156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:17.697069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:17.698453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:17.720249 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] HTTP exception thrown: Instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 could not be found. Apr 02 21:07:17.721230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Returning 404 to user: Instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:17.722567 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0243a204-9f4b-43d5-a9fd-8c0884c6bf93 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 404 len: 111 microversion: 2.20 time: 0.048233 Apr 02 21:07:17.727860 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1967/4247] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:17 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:17.734971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3063431-da1b-4106-b7cc-427d5fb49245 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '.version_select at 0x7f54c7db5550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:17.756632 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3063431-da1b-4106-b7cc-427d5fb49245 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-593430120" status: 204 len: 0 microversion: 2.20 time: 0.026634 Apr 02 21:07:17.757687 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2281/4248] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Apr 2 21:07:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-593430120 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:07:17.859171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eabcc63b-6b4b-4e0a-99aa-df1c2ab52782", "name": "network-vif-plugged", "status": "completed", "tag": "ed32f0ab-8993-4f30-99a6-612178a0337c"}, {"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "da097fe9-f79d-4d6d-8d6c-d413f8913252"}, {"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-plugged", "status": "completed", "tag": "bf93e761-9d1c-42fd-90a1-2b5196433096"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:17.878029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:17.878819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:17.899432 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] Creating event network-vif-plugged:ed32f0ab-8993-4f30-99a6-612178a0337c for instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 on nch1-master-1 Apr 02 21:07:17.900283 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] Creating event network-vif-plugged:da097fe9-f79d-4d6d-8d6c-d413f8913252 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:17.901621 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] Creating event network-vif-plugged:bf93e761-9d1c-42fd-90a1-2b5196433096 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:17.911740 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e62249f7-c876-4304-bdf5-1d371012e4ff req-c582ddc7-dda9-4870-baa2-038f276b0e39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.057623 Apr 02 21:07:17.912796 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1968/4249] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:18.017653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:18.018503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:18.031749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:18.032202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:18.033991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:18.034495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:18.369984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:18.395495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:18.397549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:18.400392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-522329aa-fc7c-4945-8614-9eb90519af44 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.387216 Apr 02 21:07:18.401170 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2282/4250] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:18 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:18.434928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:18.435639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:18.449262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:18.449920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:18.450940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:18.452030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:18.724941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:18.736190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:18.737906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:18.739382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee4ef635-7cf9-47b0-9e8a-f68641b60c8d tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.309055 Apr 02 21:07:18.740171 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1969/4251] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:18 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:19.420417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:19.421134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:19.430510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:19.431112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:19.432536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:19.433261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:19.596001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:19.607972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:19.609712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:19.610872 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09d29ad9-a2c6-483b-baf5-8bcc7cc8075d tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1359 microversion: 2.21 time: 0.195140 Apr 02 21:07:19.611703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2283/4252] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:19 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:19.760140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:19.760790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:19.769508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:19.769965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:19.770941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:19.771382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:19.984791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:19.997051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:19.999465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:20.001420 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb72f943-bcd9-464d-9386-295a5482f5d7 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1878 microversion: 2.42 time: 0.245803 Apr 02 21:07:20.002288 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1970/4253] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:19 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1878 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:20.008632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:20.009311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:20.017378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.017885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.018869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.019315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.036582 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] HTTP exception thrown: Instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 could not be found. Apr 02 21:07:20.037245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Returning 404 to user: Instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:20.038098 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2b52934-e337-42b5-9884-6815c0b3b032 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 404 len: 111 microversion: 2.20 time: 0.034300 Apr 02 21:07:20.039032 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2284/4254] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:07:20 2022] DELETE /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:20.047418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:20.048102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: 945e2822-5cfd-4165-9cf4-3d1f493dea62] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:20.054442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.055105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.056252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.056716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.072348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] HTTP exception thrown: Instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 could not be found. Apr 02 21:07:20.073094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Returning 404 to user: Instance 945e2822-5cfd-4165-9cf4-3d1f493dea62 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:20.074120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04cae014-1cea-4cd1-9d1c-460d92e0b056 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62" status: 404 len: 111 microversion: 2.20 time: 0.030643 Apr 02 21:07:20.074693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1971/4255] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:20 2022] GET /compute/v2.1/servers/945e2822-5cfd-4165-9cf4-3d1f493dea62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:20.629744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:20.630547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:20.638738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.639656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.640795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.641260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.817644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:20.826478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:20.828180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:20.829355 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85ab1102-1f83-4d7a-ba1d-01239519a374 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1552 microversion: 2.21 time: 0.204691 Apr 02 21:07:20.829913 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2285/4256] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:20 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:20.847992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:20.848864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:20.856495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.857026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.857907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.858447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.884073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:20.975286 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ea8fd626-b4ee-4ded-ac3a-f65492b2729c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 204 len: 0 microversion: 2.21 time: 0.131872 Apr 02 21:07:20.976898 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1972/4257] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:07:20 2022] DELETE /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:07:20.985317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:20.985964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:20.992314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.992827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:20.998399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:20.998399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.023709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:21.024515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:21.031345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.032088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.033276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.033848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.178880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:21.197121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:21.199420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:21.200626 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f9568ec-7698-424d-8399-74ef6269d4e3 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1558 microversion: 2.21 time: 0.219387 Apr 02 21:07:21.210805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2286/4258] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:20 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:21.233763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:21.234325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:21.241045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.241740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.242740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.243379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.257801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] HTTP exception thrown: Instance a9e92f68-549b-4c9e-bbf9-803500a77d9c could not be found. Apr 02 21:07:21.258416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Returning 404 to user: Instance a9e92f68-549b-4c9e-bbf9-803500a77d9c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:21.259273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ccccbe4-f073-4377-bcf2-804932302d8e tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 404 len: 111 microversion: 2.20 time: 0.031722 Apr 02 21:07:21.260900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2287/4259] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:07:21 2022] DELETE /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:07:21.269559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:21.270358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] [instance: a9e92f68-549b-4c9e-bbf9-803500a77d9c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:21.271009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:21.277633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.278153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.278934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.279408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.280732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:21.282530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:21.283793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ea569ae-3c3b-4e35-8623-7721a0d70663 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2836 microversion: 2.42 time: 0.266786 Apr 02 21:07:21.284771 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1973/4260] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:21 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2836 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:21.295165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] HTTP exception thrown: Instance a9e92f68-549b-4c9e-bbf9-803500a77d9c could not be found. Apr 02 21:07:21.296307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] Returning 404 to user: Instance a9e92f68-549b-4c9e-bbf9-803500a77d9c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:21.297258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26179e89-2b34-442d-b91f-c6d0a3a98802 tempest-AttachVolumeShelveTestJSON-1397899499 tempest-AttachVolumeShelveTestJSON-1397899499-project] 10.222.0.18 "GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c" status: 404 len: 111 microversion: 2.20 time: 0.033444 Apr 02 21:07:21.297940 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2288/4261] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:21 2022] GET /compute/v2.1/servers/a9e92f68-549b-4c9e-bbf9-803500a77d9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:07:21.308325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:21.308957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:21.316392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.317090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.317756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:21.318238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:21.462363 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3997aec7-c4a8-4b15-ab23-4f630cd9736c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.158405 Apr 02 21:07:21.463021 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1974/4262] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Apr 2 21:07:21 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746/os-interface => generated 1831 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:22.223249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:22.223927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:22.235080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:22.237757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:22.239278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:22.239766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:22.537468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:22.552506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:22.557634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:22.560241 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a26c429f-dc31-49f9-be9b-dc95826abb4b tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1558 microversion: 2.21 time: 0.341759 Apr 02 21:07:22.562580 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2289/4263] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:22 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1558 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:23.299118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b8eb5a0a-038d-492c-8ae1-5130060ec996 req-98815fe6-40e9-45e6-9ea2-ae798e5168dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "tag": "5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:23.309721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b8eb5a0a-038d-492c-8ae1-5130060ec996 req-98815fe6-40e9-45e6-9ea2-ae798e5168dd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:23.310689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b8eb5a0a-038d-492c-8ae1-5130060ec996 req-98815fe6-40e9-45e6-9ea2-ae798e5168dd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:23.325201 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b8eb5a0a-038d-492c-8ae1-5130060ec996 req-98815fe6-40e9-45e6-9ea2-ae798e5168dd service nova] Creating event network-changed:5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:07:23.332673 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b8eb5a0a-038d-492c-8ae1-5130060ec996 req-98815fe6-40e9-45e6-9ea2-ae798e5168dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038385 Apr 02 21:07:23.334029 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1975/4264] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:23.581207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:23.581785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:23.597968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:23.598425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:23.602399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:23.602989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:23.750102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:23.759453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:23.761512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd20c714151f14238a665d9760bec1d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2dc7aaed2f489fa941c447aa5e3aa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:23.762787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c77a916d-20e8-4f28-ab95-d33e68c0861a tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 200 len: 1344 microversion: 2.21 time: 0.185808 Apr 02 21:07:23.763574 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2290/4265] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:23 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 1344 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:24.783965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:24.785440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:24.802522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:24.805179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:24.806447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:24.806995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:24.834848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] HTTP exception thrown: Instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 could not be found. Apr 02 21:07:24.836878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Returning 404 to user: Instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:24.837975 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a08c6312-3948-4ff1-a76d-7f200f2af07c tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 404 len: 111 microversion: 2.21 time: 0.059673 Apr 02 21:07:24.839074 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1976/4266] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:24 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:24.849379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '.version_select at 0x7f54c7db5b80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:24.849973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:24.859363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:24.859829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:24.860721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:24.861210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:24.984616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-952f6c68-0fd4-427c-bf1c-26bae25fe454 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.137972 Apr 02 21:07:24.985825 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2291/4267] 10.222.0.18 () {60 vars in 1336 bytes} [Sat Apr 2 21:07:24 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782/os-instance-actions => generated 611 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:07:24.999636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:25.000704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:25.012080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:25.012585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:25.013397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:25.013851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:25.028303 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] HTTP exception thrown: Instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 could not be found. Apr 02 21:07:25.029347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Returning 404 to user: Instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:25.030402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d5057076-e02a-4fdd-b46a-c89babd3ca99 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 404 len: 111 microversion: 2.21 time: 0.035297 Apr 02 21:07:25.031496 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1977/4268] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:07:24 2022] DELETE /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:25.044800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:25.045701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] [instance: eabcc63b-6b4b-4e0a-99aa-df1c2ab52782] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:25.054356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:25.055108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:25.056078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:25.056918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:25.073645 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] HTTP exception thrown: Instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 could not be found. Apr 02 21:07:25.074554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] Returning 404 to user: Instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:25.075590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-184f08a2-f20d-49f5-b182-699e23d07882 tempest-InstanceActionsV221TestJSON-870810846 tempest-InstanceActionsV221TestJSON-870810846-project] 10.222.0.18 "GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782" status: 404 len: 111 microversion: 2.21 time: 0.040063 Apr 02 21:07:25.076900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2292/4269] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:25 2022] GET /compute/v2.1/servers/eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:25.374611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0f91b941-8449-4c46-95d1-0c8261e2eaca req-8f00c000-59d1-4348-adc5-7791546ec275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eabcc63b-6b4b-4e0a-99aa-df1c2ab52782", "name": "network-vif-deleted", "tag": "ed32f0ab-8993-4f30-99a6-612178a0337c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:25.388079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f91b941-8449-4c46-95d1-0c8261e2eaca req-8f00c000-59d1-4348-adc5-7791546ec275 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:25.388944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f91b941-8449-4c46-95d1-0c8261e2eaca req-8f00c000-59d1-4348-adc5-7791546ec275 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:25.403715 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0f91b941-8449-4c46-95d1-0c8261e2eaca req-8f00c000-59d1-4348-adc5-7791546ec275 service nova] Creating event network-vif-deleted:ed32f0ab-8993-4f30-99a6-612178a0337c for instance eabcc63b-6b4b-4e0a-99aa-df1c2ab52782 on nch1-master-1 Apr 02 21:07:25.409036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0f91b941-8449-4c46-95d1-0c8261e2eaca req-8f00c000-59d1-4348-adc5-7791546ec275 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048356 Apr 02 21:07:25.410158 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1978/4270] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:27.783789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-647f7aeb-5065-4b78-8d10-1a3a35fd1306 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-139463027", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:27.785890 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-647f7aeb-5065-4b78-8d10-1a3a35fd1306 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] HTTP exception thrown: min_count must be <= max_count Apr 02 21:07:27.786608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-647f7aeb-5065-4b78-8d10-1a3a35fd1306 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Returning 400 to user: min_count must be <= max_count {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:27.787352 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-647f7aeb-5065-4b78-8d10-1a3a35fd1306 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.253645 Apr 02 21:07:27.787928 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2293/4271] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:27 2022] POST /compute/v2.1/servers => generated 74 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 02 21:07:27.907279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-926cb3a5-1f99-44b6-b007-f92749a999e5 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-567562887", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "max_count": 0}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:27.909153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-926cb3a5-1f99-44b6-b007-f92749a999e5 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:27.909992 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-926cb3a5-1f99-44b6-b007-f92749a999e5 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007951 Apr 02 21:07:27.920508 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1979/4272] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:27 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:27.968804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a22d0845-06b0-45ae-bb21-233a20df7d0a tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1811690092", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "max_count": 2.5}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:27.971096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a22d0845-06b0-45ae-bb21-233a20df7d0a tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:27.972156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a22d0845-06b0-45ae-bb21-233a20df7d0a tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007190 Apr 02 21:07:27.973054 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2294/4273] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:28.023351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf3e7114-1c03-433b-983d-00c293f3b7cc tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2060665445", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 0}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:28.024796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf3e7114-1c03-433b-983d-00c293f3b7cc tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:28.026256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf3e7114-1c03-433b-983d-00c293f3b7cc tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007087 Apr 02 21:07:28.026995 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1980/4274] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:28 2022] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:28.125298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7dcd2094-f0db-4696-95b4-1bf2c258d014 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1727502280", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 2.5}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:28.126677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7dcd2094-f0db-4696-95b4-1bf2c258d014 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:28.127647 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7dcd2094-f0db-4696-95b4-1bf2c258d014 tempest-MultipleCreateNegativeTestJSON-60912702 tempest-MultipleCreateNegativeTestJSON-60912702-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006334 Apr 02 21:07:28.128310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2295/4275] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:28 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:07:28.754866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1362309296", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "91357282-db19-46d5-9ae6-53ef880c5451"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:28.826289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] validate_networks() for [('91357282-db19-46d5-9ae6-53ef880c5451', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:07:29.294725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:07:29.295339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:07:29.295843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:07:29.300334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:07:29.300334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:07:29.308741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:29.309212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:29.310451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:29.311271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:29.335465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Getting quotas for project f54b2160309b4d76bd7a944454903520. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:29.341847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Getting quotas for user d12e43a0a2994654a400b3a2bed83ecf and project f54b2160309b4d76bd7a944454903520. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:29.359980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:07:29.363332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:07:29.443449 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0aeaa24-5ffc-4e24-a8c8-b04b9dbdb70e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692965 Apr 02 21:07:29.447342 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1981/4276] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:07:29.460980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd978ab6-fdfc-48ea-a253-0063d433f7b2 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:29.462835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd978ab6-fdfc-48ea-a253-0063d433f7b2 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:29.544662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd978ab6-fdfc-48ea-a253-0063d433f7b2 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:29.552988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd978ab6-fdfc-48ea-a253-0063d433f7b2 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1214 microversion: 2.1 time: 0.099061 Apr 02 21:07:29.553761 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2296/4277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:29 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:30.349093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:30.353030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:30.353805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Searching by: {'deleted': False, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:07:30.360305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.361003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.362017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.362460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.390712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:07:30.430813 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8bc5302c-4428-4224-a674-cd7714fb231d tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.085142 Apr 02 21:07:30.431865 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1982/4278] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:07:30 2022] GET /compute/v2.1/servers => generated 340 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:30.452141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:30.452141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:30.452141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Searching by: {'deleted': False, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:07:30.454518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.456774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.457804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.458496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.489286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:07:30.529925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:30.537402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.538227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.571268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:30.572563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:30.584123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.585385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.586304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:30.588584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:30.667158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:30.678608 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f2ee142-6de8-4bb4-a0b3-016522203f31 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1274 microversion: 2.1 time: 0.111573 Apr 02 21:07:30.679510 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1983/4279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:30 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:30.953714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-869ca4e0-2eaf-4546-a09d-0a44fd50e613 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.514185 Apr 02 21:07:30.954780 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2297/4280] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:07:30 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:30.971852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-235d2f4e-ff63-46e0-9b7e-1970e6e2e154 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:30.988900 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-235d2f4e-ff63-46e0-9b7e-1970e6e2e154 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014416 Apr 02 21:07:30.988900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2298/4281] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:07:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:31.001718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1987926865", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "1c78514a-2582-4ee4-9ef3-1ec78090f2ba"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:31.059031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] validate_networks() for [('1c78514a-2582-4ee4-9ef3-1ec78090f2ba', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:07:31.459370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:31.460917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:31.468105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.469134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.470314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.471116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.505788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:07:31.506335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:07:31.507273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:07:31.508163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:31.508829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:07:31.509995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:07:31.525926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.527577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.528817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.529343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.550257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Getting quotas for project 1b8620340d064cd98fd526e46e061d4f. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:31.557715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Getting quotas for user 140cc422fc5b40eaa3cd538fb9c05b7a and project 1b8620340d064cd98fd526e46e061d4f. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:31.575328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:07:31.578677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:07:31.639010 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa2acc50-8456-4e09-85e8-1eaae11f1786 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "DELETE /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 204 len: 0 microversion: 2.1 time: 0.190650 Apr 02 21:07:31.641047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0abc5f5a-ae9c-44d3-9067-3e7195dcf092 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817882 Apr 02 21:07:31.641974 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1984/4283] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:07:31.645232 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2299/4283] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:07:31 2022] DELETE /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:07:31.653013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:31.654456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:31.657290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8e17383-0a44-4cab-88e8-0381ad634b21 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:31.660356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8e17383-0a44-4cab-88e8-0381ad634b21 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:31.664056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.664814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.666316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.667211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.818217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8e17383-0a44-4cab-88e8-0381ad634b21 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:31.843085 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8e17383-0a44-4cab-88e8-0381ad634b21 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1217 microversion: 2.1 time: 0.181980 Apr 02 21:07:31.845132 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2300/4284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:31 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:31.860189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:31.860913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:31.879815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.880422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.881252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:31.882238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:31.909708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:31.918487 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cdb574a-5ee9-4d13-9e30-47cdf7e996bc tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1714 microversion: 2.1 time: 0.271736 Apr 02 21:07:31.921273 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1985/4285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:31 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1714 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:32.170958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:32.186920 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5de1d879-244f-4d35-b6ff-e1ddebb5e340 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.340140 Apr 02 21:07:32.189641 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2301/4286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:31 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:32.824609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8446c652-c0df-4c0b-87d2-def1c058252e req-4526dd4e-3302-42f2-a0b7-fd6a77799707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64af2333-6bd9-4659-b79a-3514e9b221ea", "tag": "20e18d45-4075-40d9-be5a-08ae7734d965"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:32.846709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8446c652-c0df-4c0b-87d2-def1c058252e req-4526dd4e-3302-42f2-a0b7-fd6a77799707 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:32.847816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8446c652-c0df-4c0b-87d2-def1c058252e req-4526dd4e-3302-42f2-a0b7-fd6a77799707 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:32.862052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:32.862830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:32.867642 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8446c652-c0df-4c0b-87d2-def1c058252e req-4526dd4e-3302-42f2-a0b7-fd6a77799707 service nova] Creating event network-changed:20e18d45-4075-40d9-be5a-08ae7734d965 for instance 64af2333-6bd9-4659-b79a-3514e9b221ea on nch1-master-1 Apr 02 21:07:32.875926 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8446c652-c0df-4c0b-87d2-def1c058252e req-4526dd4e-3302-42f2-a0b7-fd6a77799707 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057558 Apr 02 21:07:32.877289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:32.877758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:32.880314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1986/4287] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:32.880713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:32.881173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:32.938540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:32.939807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:32.946891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:32.947962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:32.949007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:32.949662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.004224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:33.013414 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d05fad5b-5efc-4c64-9bba-e9c524d20a73 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1269 microversion: 2.1 time: 0.156138 Apr 02 21:07:33.014827 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2302/4288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:32 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:33.208237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:33.209203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:33.218546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.219001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.219806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.220248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.248114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:33.260849 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-212245ae-fdc5-41d8-8d26-76cb5f8b1d25 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1714 microversion: 2.1 time: 0.326616 Apr 02 21:07:33.264438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1987/4289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:32 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1714 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:33.405229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:33.406770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:33.416969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.417743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.418805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.419492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.458806 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d06dcaab-9260-43f1-8b3c-d7004507a747 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df/ips" status: 200 len: 150 microversion: 2.1 time: 0.058094 Apr 02 21:07:33.460170 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1988/4290] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:07:33 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:33.472153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53932f9c-8a1a-44d4-851d-4805a7def1fe"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:33.473729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:33.481751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.482473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.483726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.484519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.586777 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Invalid volume: volume 53932f9c-8a1a-44d4-851d-4805a7def1fe is already attached to instances: 58df85ac-b402-424d-8354-fc927aad0d32 Apr 02 21:07:33.587753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 400 to user: Invalid volume: volume 53932f9c-8a1a-44d4-851d-4805a7def1fe is already attached to instances: 58df85ac-b402-424d-8354-fc927aad0d32 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:33.589009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5319a394-186c-4511-9bdc-a106bfe54e27 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121527 Apr 02 21:07:33.594465 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1989/4291] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:07:33 2022] POST /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:07:33.599766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:33.601600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:33.611617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.613084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.615193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.616163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.638793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:33.646939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9853dadf-2ed2-4aae-8e1f-d2c688711316 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.444202 Apr 02 21:07:33.657545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:33.658870 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2303/4292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:33 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:33.786865 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-936ba36a-ad10-4d4e-bfff-980ed938859a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 204 len: 0 microversion: 2.1 time: 0.190729 Apr 02 21:07:33.788532 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1990/4293] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:07:33 2022] DELETE /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:07:33.797697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:33.798637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:33.806285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.807115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:33.808687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:33.809320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:34.039799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:34.041423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:34.049229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:34.050099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:34.051170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:34.051804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:34.476540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:34.486911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4be4ad2e-b645-4ee4-a911-7733f5936933 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1679 microversion: 2.1 time: 0.694569 Apr 02 21:07:34.490308 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2304/4294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:33 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1679 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:34.510577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:34.516520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:34.523978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:34.524949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:34.526100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:34.526980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:34.997513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:35.011552 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d30a9a8-6d37-4c5d-b4af-2618b3aa3fc8 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1714 microversion: 2.1 time: 0.519094 Apr 02 21:07:35.013006 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2305/4295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:34 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1714 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:35.014970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:35.020427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:35.021722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:35.030473 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d861fbbe-a453-49fb-843a-5c67052c2f24 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 1.001097 Apr 02 21:07:35.031344 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1991/4296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:34 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:35.032305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:35.034651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:35.035637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:35.036241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:35.388386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:35.398115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8aa28fdf-733e-49c8-99f9-38da270cf29a tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.383301 Apr 02 21:07:35.398766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2306/4297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:35 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:35.507558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:35.508966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:35.521043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:35.521836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:35.527009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:35.528311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.032741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:36.034144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:36.045060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.046110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.047839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.050020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.095682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:36.143024 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0c2a628-9d14-4642-b808-7c68e6e901eb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1679 microversion: 2.1 time: 0.639651 Apr 02 21:07:36.146973 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1992/4298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:35 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1679 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:36.167821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:36.170890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:36.188949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.189914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.191010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.192962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.676146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c887a3020eb4d0fbf93b55a1aba87a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d575ad1b73d40c4a8a1c7e0455886ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:36.683994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f6be5263-6c08-420d-bc08-ab891530f354 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 200 len: 1647 microversion: 2.1 time: 0.657741 Apr 02 21:07:36.694963 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2307/4299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:36 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 1647 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:36.700413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1d368f52-f685-4d0d-bc9f-3e25fa8a8c35 req-4aed3a08-2e3e-42ae-bada-7678bad5477c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b7b03e-c24e-445c-9de6-41ddee02234a", "tag": "1037642c-cc06-421a-9a77-1773424ede8f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:36.708862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1d368f52-f685-4d0d-bc9f-3e25fa8a8c35 req-4aed3a08-2e3e-42ae-bada-7678bad5477c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.710231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1d368f52-f685-4d0d-bc9f-3e25fa8a8c35 req-4aed3a08-2e3e-42ae-bada-7678bad5477c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.718024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:36.725715 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dcc23a84-7567-48b2-8f05-b63aa22d5e30 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.564106 Apr 02 21:07:36.731798 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1d368f52-f685-4d0d-bc9f-3e25fa8a8c35 req-4aed3a08-2e3e-42ae-bada-7678bad5477c service nova] Creating event network-changed:1037642c-cc06-421a-9a77-1773424ede8f for instance 60b7b03e-c24e-445c-9de6-41ddee02234a on nch2-master-1 Apr 02 21:07:36.732705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1993/4300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:36 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:36.737616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ec7db207-33ec-4c62-8931-2b6f076ac105 req-41551154-0489-4472-b726-334c3afe4d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d56e21-a208-414f-8764-6698a043fac9", "name": "network-vif-deleted", "tag": "af08ef28-22d4-4530-afd8-560f19818230"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:36.745073 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1d368f52-f685-4d0d-bc9f-3e25fa8a8c35 req-4aed3a08-2e3e-42ae-bada-7678bad5477c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048294 Apr 02 21:07:36.745953 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2308/4301] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:36.751614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:36.752599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:36.757896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ec7db207-33ec-4c62-8931-2b6f076ac105 req-41551154-0489-4472-b726-334c3afe4d88 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.763580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.764320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.764544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ec7db207-33ec-4c62-8931-2b6f076ac105 req-41551154-0489-4472-b726-334c3afe4d88 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.765494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.766104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.781420 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ec7db207-33ec-4c62-8931-2b6f076ac105 req-41551154-0489-4472-b726-334c3afe4d88 service nova] Creating event network-vif-deleted:af08ef28-22d4-4530-afd8-560f19818230 for instance 99d56e21-a208-414f-8764-6698a043fac9 on nch2-master-1 Apr 02 21:07:36.814913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ec7db207-33ec-4c62-8931-2b6f076ac105 req-41551154-0489-4472-b726-334c3afe4d88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080436 Apr 02 21:07:36.817075 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1994/4302] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:36.829570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:36.830844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:36.841766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.842608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:36.843639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:36.844283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.234049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:37.244429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9102156-9d9e-45f9-a6a3-47fc57032a88 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.425750 Apr 02 21:07:37.261302 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1995/4303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:36 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:37.264226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:37.265072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:37.275247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.275767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.276603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.281865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.405114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:37.420737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:37.422292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:37.423570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0cad7364-2870-4d37-80b5-e3c400df0132 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2949 microversion: 2.32 time: 0.676380 Apr 02 21:07:37.424129 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2309/4304] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:07:36 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2949 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:07:37.463318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:37.464032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:37.474632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.475329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.478019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.480065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.832397 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f81a0c7c-c9d5-432e-bda4-88c9dd9565c3 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.373532 Apr 02 21:07:37.833238 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2310/4305] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Apr 2 21:07:37 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2/os-interface => generated 1830 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:07:37.850786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:37.853981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] [instance: 99d56e21-a208-414f-8764-6698a043fac9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:37.872662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.873285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.874924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.875392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.887566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:37.896218 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a52033a3-17a9-47b5-a3e6-f5a07c6a0667 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1613 microversion: 2.1 time: 0.643926 Apr 02 21:07:37.900931 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1996/4306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:37 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1613 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:37.915599 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] HTTP exception thrown: Instance 99d56e21-a208-414f-8764-6698a043fac9 could not be found. Apr 02 21:07:37.916265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Returning 404 to user: Instance 99d56e21-a208-414f-8764-6698a043fac9 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:37.916871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:37.917167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a52bf26-274b-43de-91f7-ca5ea2294888 tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9" status: 404 len: 111 microversion: 2.1 time: 0.072200 Apr 02 21:07:37.917504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:37.918026 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2311/4307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:37 2022] GET /compute/v2.1/servers/99d56e21-a208-414f-8764-6698a043fac9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:07:37.926211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.926676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.927468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:37.927914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:37.930707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2de53c0-c39d-4822-ac03-309ad306df4c tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] Calling method '.version_select at 0x7f54c7cdbb80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:37.967319 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2de53c0-c39d-4822-ac03-309ad306df4c tempest-ServersTestManualDisk-266801999 tempest-ServersTestManualDisk-266801999-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302907406" status: 202 len: 0 microversion: 2.1 time: 0.044048 Apr 02 21:07:37.969050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2312/4308] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:07:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302907406 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:07:38.271808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:38.272558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:38.285543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:38.286046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:38.293523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:38.293984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:38.442784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:38.453505 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-edf9a82f-becf-4975-bba3-b389a905ee77 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.550853 Apr 02 21:07:38.455177 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1997/4309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:37 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:38.749431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:38.757082 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ef07f07-0bad-473e-a1b7-6a2423200362 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.491364 Apr 02 21:07:38.760645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2313/4310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:38 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:38.806055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-aa044bc8-972c-4d8c-ad9b-7531f0e1fe59 req-b1b23dda-e672-4c9f-9655-1a4c2a5d36cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffaf327-24f7-4378-ae51-a4bd58d135df", "name": "network-vif-deleted", "tag": "19ccd802-b62f-4e90-8658-35f9abd17342"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:38.818590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-aa044bc8-972c-4d8c-ad9b-7531f0e1fe59 req-b1b23dda-e672-4c9f-9655-1a4c2a5d36cd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:38.819334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-aa044bc8-972c-4d8c-ad9b-7531f0e1fe59 req-b1b23dda-e672-4c9f-9655-1a4c2a5d36cd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:38.834699 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-aa044bc8-972c-4d8c-ad9b-7531f0e1fe59 req-b1b23dda-e672-4c9f-9655-1a4c2a5d36cd service nova] Creating event network-vif-deleted:19ccd802-b62f-4e90-8658-35f9abd17342 for instance 0ffaf327-24f7-4378-ae51-a4bd58d135df on nch1-master-1 Apr 02 21:07:38.858319 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-aa044bc8-972c-4d8c-ad9b-7531f0e1fe59 req-b1b23dda-e672-4c9f-9655-1a4c2a5d36cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056722 Apr 02 21:07:38.863548 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1998/4311] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:38.922158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:38.922777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:38.931098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:38.931554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:38.932342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:38.932809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:38.981757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:38.983148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:38.984511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lazy-loading 'fault' on Instance uuid 0ffaf327-24f7-4378-ae51-a4bd58d135df {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:07:39.076838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:39.089555 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46746feb-e599-49b2-a2f7-1637be1e6271 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 200 len: 1330 microversion: 2.1 time: 0.171330 Apr 02 21:07:39.093244 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2314/4312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:38 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 1330 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:39.477825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:39.478606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:39.492498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:39.493201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:39.494108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:39.494571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:39.780894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:39.783145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:39.794724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:39.795167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:39.795934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:39.796942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:40.003616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:40.018520 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69f7b925-77f8-403d-9785-f4d845827926 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.243864 Apr 02 21:07:40.030616 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2315/4313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:39 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:40.110655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:40.111317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:40.121216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:40.121962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:40.123316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:40.123942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:40.143748 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 0ffaf327-24f7-4378-ae51-a4bd58d135df could not be found. Apr 02 21:07:40.145197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 0ffaf327-24f7-4378-ae51-a4bd58d135df could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:40.148404 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-50ac10cb-4efc-4925-8ea7-00d1c9c98fca tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 404 len: 111 microversion: 2.1 time: 0.042432 Apr 02 21:07:40.153487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2316/4314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:40 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:07:40.163254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f0653df-443a-483a-8707-9857554eb460 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '.version_select at 0x7f54c7cb2790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:40.212965 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f0653df-443a-483a-8707-9857554eb460 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-426645117" status: 202 len: 0 microversion: 2.1 time: 0.058011 Apr 02 21:07:40.214007 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2317/4315] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:07:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-426645117 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:07:40.214579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:40.242317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0041f668-9275-49e2-a935-6a68cd9e4f8f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.773447 Apr 02 21:07:40.242942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 1999/4316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:39 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:41.038961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:41.040885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:41.062581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:41.063054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:41.071804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:41.072564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:41.261681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:41.262636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:41.280683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:41.284526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:41.286020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:41.286952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:41.540903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:41.541689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:41.549193 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81aaa798-5ebf-40cf-ae99-5d5862329b2c tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.293095 Apr 02 21:07:41.553559 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2000/4317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:41 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:41.566277 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5fd365df-4bf3-4e99-99bb-9b4db99c92ef tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.532814 Apr 02 21:07:41.566950 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2318/4318] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:41 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:41.863899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-409b1993-292d-4509-b497-a0e9f6c58350 req-a02fc877-1ad0-445a-94e7-fd3fcb827413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64af2333-6bd9-4659-b79a-3514e9b221ea", "name": "network-vif-plugged", "status": "completed", "tag": "20e18d45-4075-40d9-be5a-08ae7734d965"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:41.889689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-409b1993-292d-4509-b497-a0e9f6c58350 req-a02fc877-1ad0-445a-94e7-fd3fcb827413 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:41.892792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-409b1993-292d-4509-b497-a0e9f6c58350 req-a02fc877-1ad0-445a-94e7-fd3fcb827413 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:41.915297 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-409b1993-292d-4509-b497-a0e9f6c58350 req-a02fc877-1ad0-445a-94e7-fd3fcb827413 service nova] Creating event network-vif-plugged:20e18d45-4075-40d9-be5a-08ae7734d965 for instance 64af2333-6bd9-4659-b79a-3514e9b221ea on nch1-master-1 Apr 02 21:07:41.922633 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-409b1993-292d-4509-b497-a0e9f6c58350 req-a02fc877-1ad0-445a-94e7-fd3fcb827413 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326320 Apr 02 21:07:41.924286 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2001/4319] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:42.572777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:42.573412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:42.585879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:42.586821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:42.587449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:42.588281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:42.588939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:42.590103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:42.601065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:42.601646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:42.604055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:42.604553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:42.987986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:42.996408 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be966428-45bc-45ff-acc0-44f05e5bec0d tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.429846 Apr 02 21:07:42.997066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2319/4320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:42 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:43.002132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:43.002827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:43.025735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:43.026413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:43.027511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:43.029706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:43.030322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:43.042429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e825d89d-f03c-4767-b31f-b3647a8ca5bf tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1314 microversion: 2.1 time: 0.461972 Apr 02 21:07:43.043427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2002/4321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:42 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:43.133459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lazy-loading 'services' on Instance uuid 58df85ac-b402-424d-8354-fc927aad0d32 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:07:43.222972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments/53932f9c-8a1a-44d4-851d-4805a7def1fe" status: 202 len: 0 microversion: 2.1 time: 0.224150 Apr 02 21:07:43.224211 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2320/4322] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:07:42 2022] DELETE /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments/53932f9c-8a1a-44d4-851d-4805a7def1fe => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:07:43.240430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:43.243119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:43.252659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:43.253187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:43.254097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:43.254548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:43.302810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ea9e3c8d-0ac5-40fd-a762-fb27850094e5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072417 Apr 02 21:07:43.304369 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2003/4323] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:07:43 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:43.958838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d64d5769-cb40-44ac-b2d3-cd672859b831 req-6e94b023-2235-4f95-90aa-1df9a8127d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b7b03e-c24e-445c-9de6-41ddee02234a", "name": "network-vif-plugged", "status": "completed", "tag": "1037642c-cc06-421a-9a77-1773424ede8f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:43.993848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d64d5769-cb40-44ac-b2d3-cd672859b831 req-6e94b023-2235-4f95-90aa-1df9a8127d39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:43.994625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d64d5769-cb40-44ac-b2d3-cd672859b831 req-6e94b023-2235-4f95-90aa-1df9a8127d39 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.016487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:44.027010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:44.030055 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d64d5769-cb40-44ac-b2d3-cd672859b831 req-6e94b023-2235-4f95-90aa-1df9a8127d39 service nova] Creating event network-vif-plugged:1037642c-cc06-421a-9a77-1773424ede8f for instance 60b7b03e-c24e-445c-9de6-41ddee02234a on nch2-master-1 Apr 02 21:07:44.037068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.039638 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d64d5769-cb40-44ac-b2d3-cd672859b831 req-6e94b023-2235-4f95-90aa-1df9a8127d39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100612 Apr 02 21:07:44.041067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.041526 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2321/4324] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:44.042433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.045703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.063729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:44.065184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:44.074896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.075708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.076778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.078508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.353654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:44.367623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b88c64c6-aab3-4b72-957c-3dffd8e96f3c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1498 microversion: 2.1 time: 0.310235 Apr 02 21:07:44.382049 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2322/4325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:44 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1498 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:44.393437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:44.395811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:44.416474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.417018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.418078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.418502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.476647 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21cb372d-68ed-46f6-88e4-6ebb012e64f4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092996 Apr 02 21:07:44.477411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2323/4326] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:07:44 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:07:44.552199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:44.553575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:44.560255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.561176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.562456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.563087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.621539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:44.634656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:44.653188 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a720fc9-59d5-4894-be2d-0d3c90817338 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.641849 Apr 02 21:07:44.654385 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2004/4327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:44 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:44.765009 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b4411df-05ca-4ccb-8d36-957516f45541 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 204 len: 0 microversion: 2.1 time: 0.216763 Apr 02 21:07:44.766142 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2324/4328] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:07:44 2022] DELETE /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:07:44.775336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:44.776845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:44.788566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.790224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.791083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:44.791524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:44.994418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:44.995049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:45.006236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:45.011035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:45.014075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:45.015035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:45.052746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:45.131578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:45.147956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eacffbb5-6bda-4b02-a05e-eca2b1035ec5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1683 microversion: 2.1 time: 0.376192 Apr 02 21:07:45.149025 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2005/4329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:44 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1683 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:45.196791 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ff1e2fc-5138-4e00-a4c3-a9373538a4fe tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 204 len: 0 microversion: 2.1 time: 0.206893 Apr 02 21:07:45.198014 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2325/4330] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:07:44 2022] DELETE /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:07:45.207260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:45.207808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:45.215622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:45.216097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:45.217171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:45.217656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:45.514627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:45.526414 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6beecbce-7a41-4374-bc45-9b7f3bb49d63 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1504 microversion: 2.1 time: 0.323443 Apr 02 21:07:45.527741 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2006/4331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:45 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:45.673531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:45.674784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:45.683022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:45.683559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:45.684925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:45.685583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:45.953310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:45.997528 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a822da19-02fb-491f-8328-52507fcb7b49 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1317 microversion: 2.1 time: 0.325526 Apr 02 21:07:45.998189 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2326/4332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:45 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:46.170796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:46.172215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:46.181864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:46.182690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:46.184491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:46.185552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:46.394864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:46.407738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34e6972c-e7aa-45af-a93d-f12f0c600b63 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1683 microversion: 2.1 time: 0.245049 Apr 02 21:07:46.409096 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2007/4333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:46 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:46.546831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:46.558966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:46.579765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:46.581911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:46.582860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:46.583383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:46.943219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:46.955955 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6b671e2-ac58-42d4-ba3e-1ead0f58bac7 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1504 microversion: 2.1 time: 0.415347 Apr 02 21:07:46.956598 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2327/4334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:46 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:47.016019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.016663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:47.025854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.026322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.027112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.027556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.427730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.430662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:47.444353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:47.459462 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b63f2a4f-cdf7-4ad1-8c35-35e42e08d381 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1506 microversion: 2.1 time: 0.447756 Apr 02 21:07:47.461264 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2008/4335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:47 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:47.471392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.471937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.473815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.474435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.477654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.478409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:47.485077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.485842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.486855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.487507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.517168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d273708-8f77-44fd-b6d3-583cbcf7fe5a tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a/ips" status: 200 len: 109 microversion: 2.1 time: 0.043391 Apr 02 21:07:47.524933 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2009/4336] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:07:47 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a/ips => generated 109 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:47.538065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.543729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:47.558872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.565905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.566791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.567249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.610902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46f4c364-5b37-4012-929f-2d270fee2b89 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a/ips" status: 200 len: 109 microversion: 2.1 time: 0.081517 Apr 02 21:07:47.611678 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2010/4337] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:07:47 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a/ips => generated 109 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:47.622839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.623756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:47.631509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.632200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.633490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.634208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.686846 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6613f8b4-abba-43ae-b399-e3ff2bda870f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a/ips/tempest-ServerAddressesTestJSON-178306721-network" status: 200 len: 94 microversion: 2.1 time: 0.067885 Apr 02 21:07:47.690992 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2011/4338] 10.222.0.18 () {58 vars in 1397 bytes} [Sat Apr 2 21:07:47 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a/ips/tempest-ServerAddressesTestJSON-178306721-network => generated 94 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:07:47.704386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.706777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:47.722838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.726305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.727396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.728054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.789449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:07:47.858474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:47.888530 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f982acea-4218-4fde-83a3-581d9ed1d12b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1683 microversion: 2.1 time: 0.463192 Apr 02 21:07:47.889934 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2328/4339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:47 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1683 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:47.929095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-55caa834-84bf-4190-9067-709f3ef612db req-9026cf5a-666a-4f57-b733-f256128f9c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64af2333-6bd9-4659-b79a-3514e9b221ea", "name": "network-vif-deleted", "tag": "20e18d45-4075-40d9-be5a-08ae7734d965"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:47.943784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-55caa834-84bf-4190-9067-709f3ef612db req-9026cf5a-666a-4f57-b733-f256128f9c74 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:47.944776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-55caa834-84bf-4190-9067-709f3ef612db req-9026cf5a-666a-4f57-b733-f256128f9c74 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:47.964062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-55caa834-84bf-4190-9067-709f3ef612db req-9026cf5a-666a-4f57-b733-f256128f9c74 service nova] Creating event network-vif-deleted:20e18d45-4075-40d9-be5a-08ae7734d965 for instance 64af2333-6bd9-4659-b79a-3514e9b221ea on nch1-master-1 Apr 02 21:07:47.978337 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-55caa834-84bf-4190-9067-709f3ef612db req-9026cf5a-666a-4f57-b733-f256128f9c74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059563 Apr 02 21:07:47.979666 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2329/4340] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:47.988976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:47.990072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:48.010362 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8bad5f6a-e8d8-410c-9ba6-87ffdc294d6e tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 204 len: 0 microversion: 2.1 time: 0.308137 Apr 02 21:07:48.015366 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2012/4341] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:07:47 2022] DELETE /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:07:48.023308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:48.024355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:48.026998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.027466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.028316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.033358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.034600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.035402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.036731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.038161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.239402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:48.255259 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4f9559a1-c712-4333-8000-84bd203a834c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 200 len: 1299 microversion: 2.1 time: 0.274003 Apr 02 21:07:48.255935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2330/4342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:47 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:48.483269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:48.494797 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f98b238d-7488-49bf-bb0b-497509404755 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1512 microversion: 2.1 time: 0.477088 Apr 02 21:07:48.495607 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2013/4343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:48 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:48.907951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:48.909032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:48.922900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.926140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.927256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.928863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.977214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:48.977931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:48.978652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lazy-loading 'fault' on Instance uuid 58df85ac-b402-424d-8354-fc927aad0d32 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:07:49.042021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:49.055223 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c9d7e30b-e137-473d-bf21-0b71d6b214cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 200 len: 1331 microversion: 2.1 time: 0.150907 Apr 02 21:07:49.058252 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2331/4344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:48 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:49.271495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:49.272032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 64af2333-6bd9-4659-b79a-3514e9b221ea] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:49.281020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:49.281741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:49.282701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:49.283342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:49.301540 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] HTTP exception thrown: Instance 64af2333-6bd9-4659-b79a-3514e9b221ea could not be found. Apr 02 21:07:49.302426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Returning 404 to user: Instance 64af2333-6bd9-4659-b79a-3514e9b221ea could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:49.304064 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-800f61a5-7d1c-4df6-a13f-cb1b53a4e59c tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea" status: 404 len: 111 microversion: 2.1 time: 0.036859 Apr 02 21:07:49.305257 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2014/4345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:49 2022] GET /compute/v2.1/servers/64af2333-6bd9-4659-b79a-3514e9b221ea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:07:49.418210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-511270730", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "91357282-db19-46d5-9ae6-53ef880c5451"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:49.507758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] validate_networks() for [('91357282-db19-46d5-9ae6-53ef880c5451', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:07:49.514189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:49.515773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:49.529255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:49.530297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:49.531339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:49.532009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:49.891856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:49.906671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-500cbfdc-ad4c-4840-8ee4-0922acc2b5eb tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1512 microversion: 2.1 time: 0.395531 Apr 02 21:07:49.909329 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2015/4346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:49 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:50.017295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2dd4e126-ee63-4fb6-a5c8-d45e84f0c4b8 req-ae9982f1-50f2-4802-982a-d9b322d4e70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58df85ac-b402-424d-8354-fc927aad0d32", "name": "network-vif-deleted", "tag": "d4d64426-ae59-4e94-a2da-c586004c8607"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:50.035377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2dd4e126-ee63-4fb6-a5c8-d45e84f0c4b8 req-ae9982f1-50f2-4802-982a-d9b322d4e70d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.036108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2dd4e126-ee63-4fb6-a5c8-d45e84f0c4b8 req-ae9982f1-50f2-4802-982a-d9b322d4e70d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:50.054110 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2dd4e126-ee63-4fb6-a5c8-d45e84f0c4b8 req-ae9982f1-50f2-4802-982a-d9b322d4e70d service nova] Creating event network-vif-deleted:d4d64426-ae59-4e94-a2da-c586004c8607 for instance 58df85ac-b402-424d-8354-fc927aad0d32 on nch2-master-1 Apr 02 21:07:50.061406 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2dd4e126-ee63-4fb6-a5c8-d45e84f0c4b8 req-ae9982f1-50f2-4802-982a-d9b322d4e70d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051676 Apr 02 21:07:50.062583 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2016/4347] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:50.087694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:50.088563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:50.115976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.116972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:50.123501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.133295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:50.177484 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 58df85ac-b402-424d-8354-fc927aad0d32 could not be found. Apr 02 21:07:50.178798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 58df85ac-b402-424d-8354-fc927aad0d32 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:50.179680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b965cc07-a674-4ac1-b807-f25316ffe824 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 404 len: 111 microversion: 2.1 time: 0.109263 Apr 02 21:07:50.194121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2017/4348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:50 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:07:50.213642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-914335cb-c23f-4058-a50b-71dc11a622bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '.version_select at 0x7f54d41e4820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:50.255187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-914335cb-c23f-4058-a50b-71dc11a622bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542094113" status: 202 len: 0 microversion: 2.1 time: 0.059562 Apr 02 21:07:50.257060 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2018/4349] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:07:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542094113 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:07:50.525725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1700778975", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "cca1143a-9c1f-4e9e-8a8e-6a7fe8e5d804"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:50.616986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] validate_networks() for [('cca1143a-9c1f-4e9e-8a8e-6a7fe8e5d804', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:07:50.772648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:07:50.773244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:07:50.773555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:07:50.773996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:07:50.774392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:07:50.794652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.797632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:50.799299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.799979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:50.829828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Getting quotas for project f54b2160309b4d76bd7a944454903520. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:50.841373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Getting quotas for user d12e43a0a2994654a400b3a2bed83ecf and project f54b2160309b4d76bd7a944454903520. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:50.866297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:07:50.870721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:07:50.955253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd10335c-63d3-4e43-889f-594a3130d097 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541542 Apr 02 21:07:50.972857 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2332/4350] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:07:50.981681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:50.983212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:50.992031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.993864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:50.995120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:50.995806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:51.118368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140cc422fc5b40eaa3cd538fb9c05b7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8620340d064cd98fd526e46e061d4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:51.128947 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-463dcfdd-b12e-49b0-85ff-a58d442e655f tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 200 len: 1470 microversion: 2.1 time: 0.151994 Apr 02 21:07:51.131863 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2333/4351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:50 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:51.138175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5391d1cf-e832-4a71-a8e1-0a30b069c9f4 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:51.139115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5391d1cf-e832-4a71-a8e1-0a30b069c9f4 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:51.344554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5391d1cf-e832-4a71-a8e1-0a30b069c9f4 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:51.366556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5391d1cf-e832-4a71-a8e1-0a30b069c9f4 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1213 microversion: 2.1 time: 0.231740 Apr 02 21:07:51.381312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2334/4352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:51 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1213 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:51.868549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:07:51.869577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:07:51.870221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:07:51.870720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:07:51.871323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:07:51.882466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:51.883602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:51.884975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:51.885927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:51.909421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Getting quotas for project 93da813e266e41509229a1e99815d9ab. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:51.917811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Getting quotas for user ac8027ca8086469999ae8a73639fca90 and project 93da813e266e41509229a1e99815d9ab. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:51.936974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:07:51.942328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:07:52.012039 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-178ba8c0-b3aa-45c2-b309-4d3030fdd632 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.736313 Apr 02 21:07:52.014278 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2019/4353] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:07:52.135804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-111185222", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "cca1143a-9c1f-4e9e-8a8e-6a7fe8e5d804"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:52.154880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:52.155870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] [instance: 60b7b03e-c24e-445c-9de6-41ddee02234a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:52.180172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:52.191694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:52.197947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:52.199991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:52.244844 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] HTTP exception thrown: Instance 60b7b03e-c24e-445c-9de6-41ddee02234a could not be found. Apr 02 21:07:52.260837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] Returning 404 to user: Instance 60b7b03e-c24e-445c-9de6-41ddee02234a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:07:52.263510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] validate_networks() for [('cca1143a-9c1f-4e9e-8a8e-6a7fe8e5d804', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:07:52.264413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cc93589-2e90-45a7-8b6d-288e5de0d0e5 tempest-ServerAddressesTestJSON-155009259 tempest-ServerAddressesTestJSON-155009259-project] 10.222.0.18 "GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a" status: 404 len: 111 microversion: 2.1 time: 0.119301 Apr 02 21:07:52.275858 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2020/4354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:52 2022] GET /compute/v2.1/servers/60b7b03e-c24e-445c-9de6-41ddee02234a => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:07:52.299264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-52d88f14-b1c0-4543-895e-9fc34d4926d9 req-6b3b95d6-96f0-4ec8-81de-e61b2e47ac83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b7b03e-c24e-445c-9de6-41ddee02234a", "name": "network-vif-deleted", "tag": "1037642c-cc06-421a-9a77-1773424ede8f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:52.322707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-52d88f14-b1c0-4543-895e-9fc34d4926d9 req-6b3b95d6-96f0-4ec8-81de-e61b2e47ac83 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:52.323176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-52d88f14-b1c0-4543-895e-9fc34d4926d9 req-6b3b95d6-96f0-4ec8-81de-e61b2e47ac83 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:52.338294 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-52d88f14-b1c0-4543-895e-9fc34d4926d9 req-6b3b95d6-96f0-4ec8-81de-e61b2e47ac83 service nova] Creating event network-vif-deleted:1037642c-cc06-421a-9a77-1773424ede8f for instance 60b7b03e-c24e-445c-9de6-41ddee02234a on nch2-master-1 Apr 02 21:07:52.345058 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-52d88f14-b1c0-4543-895e-9fc34d4926d9 req-6b3b95d6-96f0-4ec8-81de-e61b2e47ac83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056254 Apr 02 21:07:52.346404 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2021/4355] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:52.402281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:52.403157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:52.422486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:52.422953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:52.423754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:52.424219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:52.819627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:52.833015 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd11a283-950b-4341-9834-184eeeac0585 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1265 microversion: 2.1 time: 0.437287 Apr 02 21:07:52.834964 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2022/4356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:52 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1265 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:53.197385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f5acb4b9-6a94-41ed-844f-9b780c3592a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: .version_select at 0x7f54d42db310>, body: {"keypair": {"name": "tempest-keypair-1750947612"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:53.257807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f5acb4b9-6a94-41ed-844f-9b780c3592a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:53.274219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f5acb4b9-6a94-41ed-844f-9b780c3592a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:53.316261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:07:53.317498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:07:53.320151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:07:53.320895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:07:53.321595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:07:53.341201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:53.343093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:53.366243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:53.366900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:53.403788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Getting quotas for project 93da813e266e41509229a1e99815d9ab. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:53.412438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Getting quotas for user ac8027ca8086469999ae8a73639fca90 and project 93da813e266e41509229a1e99815d9ab. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:53.465562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:07:53.471534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:07:53.566017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f5acb4b9-6a94-41ed-844f-9b780c3592a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:53.574733 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b07a381-f551-401d-9098-659aa1c87eab tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443713 Apr 02 21:07:53.576821 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2335/4357] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:07:53.596927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f5acb4b9-6a94-41ed-844f-9b780c3592a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:53.643742 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f5acb4b9-6a94-41ed-844f-9b780c3592a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.483548 Apr 02 21:07:53.644944 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2023/4358] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:07:53 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:53.808933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-397965992", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "451", "networks": [{"uuid": "cca1143a-9c1f-4e9e-8a8e-6a7fe8e5d804"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:53.851639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:53.852417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:53.863181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:53.863675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:53.870162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:53.870678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:53.940366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] validate_networks() for [('cca1143a-9c1f-4e9e-8a8e-6a7fe8e5d804', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:07:54.104590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:54.120112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e11f705-a571-4f8a-98b0-ed583305bb81 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1271 microversion: 2.1 time: 0.272733 Apr 02 21:07:54.121577 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2024/4359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:53 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1271 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:55.103075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:07:55.104926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:07:55.105818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:07:55.106605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:07:55.107263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:07:55.119703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:55.120588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:55.121801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:55.122512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:55.142400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:55.148424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:55.169333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:55.169964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:55.173207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:55.174031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:55.223636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Getting quotas for project 93da813e266e41509229a1e99815d9ab. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:07:55.249999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Getting quotas for user ac8027ca8086469999ae8a73639fca90 and project 93da813e266e41509229a1e99815d9ab. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:07:55.350765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:07:55.355010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:07:55.504431 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-71c2fcc6-ea05-409f-8a33-b214448ac39b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.700132 Apr 02 21:07:55.519500 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2336/4360] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:07:55.525921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8aa48459-a19f-4e60-a186-e26d53cc1343 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:55.530730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8aa48459-a19f-4e60-a186-e26d53cc1343 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:55.749874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8aa48459-a19f-4e60-a186-e26d53cc1343 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:55.767906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8aa48459-a19f-4e60-a186-e26d53cc1343 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1220 microversion: 2.1 time: 0.244950 Apr 02 21:07:55.770472 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2337/4361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:55 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1220 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:56.000499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:56.020358 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af4965b3-dff0-4307-b341-bc0ff3916b11 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 0.874036 Apr 02 21:07:56.022871 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2025/4362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:55 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:56.779760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-970bbc2d-17ba-4dbf-bef9-d58ce4b12346 req-101e6962-59da-48b1-ae96-477281e198e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208b3d58-e40e-4350-9f4d-0e979db4cadc", "tag": "5a209f67-e99e-4f07-bc3b-151e8afba63f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:56.793446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:56.794494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:56.798087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-970bbc2d-17ba-4dbf-bef9-d58ce4b12346 req-101e6962-59da-48b1-ae96-477281e198e6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:56.799735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-970bbc2d-17ba-4dbf-bef9-d58ce4b12346 req-101e6962-59da-48b1-ae96-477281e198e6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:56.825668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:56.827329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:56.829742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:56.830274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:56.836532 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-970bbc2d-17ba-4dbf-bef9-d58ce4b12346 req-101e6962-59da-48b1-ae96-477281e198e6 service nova] Creating event network-changed:5a209f67-e99e-4f07-bc3b-151e8afba63f for instance 208b3d58-e40e-4350-9f4d-0e979db4cadc on nch1-master-1 Apr 02 21:07:56.842688 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-970bbc2d-17ba-4dbf-bef9-d58ce4b12346 req-101e6962-59da-48b1-ae96-477281e198e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066777 Apr 02 21:07:56.847355 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2338/4363] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:57.044514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:57.045231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:57.060612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:57.065983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:57.069845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:57.072369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:57.239498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:57.251669 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c40dd2b0-d1a3-468c-bbc1-d1736d2b6e5d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1272 microversion: 2.1 time: 0.465276 Apr 02 21:07:57.252220 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2026/4364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:56 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1272 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:07:58.197154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:58.206372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2bab5616-ee19-4821-b0f8-6e5d1dfdbe80 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 1.165981 Apr 02 21:07:58.207218 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2339/4365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:57 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:58.289248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:58.290008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:58.321566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:58.322123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:58.323869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:58.324362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:58.507660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:58.518159 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ecde6bc-cda5-4bc1-a744-14b0cf6d0995 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1278 microversion: 2.1 time: 0.250003 Apr 02 21:07:58.518889 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2027/4366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:58 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:58.541675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-801df7ae-da02-4f26-a4bb-d1cfa94ab79c req-6c5604d1-49fc-40db-a85d-36802688fe19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f06abe1-8723-4cef-87af-ecf16cc21db5", "tag": "ca836671-e4c3-48a2-a13b-3b83b10b9123"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:58.558073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-801df7ae-da02-4f26-a4bb-d1cfa94ab79c req-6c5604d1-49fc-40db-a85d-36802688fe19 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:58.558952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-801df7ae-da02-4f26-a4bb-d1cfa94ab79c req-6c5604d1-49fc-40db-a85d-36802688fe19 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:58.580165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-801df7ae-da02-4f26-a4bb-d1cfa94ab79c req-6c5604d1-49fc-40db-a85d-36802688fe19 service nova] Creating event network-changed:ca836671-e4c3-48a2-a13b-3b83b10b9123 for instance 3f06abe1-8723-4cef-87af-ecf16cc21db5 on nch1-master-1 Apr 02 21:07:58.589538 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-801df7ae-da02-4f26-a4bb-d1cfa94ab79c req-6c5604d1-49fc-40db-a85d-36802688fe19 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315722 Apr 02 21:07:58.591072 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2340/4367] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:07:59.227292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:59.228519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:59.236425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:59.237191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:59.238162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:59.238612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:59.538464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:07:59.539753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:07:59.546919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:59.547800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:59.549407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:07:59.550026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:07:59.707252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:59.715914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef07c077-a989-4125-8471-f64b8b2d9a36 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1278 microversion: 2.1 time: 0.183213 Apr 02 21:07:59.725773 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2341/4368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:59 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:07:59.888184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-941838531", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e11fe41-71ae-4517-9435-793475d4d7b5"}], "security_groups": [{"name": "tempest-securitygroup--1137432510"}], "key_name": "tempest-keypair-1750947612", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:07:59.949158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:07:59.961159 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ba9a0714-a48b-433e-8771-788ea7de9d30 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 0.741231 Apr 02 21:07:59.961746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2028/4369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:07:59 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:00.110390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0d1a9585-b57a-4be5-bee6-8bfd392637ee req-9e991e52-0715-4ba3-8b4e-a0afa6642f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b714f238-380f-4ce0-b87b-d7beb9873704", "tag": "cee15827-0ae8-4256-97c2-7bf6108378c3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:00.128719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0d1a9585-b57a-4be5-bee6-8bfd392637ee req-9e991e52-0715-4ba3-8b4e-a0afa6642f91 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:00.129274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0d1a9585-b57a-4be5-bee6-8bfd392637ee req-9e991e52-0715-4ba3-8b4e-a0afa6642f91 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:00.146918 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0d1a9585-b57a-4be5-bee6-8bfd392637ee req-9e991e52-0715-4ba3-8b4e-a0afa6642f91 service nova] Creating event network-changed:cee15827-0ae8-4256-97c2-7bf6108378c3 for instance b714f238-380f-4ce0-b87b-d7beb9873704 on nch2-master-1 Apr 02 21:08:00.151986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0d1a9585-b57a-4be5-bee6-8bfd392637ee req-9e991e52-0715-4ba3-8b4e-a0afa6642f91 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046468 Apr 02 21:08:00.153192 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2029/4370] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:00.281407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] validate_networks() for [('8e11fe41-71ae-4517-9435-793475d4d7b5', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:08:00.774914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad466b6c-ad1b-4726-9e18-860de8dc75b5 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Action: 'create', calling method: .version_select at 0x7f54c7fbf040>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:00.795579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad466b6c-ad1b-4726-9e18-860de8dc75b5 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Getting quotas for project 381ce062df854c77b16cc5cff07c462e. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:00.802018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad466b6c-ad1b-4726-9e18-860de8dc75b5 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Getting quotas for user 59fa2d8ade804f859d48ea6be1949e42 and project 381ce062df854c77b16cc5cff07c462e. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:00.856547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad466b6c-ad1b-4726-9e18-860de8dc75b5 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Getting quotas for project 381ce062df854c77b16cc5cff07c462e. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:00.863931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad466b6c-ad1b-4726-9e18-860de8dc75b5 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Getting quotas for user 59fa2d8ade804f859d48ea6be1949e42 and project 381ce062df854c77b16cc5cff07c462e. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:00.882583 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad466b6c-ad1b-4726-9e18-860de8dc75b5 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.186461 Apr 02 21:08:00.882876 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2030/4371] 10.222.0.18 () {62 vars in 1213 bytes} [Sat Apr 2 21:08:00 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 21:08:00.888863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:00.889988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:00.898117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:00.899157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:00.900113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:00.900825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:01.290368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:01.299046 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cfbbb297-b0d5-4bfc-8500-74f1584fe4d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.414878 Apr 02 21:08:01.308212 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2031/4372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:00 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:01.316686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31160308-a5ee-4546-8321-cd80f249c872 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:01.331706 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31160308-a5ee-4546-8321-cd80f249c872 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021860 Apr 02 21:08:01.332761 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2032/4373] 10.222.0.18 () {60 vars in 1192 bytes} [Sat Apr 2 21:08:01 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:08:01.343435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:01.344382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:01.351573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:01.352286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:01.353297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:01.353908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:01.969370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:01.977934 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d72990f5-c665-4ddc-bcfd-ed3c378449fb tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 0.639114 Apr 02 21:08:01.978526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2033/4374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:01 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:01.994024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4a41c5a-2371-41b9-9370-772cac0c4844 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:02.003340 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4a41c5a-2371-41b9-9370-772cac0c4844 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/c47ec09a-e2b9-46b0-9619-a36bcc530545" status: 200 len: 235 microversion: 2.64 time: 0.013886 Apr 02 21:08:02.003898 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2034/4375] 10.222.0.18 () {60 vars in 1303 bytes} [Sat Apr 2 21:08:01 2022] GET /compute/v2.1/os-server-groups/c47ec09a-e2b9-46b0-9619-a36bcc530545 => generated 235 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:08:02.015356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f1d0b6a4-27d9-4e7c-86c3-964e5f9168e1 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:02.044391 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f1d0b6a4-27d9-4e7c-86c3-964e5f9168e1 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c47ec09a-e2b9-46b0-9619-a36bcc530545" status: 204 len: 0 microversion: 2.64 time: 0.033931 Apr 02 21:08:02.045070 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2035/4376] 10.222.0.18 () {60 vars in 1306 bytes} [Sat Apr 2 21:08:02 2022] DELETE /compute/v2.1/os-server-groups/c47ec09a-e2b9-46b0-9619-a36bcc530545 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:08:02.054947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44dfa111-28e7-40fa-a895-92062cb34ec2 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:02.063007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-44dfa111-28e7-40fa-a895-92062cb34ec2 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] HTTP exception thrown: Instance group c47ec09a-e2b9-46b0-9619-a36bcc530545 could not be found. Apr 02 21:08:02.063685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44dfa111-28e7-40fa-a895-92062cb34ec2 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] Returning 404 to user: Instance group c47ec09a-e2b9-46b0-9619-a36bcc530545 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:02.064845 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44dfa111-28e7-40fa-a895-92062cb34ec2 tempest-ServerGroup264TestJSON-199055413 tempest-ServerGroup264TestJSON-199055413-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/c47ec09a-e2b9-46b0-9619-a36bcc530545" status: 404 len: 117 microversion: 2.64 time: 0.014659 Apr 02 21:08:02.065723 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2036/4377] 10.222.0.18 () {60 vars in 1306 bytes} [Sat Apr 2 21:08:02 2022] DELETE /compute/v2.1/os-server-groups/c47ec09a-e2b9-46b0-9619-a36bcc530545 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:08:02.099938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:08:02.101650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:08:02.102329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:08:02.102916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:08:02.103570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:08:02.114165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:02.115510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:02.117174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:02.117888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:02.143708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:02.150841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:02.169046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:08:02.172116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:08:02.245163 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2aaf138-0b3f-4811-b5d6-4d7dab34d0d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.361272 Apr 02 21:08:02.246945 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2342/4378] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:07:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:08:02.264888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45687e72-9b87-4379-a9ae-9f5187ecd85a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:02.266171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45687e72-9b87-4379-a9ae-9f5187ecd85a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:02.321085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:02.321711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:02.329257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:02.329703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:02.337762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:02.341118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:02.420200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-45687e72-9b87-4379-a9ae-9f5187ecd85a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:02.428430 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45687e72-9b87-4379-a9ae-9f5187ecd85a tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1241 microversion: 2.1 time: 0.172183 Apr 02 21:08:02.432892 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2037/4379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:02 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:02.517097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-406dfb0c-f6ea-4675-a142-57c27ac57a03 req-448c170f-8957-4a71-87ab-a3e02518a5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da1fde6-a875-46d3-b37c-48141af6c351", "tag": "b0db797e-0c06-416a-9943-2bde82ea66bd"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:02.537479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-406dfb0c-f6ea-4675-a142-57c27ac57a03 req-448c170f-8957-4a71-87ab-a3e02518a5ce service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:02.538754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-406dfb0c-f6ea-4675-a142-57c27ac57a03 req-448c170f-8957-4a71-87ab-a3e02518a5ce service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:02.553122 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-406dfb0c-f6ea-4675-a142-57c27ac57a03 req-448c170f-8957-4a71-87ab-a3e02518a5ce service nova] Creating event network-changed:b0db797e-0c06-416a-9943-2bde82ea66bd for instance 0da1fde6-a875-46d3-b37c-48141af6c351 on nch2-master-1 Apr 02 21:08:02.559774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-406dfb0c-f6ea-4675-a142-57c27ac57a03 req-448c170f-8957-4a71-87ab-a3e02518a5ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047180 Apr 02 21:08:02.560660 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2038/4380] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:02.759627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:02.773732 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-adacd706-4280-4293-9af4-8d41f5bfc096 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.456681 Apr 02 21:08:02.792086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2343/4381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:02 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:03.001194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:03.003051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:03.019532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:03.020402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:03.022532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:03.023802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:03.298362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:03.314089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de6681aa-2ede-4184-9761-4eea3e3900d5 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 0.321550 Apr 02 21:08:03.328336 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2039/4382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:02 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:03.470053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:03.471225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:03.479117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:03.479595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:03.480384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:03.480870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:03.574968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:03.607015 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ca28ed7-be33-462f-a2be-b95e6fcc9403 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1293 microversion: 2.1 time: 0.156906 Apr 02 21:08:03.608702 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2344/4383] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:03 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:03.793185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:03.794455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:03.804937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:03.806038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:03.809477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:03.810190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:04.000173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a20712fa-f8ba-457f-9788-b75833ba32e4 req-198c70ae-6767-4ee3-9032-d7440c9a92d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208b3d58-e40e-4350-9f4d-0e979db4cadc", "name": "network-vif-plugged", "status": "completed", "tag": "5a209f67-e99e-4f07-bc3b-151e8afba63f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:04.014465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a20712fa-f8ba-457f-9788-b75833ba32e4 req-198c70ae-6767-4ee3-9032-d7440c9a92d9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:04.015222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a20712fa-f8ba-457f-9788-b75833ba32e4 req-198c70ae-6767-4ee3-9032-d7440c9a92d9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:04.066488 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a20712fa-f8ba-457f-9788-b75833ba32e4 req-198c70ae-6767-4ee3-9032-d7440c9a92d9 service nova] Creating event network-vif-plugged:5a209f67-e99e-4f07-bc3b-151e8afba63f for instance 208b3d58-e40e-4350-9f4d-0e979db4cadc on nch1-master-1 Apr 02 21:08:04.093049 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a20712fa-f8ba-457f-9788-b75833ba32e4 req-198c70ae-6767-4ee3-9032-d7440c9a92d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090429 Apr 02 21:08:04.106995 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2345/4384] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:04.339359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:04.340592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:04.358836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:04.359885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:04.361870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:04.363356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:04.520373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:04.542095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84611655-ca77-4499-9d2c-ac58924b5502 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.751540 Apr 02 21:08:04.545790 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2040/4385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:03 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:04.628354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:04.630033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:04.640924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:04.641769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:04.642954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:04.643650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:04.741017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:04.756054 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5950d342-8389-46a1-b4a4-846f59eacbd0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1299 microversion: 2.1 time: 0.133478 Apr 02 21:08:04.759939 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2041/4386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:04 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:04.769665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:04.794382 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb648118-87b7-4385-b684-06b2849225f0 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 0.463112 Apr 02 21:08:04.813551 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2346/4387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:04 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:05.567060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:05.567756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:05.574726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:05.575190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:05.576002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:05.576686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:05.778061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:05.778703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:05.785992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:05.786450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:05.788193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:05.788193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:05.988050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:06.012504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:06.019557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d35e77e9-da79-495d-9f85-12faec02ef0b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.245102 Apr 02 21:08:06.025136 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c5faed6-8726-4fd9-87f1-d546cc1a2f51 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.466522 Apr 02 21:08:06.033623 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2347/4388] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:05 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:06.035578 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2042/4389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:05 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:06.039204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:06.040090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:06.046884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:06.047624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:06.048671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:06.049285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:06.306604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:06.326368 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfbcc84f-6ff4-4efb-abf7-9b04f20eb0af tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1313 microversion: 2.1 time: 0.291256 Apr 02 21:08:06.326989 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2348/4390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:06 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:06.466535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8035f28d-4392-4008-8e23-c91f10bda8da req-89e15b30-84c0-4a00-b5f3-adcfc72a9610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36", "tag": "96ce7472-2a62-45dc-8a1e-fe0e2262b5aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:06.488991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8035f28d-4392-4008-8e23-c91f10bda8da req-89e15b30-84c0-4a00-b5f3-adcfc72a9610 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:06.489591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8035f28d-4392-4008-8e23-c91f10bda8da req-89e15b30-84c0-4a00-b5f3-adcfc72a9610 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:06.508143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8035f28d-4392-4008-8e23-c91f10bda8da req-89e15b30-84c0-4a00-b5f3-adcfc72a9610 service nova] Creating event network-changed:96ce7472-2a62-45dc-8a1e-fe0e2262b5aa for instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 on nch2-master-1 Apr 02 21:08:06.513767 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8035f28d-4392-4008-8e23-c91f10bda8da req-89e15b30-84c0-4a00-b5f3-adcfc72a9610 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075549 Apr 02 21:08:06.515185 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2043/4391] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:07.044194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.046588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:07.059979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.062921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.064768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.065234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.126415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aa6dc55f-5f0d-46b7-a572-96bf65b2406d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Action: 'create', calling method: .version_select at 0x7f54c7c1faf0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-768318088", "policies": ["affinity"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:07.169044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-aa6dc55f-5f0d-46b7-a572-96bf65b2406d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:07.178161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-aa6dc55f-5f0d-46b7-a572-96bf65b2406d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:07.243199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-aa6dc55f-5f0d-46b7-a572-96bf65b2406d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:07.251116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-aa6dc55f-5f0d-46b7-a572-96bf65b2406d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:07.277320 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aa6dc55f-5f0d-46b7-a572-96bf65b2406d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.310704 Apr 02 21:08:07.278872 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2349/4392] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Apr 2 21:08:06 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:07.284636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.287089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:07.294862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.298085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.299135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.299803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.402141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:07.413188 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-10cc12b8-5433-4130-8e76-a358205d8223 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.377576 Apr 02 21:08:07.423521 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2044/4393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:07 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:07.429122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-499238da-9f8f-4209-b2da-8f8d979509c2 req-b2d3bbd8-a1ac-4217-8ec1-388027010e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b714f238-380f-4ce0-b87b-d7beb9873704", "name": "network-vif-plugged", "status": "completed", "tag": "cee15827-0ae8-4256-97c2-7bf6108378c3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:07.440210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-499238da-9f8f-4209-b2da-8f8d979509c2 req-b2d3bbd8-a1ac-4217-8ec1-388027010e77 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.440983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-499238da-9f8f-4209-b2da-8f8d979509c2 req-b2d3bbd8-a1ac-4217-8ec1-388027010e77 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.456440 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-499238da-9f8f-4209-b2da-8f8d979509c2 req-b2d3bbd8-a1ac-4217-8ec1-388027010e77 service nova] Creating event network-vif-plugged:cee15827-0ae8-4256-97c2-7bf6108378c3 for instance b714f238-380f-4ce0-b87b-d7beb9873704 on nch2-master-1 Apr 02 21:08:07.464784 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-499238da-9f8f-4209-b2da-8f8d979509c2 req-b2d3bbd8-a1ac-4217-8ec1-388027010e77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038665 Apr 02 21:08:07.466484 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2045/4394] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:07.532535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:07.547002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Calling method '.version_select at 0x7f54c7fa6550>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.548341 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:08:07.548341 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:08:07.550477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.551201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.551988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-085902a8-7b61-4ca7-8db4-225b4a95ab7c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.271800 Apr 02 21:08:07.554745 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2350/4395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:07 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:07.563967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b67daa6-4f80-4b69-acb9-3aab8b89f8a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Action: 'create', calling method: .version_select at 0x7f54c7c1f160>, body: {"server_group": {"name": "tempest-server-group-471333845", "policies": ["affinity"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:07.568586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.569326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.584094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.584663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.592406 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c203c07-199d-4e61-8847-5ec2a61be16d tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214 tempest-PortsAdminExtendedAttrsIpV6TestJSON-689274214-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.124444 Apr 02 21:08:07.593635 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2046/4396] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:08:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:07.600566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.601743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:07.602175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2b67daa6-4f80-4b69-acb9-3aab8b89f8a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:07.611491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2b67daa6-4f80-4b69-acb9-3aab8b89f8a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:07.611635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.612005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.612842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:07.613521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:07.680507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2b67daa6-4f80-4b69-acb9-3aab8b89f8a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:07.687351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2b67daa6-4f80-4b69-acb9-3aab8b89f8a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:07.701920 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2b67daa6-4f80-4b69-acb9-3aab8b89f8a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.146073 Apr 02 21:08:07.707071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2351/4397] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Apr 2 21:08:07 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:07.713202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e9ecc46-5b6b-4e8f-8f4f-108b09ee4a5b tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Action: 'create', calling method: .version_select at 0x7f54c7ca0a60>, body: {"server_group": {"name": "tempest-server-group-471333845", "policies": ["affinity"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:07.733554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8e9ecc46-5b6b-4e8f-8f4f-108b09ee4a5b tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:07.742136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8e9ecc46-5b6b-4e8f-8f4f-108b09ee4a5b tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:07.807040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8e9ecc46-5b6b-4e8f-8f4f-108b09ee4a5b tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:07.816409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8e9ecc46-5b6b-4e8f-8f4f-108b09ee4a5b tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:07.831921 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e9ecc46-5b6b-4e8f-8f4f-108b09ee4a5b tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.123368 Apr 02 21:08:07.832924 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2352/4398] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Apr 2 21:08:07 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:07.844662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e8ab67cb-f5a5-4171-8dfb-d875f4190a00 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.884378 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e8ab67cb-f5a5-4171-8dfb-d875f4190a00 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/2ff3820e-0113-49f1-acc9-3f237d3d66b9" status: 204 len: 0 microversion: 2.1 time: 0.044314 Apr 02 21:08:07.885504 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2353/4399] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:07 2022] DELETE /compute/v2.1/os-server-groups/2ff3820e-0113-49f1-acc9-3f237d3d66b9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:07.894741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fcee8445-563e-4b75-92bf-4ae6b053328a tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.903650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:07.912317 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fcee8445-563e-4b75-92bf-4ae6b053328a tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.022564 Apr 02 21:08:07.914156 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2354/4400] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:08:07 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:07.914931 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae99e67b-3448-4107-a9ea-4a25ff050219 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1497 microversion: 2.1 time: 0.317527 Apr 02 21:08:07.916899 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2047/4401] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:07 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1497 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:07.935020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ad4edb7-7965-4049-99e9-279c31b65ebb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.965247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ad4edb7-7965-4049-99e9-279c31b65ebb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/56b71fa0-5fcf-435a-b5c1-343d611a878a" status: 204 len: 0 microversion: 2.1 time: 0.034109 Apr 02 21:08:07.966097 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2355/4402] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:07 2022] DELETE /compute/v2.1/os-server-groups/56b71fa0-5fcf-435a-b5c1-343d611a878a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:07.974362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-225d75ec-682e-4d78-8e90-d85d8ca91043 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:07.987395 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-225d75ec-682e-4d78-8e90-d85d8ca91043 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.017069 Apr 02 21:08:07.988343 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2048/4403] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:08:07 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:08.002223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-984555fb-61e9-420f-9c6d-62dcf4108025 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Action: 'create', calling method: .version_select at 0x7f54c7c1f700>, body: {"server_group": {"name": "tempest-server-group-262030920", "policies": ["affinity"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:08.038623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-984555fb-61e9-420f-9c6d-62dcf4108025 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:08.045180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-984555fb-61e9-420f-9c6d-62dcf4108025 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:08.101021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-984555fb-61e9-420f-9c6d-62dcf4108025 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:08.107001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-984555fb-61e9-420f-9c6d-62dcf4108025 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:08.123650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-984555fb-61e9-420f-9c6d-62dcf4108025 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.125329 Apr 02 21:08:08.124645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2356/4404] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Apr 2 21:08:07 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:08.135376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e40667a1-fdcb-456e-8814-c762dc1560a0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.163478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e40667a1-fdcb-456e-8814-c762dc1560a0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/85c8dff4-5e24-4c9b-891c-ac6774aee41c" status: 204 len: 0 microversion: 2.1 time: 0.032965 Apr 02 21:08:08.164254 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2049/4405] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:08 2022] DELETE /compute/v2.1/os-server-groups/85c8dff4-5e24-4c9b-891c-ac6774aee41c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:08.173157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3014d77f-8b37-4e25-8f99-7ca92e92c65a tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.187768 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3014d77f-8b37-4e25-8f99-7ca92e92c65a tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018672 Apr 02 21:08:08.189377 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2357/4406] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:08:08 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:08.201186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00e44278-9918-436e-baa0-12a8494fb6cb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Action: 'create', calling method: .version_select at 0x7f54c7ec1f70>, body: {"server_group": {"name": "tempest-server-group-886300795", "policies": ["anti-affinity"]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:08.217055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00e44278-9918-436e-baa0-12a8494fb6cb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:08.223188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00e44278-9918-436e-baa0-12a8494fb6cb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:08.274910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00e44278-9918-436e-baa0-12a8494fb6cb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:08.280733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-00e44278-9918-436e-baa0-12a8494fb6cb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_groups'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:08.297431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00e44278-9918-436e-baa0-12a8494fb6cb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.099888 Apr 02 21:08:08.299453 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2050/4407] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Apr 2 21:08:08 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:08.309166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2857c1a0-dd43-4773-be26-762ffc910999 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.344087 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2857c1a0-dd43-4773-be26-762ffc910999 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/e786faf5-1974-4fa1-b738-0fc039a42a6b" status: 204 len: 0 microversion: 2.1 time: 0.038084 Apr 02 21:08:08.345675 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2358/4408] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:08 2022] DELETE /compute/v2.1/os-server-groups/e786faf5-1974-4fa1-b738-0fc039a42a6b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:08.355852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89c6a472-d410-4b75-87f7-514f0f951046 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.367138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89c6a472-d410-4b75-87f7-514f0f951046 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.017009 Apr 02 21:08:08.368035 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2051/4409] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:08:08 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:08.431334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.431974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:08.440253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.441932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.443516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.444127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.496284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.496869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:08.503906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.504445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.505955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.506455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.532394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:08:08.617180 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72870f67-fd03-46be-9e4e-a17cb00b0236 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "DELETE /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 204 len: 0 microversion: 2.1 time: 0.122966 Apr 02 21:08:08.618243 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2052/4410] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:08:08 2022] DELETE /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:08:08.623975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-169551042", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "4d5a73db-037d-48be-8895-75089364a390"}]}, "os:scheduler_hints": {"group": "916b947c-a8c5-4589-80bd-f24f0ec2d75a"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:08.664348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:08.673468 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3cf0c972-b4fd-4b7c-996a-c3845aea4b09 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.246536 Apr 02 21:08:08.674571 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2359/4411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:08 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:08.679709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] validate_networks() for [('4d5a73db-037d-48be-8895-75089364a390', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:08:08.680434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.681212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:08.689321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.689779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.690614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.691002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.912709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:08.920671 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf27704d-09ae-4f1a-9e75-87aaff5b8749 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.244665 Apr 02 21:08:08.925231 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2360/4412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:08 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:08.942217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:08.943137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:08.955614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.958992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:08.959827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:08.965120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.119840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:09.129557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b5dd892-0fbf-493f-ae33-aa8e7614006e tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1503 microversion: 2.1 time: 0.202771 Apr 02 21:08:09.130731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2361/4413] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:08 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:09.288813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:08:09.290579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:08:09.291055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:08:09.291447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:08:09.292019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:08:09.313581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.314324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.315341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.315795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.342514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:09.352810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:09.371252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:08:09.375885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:08:09.422504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136517) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 02 21:08:09.446656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_group_members'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:09.454671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_group_members'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:09.503104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_group_members'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:09.509932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Getting quotas for user b4b018df5174476da8718bc8cf5ea96c and project 26c2ad88757e44dca408afd7d040112f. Resources: {'server_group_members'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:09.514915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e7d385b4-60b6-4470-bc56-0b90d3278318 req-6ce5b96a-cf59-45f8-97c0-bc1ad562749c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f06abe1-8723-4cef-87af-ecf16cc21db5", "name": "network-vif-plugged", "status": "completed", "tag": "ca836671-e4c3-48a2-a13b-3b83b10b9123"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:09.525832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e7d385b4-60b6-4470-bc56-0b90d3278318 req-6ce5b96a-cf59-45f8-97c0-bc1ad562749c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.526596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e7d385b4-60b6-4470-bc56-0b90d3278318 req-6ce5b96a-cf59-45f8-97c0-bc1ad562749c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.539472 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-467a7ec1-a951-4281-9c4d-7d82a9f833c8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919956 Apr 02 21:08:09.541036 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2053/4414] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:08:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:08:09.541716 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e7d385b4-60b6-4470-bc56-0b90d3278318 req-6ce5b96a-cf59-45f8-97c0-bc1ad562749c service nova] Creating event network-vif-plugged:ca836671-e4c3-48a2-a13b-3b83b10b9123 for instance 3f06abe1-8723-4cef-87af-ecf16cc21db5 on nch1-master-1 Apr 02 21:08:09.548649 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e7d385b4-60b6-4470-bc56-0b90d3278318 req-6ce5b96a-cf59-45f8-97c0-bc1ad562749c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039026 Apr 02 21:08:09.551992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5f90e40-392c-4c0b-bacd-f887ba8dedfb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:09.552848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5f90e40-392c-4c0b-bacd-f887ba8dedfb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:09.553086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2362/4415] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:09.618910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e5f90e40-392c-4c0b-bacd-f887ba8dedfb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:09.628045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5f90e40-392c-4c0b-bacd-f887ba8dedfb tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1212 microversion: 2.1 time: 0.080589 Apr 02 21:08:09.629291 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2054/4416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:09 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:09.696101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:09.696970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:09.705982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.706549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.707552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.709817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.892721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:09.903466 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c3c7fe7-eb17-4f89-a91c-c70b149c3bae tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.213842 Apr 02 21:08:09.904079 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2363/4417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:09 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:09.941737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:09.942656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:09.950255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.950732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:09.951527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:09.952115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:10.148040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:10.149174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:10.158834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:10.159309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:10.160072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:10.160695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:10.228239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:10.244834 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-97ca11a5-a129-4b5e-87b5-aa4aa9393bc6 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.307086 Apr 02 21:08:10.246046 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2055/4418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:09 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:10.332612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:10.341504 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e841f762-7520-4b20-a75a-076a3a4454b8 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1503 microversion: 2.1 time: 0.197728 Apr 02 21:08:10.342362 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2364/4419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:10 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:10.647362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:10.648649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:10.660817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:10.661757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:10.663697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:10.664704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:10.761946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:10.777773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49927f91-a888-436e-a3ac-4f5c3c41e864 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1264 microversion: 2.1 time: 0.134168 Apr 02 21:08:10.778406 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2056/4420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:10 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:10.919993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:10.921501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:10.932252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:10.933145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:10.934224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:10.934944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.210729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-16fe4215-8a88-4f77-ae0d-2ce0bb2a68d5 req-88bd0034-ba3f-4a88-a4cd-87c9be3fdce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208b3d58-e40e-4350-9f4d-0e979db4cadc", "name": "network-vif-deleted", "tag": "5a209f67-e99e-4f07-bc3b-151e8afba63f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:11.237959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-16fe4215-8a88-4f77-ae0d-2ce0bb2a68d5 req-88bd0034-ba3f-4a88-a4cd-87c9be3fdce0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.242748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-16fe4215-8a88-4f77-ae0d-2ce0bb2a68d5 req-88bd0034-ba3f-4a88-a4cd-87c9be3fdce0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.265143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-16fe4215-8a88-4f77-ae0d-2ce0bb2a68d5 req-88bd0034-ba3f-4a88-a4cd-87c9be3fdce0 service nova] Creating event network-vif-deleted:5a209f67-e99e-4f07-bc3b-151e8afba63f for instance 208b3d58-e40e-4350-9f4d-0e979db4cadc on nch1-master-1 Apr 02 21:08:11.281782 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-16fe4215-8a88-4f77-ae0d-2ce0bb2a68d5 req-88bd0034-ba3f-4a88-a4cd-87c9be3fdce0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076175 Apr 02 21:08:11.283002 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2057/4421] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:11.293087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:11.298084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:11.309503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.310328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.313352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.314652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.335080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:11.354320 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d7b7b83-8642-4679-974e-301a93d3e55d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.433191 Apr 02 21:08:11.355251 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2365/4422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:10 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:11.364663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:11.365593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:11.384363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.389073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.390252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.390952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.437567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.444736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.444736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lazy-loading 'fault' on Instance uuid 208b3d58-e40e-4350-9f4d-0e979db4cadc {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:08:11.490391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12e43a0a2994654a400b3a2bed83ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f54b2160309b4d76bd7a944454903520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:11.502946 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8cbb2790-6509-44e0-8918-7f1b56479962 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 200 len: 1303 microversion: 2.1 time: 0.144853 Apr 02 21:08:11.503830 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2366/4423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:11 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:11.565531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-056047e4-2102-4826-8f7c-5407f1468a8d req-2ace34f5-64ff-48a1-88f6-17351aabb995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da1fde6-a875-46d3-b37c-48141af6c351", "name": "network-vif-plugged", "status": "completed", "tag": "b0db797e-0c06-416a-9943-2bde82ea66bd"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:11.575327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-056047e4-2102-4826-8f7c-5407f1468a8d req-2ace34f5-64ff-48a1-88f6-17351aabb995 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.575776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-056047e4-2102-4826-8f7c-5407f1468a8d req-2ace34f5-64ff-48a1-88f6-17351aabb995 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.590305 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-056047e4-2102-4826-8f7c-5407f1468a8d req-2ace34f5-64ff-48a1-88f6-17351aabb995 service nova] Creating event network-vif-plugged:b0db797e-0c06-416a-9943-2bde82ea66bd for instance 0da1fde6-a875-46d3-b37c-48141af6c351 on nch2-master-1 Apr 02 21:08:11.595933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-056047e4-2102-4826-8f7c-5407f1468a8d req-2ace34f5-64ff-48a1-88f6-17351aabb995 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035249 Apr 02 21:08:11.597302 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2367/4424] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:11.796854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:11.797697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:11.808952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.810906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.811164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:11.814354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:11.817094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:11.826264 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bfa93365-9263-4c80-8fed-71a9f395c2c1 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.541713 Apr 02 21:08:11.829180 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2058/4425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:11 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:11.927604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:11.939684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e5f420b-f514-4e33-9aa0-0e1c68d4ad3e tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1270 microversion: 2.1 time: 0.148063 Apr 02 21:08:11.940805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2368/4426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:11 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:12.375659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:12.376655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:12.384967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.385862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.387093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.387974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.523892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:12.525094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] [instance: 208b3d58-e40e-4350-9f4d-0e979db4cadc] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:12.534741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.536006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.537564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.538258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.572137 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] HTTP exception thrown: Instance 208b3d58-e40e-4350-9f4d-0e979db4cadc could not be found. Apr 02 21:08:12.573651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] Returning 404 to user: Instance 208b3d58-e40e-4350-9f4d-0e979db4cadc could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:12.574793 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c79d47c-36ba-43a2-9a5d-df30c0cb8e44 tempest-VolumesActionsTest-1651102816 tempest-VolumesActionsTest-1651102816-project] 10.222.0.18 "GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc" status: 404 len: 111 microversion: 2.1 time: 0.057107 Apr 02 21:08:12.576545 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2369/4427] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:12 2022] GET /compute/v2.1/servers/208b3d58-e40e-4350-9f4d-0e979db4cadc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:12.732125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:12.744606 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fefd9278-4a8b-4293-830a-91c9aad7c691 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.373929 Apr 02 21:08:12.756342 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2059/4428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:12 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:12.847378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:12.848005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:12.864212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.865646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.867396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.869645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.965034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:12.965823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:12.973266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.973753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:12.974692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:12.975165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:13.221380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:13.233684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6735ee03-09d1-42b4-91df-556b381546e4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1320 microversion: 2.1 time: 0.390805 Apr 02 21:08:13.243201 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2370/4429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:12 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:13.271161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:13.285069 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5923f474-4294-4250-914b-27a3e65e03d6 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.329892 Apr 02 21:08:13.285854 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2060/4430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:12 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:13.711859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-267b106b-ef76-436d-96db-21bc4d27d5f5 req-196fee13-6d3c-4955-9ba5-e25e5c87f6fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1027fad3-657a-46d6-bf7f-464a65a29b13", "tag": "d9f4bba9-6424-4d62-9080-aee1431675bb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:13.741355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-267b106b-ef76-436d-96db-21bc4d27d5f5 req-196fee13-6d3c-4955-9ba5-e25e5c87f6fa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:13.741950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-267b106b-ef76-436d-96db-21bc4d27d5f5 req-196fee13-6d3c-4955-9ba5-e25e5c87f6fa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:13.760072 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-267b106b-ef76-436d-96db-21bc4d27d5f5 req-196fee13-6d3c-4955-9ba5-e25e5c87f6fa service nova] Creating event network-changed:d9f4bba9-6424-4d62-9080-aee1431675bb for instance 1027fad3-657a-46d6-bf7f-464a65a29b13 on nch1-master-1 Apr 02 21:08:13.764236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:13.764420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:13.767533 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-267b106b-ef76-436d-96db-21bc4d27d5f5 req-196fee13-6d3c-4955-9ba5-e25e5c87f6fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059921 Apr 02 21:08:13.768210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2371/4431] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:13.773654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:13.774156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:13.775056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:13.775645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.084874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:14.100760 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c19190f-4a50-4c16-80c3-940e0e655896 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.341496 Apr 02 21:08:14.101697 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2061/4432] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:13 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:14.254609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:14.255477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:14.271073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.274498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.275915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.285359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.306346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:14.307406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:14.341977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.344801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.345947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.347568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.633045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:14.666461 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5ac58aa-31d8-440f-9b9c-e023afe03d2b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1511 microversion: 2.1 time: 0.416506 Apr 02 21:08:14.681749 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2372/4433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:14 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:14.695196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:14.696949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:14.708242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.711355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.713066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.713772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.737983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:14.752944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e33fec8-08a4-4303-bd6c-67a0a43c0a37 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.452244 Apr 02 21:08:14.765182 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2062/4434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:14 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:14.950285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6ba8fb8d-652a-49da-865e-7b6f52ed2c49 req-785224c7-b442-4790-ac47-f5b4a60b116f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36", "name": "network-vif-plugged", "status": "completed", "tag": "96ce7472-2a62-45dc-8a1e-fe0e2262b5aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:14.963773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6ba8fb8d-652a-49da-865e-7b6f52ed2c49 req-785224c7-b442-4790-ac47-f5b4a60b116f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:14.964282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6ba8fb8d-652a-49da-865e-7b6f52ed2c49 req-785224c7-b442-4790-ac47-f5b4a60b116f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:14.990258 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6ba8fb8d-652a-49da-865e-7b6f52ed2c49 req-785224c7-b442-4790-ac47-f5b4a60b116f service nova] Creating event network-vif-plugged:96ce7472-2a62-45dc-8a1e-fe0e2262b5aa for instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 on nch2-master-1 Apr 02 21:08:15.021613 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6ba8fb8d-652a-49da-865e-7b6f52ed2c49 req-785224c7-b442-4790-ac47-f5b4a60b116f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079458 Apr 02 21:08:15.022526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2063/4435] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:15.087322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:15.100247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0796f6fc-a0d4-44c3-9349-2908a9e88bad tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1512 microversion: 2.1 time: 0.414962 Apr 02 21:08:15.101578 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2373/4436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:14 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:15.118971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:15.120362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:15.137336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.137679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:15.138716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:15.142044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.143153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.144365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.152207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.152692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.159541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.162182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.500579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:15.511930 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31a4fb2f-77a0-4d54-9fb7-d5f1745b9834 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.387696 Apr 02 21:08:15.513439 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2374/4437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:15 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:15.612579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:15.621410 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-484f6bf4-d742-4eea-a42f-88602c6becfd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 200 len: 1512 microversion: 2.1 time: 0.507074 Apr 02 21:08:15.626458 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2064/4438] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:15 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:15.643056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:15.648173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:15.649565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:15.666056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.666604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.667590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.668058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.772583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:15.773746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:15.778104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:15.788080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.790625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.792245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.792804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:15.866299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:15.873916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:15.874400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.129746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:16.139758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-28c65513-8ba5-4634-8078-a3b4d6cc45bd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.371533 Apr 02 21:08:16.150875 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2065/4439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:15 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:16.162861 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e341dcf-a170-4129-9d26-9182248a0be4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.523718 Apr 02 21:08:16.163621 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2375/4440] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 21:08:15 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:16.188220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:16.196922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:16.199097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1700778975', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:16.208636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.209645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.210703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.211571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.358741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:16.450773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:16.467009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.467009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.532262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:16.533027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:16.548746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.549659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.550927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.553484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.682345 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b70157a8-f06a-45ff-96bf-9008714e3cda tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1700778975" status: 200 len: 1515 microversion: 2.1 time: 0.502906 Apr 02 21:08:16.683768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2066/4441] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:08:16 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1700778975 => generated 1515 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:16.711807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:16.711807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:16.711807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:16.717302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.717878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.718895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.719524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:16.834839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:16.845763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:16.872508 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4693d65a-2232-40d1-8960-95dae642f1ba tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1367 microversion: 2.1 time: 0.344722 Apr 02 21:08:16.874345 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2376/4442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:16 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:16.930945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:16.939944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:16.940699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.157349 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3014b94c-ec87-4f55-b225-7ddf20a77a4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.459670 Apr 02 21:08:17.158306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2067/4443] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Apr 2 21:08:16 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:17.162100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:17.163886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:17.170481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.171386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.172422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.173165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.178355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:17.182392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:17.186609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.servers [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Removing options 'limit' from query {{(pid=136517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 02 21:08:17.187675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:17.202014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.202780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.203814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.204564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.287362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:17.298610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.299080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.501946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:17.512144 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c9229b3-1b4d-4f00-8c6f-aa73043d00d1 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.357929 Apr 02 21:08:17.513566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2377/4444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:17 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:17.570846 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-00c5483d-ed02-4ed8-a8fa-9f05769f6a32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.396172 Apr 02 21:08:17.571694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2068/4445] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 21:08:17 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:17.590522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:17.597072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:17.599812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:17.608293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.609123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.610162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.610813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.792316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:17.885119 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-677256f3-d408-4c75-a1aa-07fffdb39d89 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.298713 Apr 02 21:08:17.886070 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2378/4446] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:08:17 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:17.904862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:17.908357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:17.911807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:17.916724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:17.917184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.servers [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Removing options 'limit' from query {{(pid=136517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 02 21:08:17.917894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:17.918629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.919944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.921047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.922206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.955873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.961364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:17.962587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:17.963446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.018398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:18.064152 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb7e37f9-464e-44a3-9fd5-00cb3a6fd694 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.163548 Apr 02 21:08:18.067929 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2069/4447] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Apr 2 21:08:17 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:18.087373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:18.095230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:18.096573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:18.103765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.104551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.106610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.107349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.155048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:18.229886 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6da976d2-4b40-4547-ae3c-abe0bc5d4f1a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.154816 Apr 02 21:08:18.233137 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2070/4448] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:08:18 2022] GET /compute/v2.1/servers => generated 1010 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:18.259624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:18.267838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:18.269183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:18.286917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.287988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.288147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:18.289538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.290468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.299869 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-37d01316-128c-40c4-b978-9c0363b46e45 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1558 microversion: 2.1 time: 0.400942 Apr 02 21:08:18.305509 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2379/4449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:17 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1558 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:18.328236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:18.333229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:18.359447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.360215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.361262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.361877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.495141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:18.530916 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4962b24e-3f28-4f0a-8d7f-6f4db9187582 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212982 Apr 02 21:08:18.531600 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2380/4450] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:08:18 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:18.537003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:18.537811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:18.552970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.553782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.554836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.556978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.624668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60f956fa-7358-45da-9f4d-6b300012c3a2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.371811 Apr 02 21:08:18.625875 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2071/4451] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:08:18 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:18.647426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:18.658195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:18.662359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.servers [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Removing options 'limit' from query {{(pid=136517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 02 21:08:18.663410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:18.676223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.680191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.682832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.685721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.753389 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e8cc4f6-ea9d-4878-b65d-0ceef6498b73 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.113595 Apr 02 21:08:18.766200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2072/4452] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Apr 2 21:08:18 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:18.789954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:18.793912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:18.794395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1700778975', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:18.811306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.812773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.812773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:18.813131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:18.855193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:18.872480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70977f26-2e62-4eb1-b2d7-02bce0059703 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.339427 Apr 02 21:08:18.873803 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2381/4453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:18 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:18.961092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:19.029799 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e373113-e413-47d3-8b7d-70c72ea854d2 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1700778975" status: 200 len: 346 microversion: 2.1 time: 0.262362 Apr 02 21:08:19.030743 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2073/4454] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:08:18 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1700778975 => generated 346 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:19.043791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c79522a2-fe3c-4284-ba05-4d9b407b9b6b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:19.059482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79522a2-fe3c-4284-ba05-4d9b407b9b6b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:19.060226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c79522a2-fe3c-4284-ba05-4d9b407b9b6b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:19.105272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c79522a2-fe3c-4284-ba05-4d9b407b9b6b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Going to try to stop instance {{(pid=136518) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:08:19.210803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c79522a2-fe3c-4284-ba05-4d9b407b9b6b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "POST /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5/action" status: 202 len: 0 microversion: 2.1 time: 0.169574 Apr 02 21:08:19.216226 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2382/4455] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:08:19 2022] POST /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:08:19.222936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:19.224810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:19.241326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:19.242532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:19.243628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:19.244201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:19.699125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:19.710260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9c77232-1e2c-41b9-9b59-59eed1dd356c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.492493 Apr 02 21:08:19.721337 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2074/4456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:19 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:19.897030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:19.899374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:19.909915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:19.912151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:19.913414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:19.914233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:20.115918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:20.142068 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8fb311f-e060-432a-b12c-2b5dfff8fef0 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.255163 Apr 02 21:08:20.143439 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2383/4457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:19 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:20.687921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e03700e8-3f66-4170-b3ec-4083312c9611 req-8dae80d7-787a-4f9f-b1c1-fc0231f45fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36", "tag": "96ce7472-2a62-45dc-8a1e-fe0e2262b5aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:20.704159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e03700e8-3f66-4170-b3ec-4083312c9611 req-8dae80d7-787a-4f9f-b1c1-fc0231f45fb4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:20.704652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e03700e8-3f66-4170-b3ec-4083312c9611 req-8dae80d7-787a-4f9f-b1c1-fc0231f45fb4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:20.719696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e03700e8-3f66-4170-b3ec-4083312c9611 req-8dae80d7-787a-4f9f-b1c1-fc0231f45fb4 service nova] Creating event network-changed:96ce7472-2a62-45dc-8a1e-fe0e2262b5aa for instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 on nch2-master-1 Apr 02 21:08:20.728224 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e03700e8-3f66-4170-b3ec-4083312c9611 req-8dae80d7-787a-4f9f-b1c1-fc0231f45fb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046103 Apr 02 21:08:20.730073 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2075/4458] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:20.733077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:20.733710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:20.740649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:20.741316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:20.742276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:20.742982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:21.160593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:21.161894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:21.173536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:21.177708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:21.178834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:21.179720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:21.234225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:21.245958 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-63591f4c-1fbf-4b6d-b643-c2fa12534e03 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.520275 Apr 02 21:08:21.249931 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2384/4459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:20 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:21.709744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:21.726092 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2cf841e5-061c-40d6-9ffc-15f4f5ab6377 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.569909 Apr 02 21:08:21.728400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2076/4460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:21 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:21.920261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e8de07d4-24ce-4385-a28c-10e9cf1866f3 req-85679676-04c1-448e-a8a8-51cbfc5d8db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1027fad3-657a-46d6-bf7f-464a65a29b13", "name": "network-vif-plugged", "status": "completed", "tag": "d9f4bba9-6424-4d62-9080-aee1431675bb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:21.944354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8de07d4-24ce-4385-a28c-10e9cf1866f3 req-85679676-04c1-448e-a8a8-51cbfc5d8db9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:21.945260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8de07d4-24ce-4385-a28c-10e9cf1866f3 req-85679676-04c1-448e-a8a8-51cbfc5d8db9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:21.994232 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e8de07d4-24ce-4385-a28c-10e9cf1866f3 req-85679676-04c1-448e-a8a8-51cbfc5d8db9 service nova] Creating event network-vif-plugged:d9f4bba9-6424-4d62-9080-aee1431675bb for instance 1027fad3-657a-46d6-bf7f-464a65a29b13 on nch1-master-1 Apr 02 21:08:22.012677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e8de07d4-24ce-4385-a28c-10e9cf1866f3 req-85679676-04c1-448e-a8a8-51cbfc5d8db9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097950 Apr 02 21:08:22.015978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2385/4461] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:22.264856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:22.265513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:22.278401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:22.278771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:22.279603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:22.280149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:22.559806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:22.570115 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ba9eaf4-38e7-450c-8235-270028a837e8 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.309377 Apr 02 21:08:22.572448 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2077/4462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:22 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:22.746846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:22.748383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:22.756951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:22.760925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:22.761984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:22.762618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:23.175023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:23.194695 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e37ab9a8-46d9-445d-8079-d6c1bf74b4f5 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1312 microversion: 2.1 time: 0.451562 Apr 02 21:08:23.201849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2386/4463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:22 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1312 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:23.591730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:23.595082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:23.603238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:23.603696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:23.604515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:23.605284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:23.791964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:23.801387 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e9eb561-a184-4103-8b6a-2c559a1de010 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.215540 Apr 02 21:08:23.803293 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2078/4464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:23 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:24.221422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:24.223063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:24.237962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:24.240187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:24.241912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:24.244837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:24.821061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:24.822717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:24.840299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:24.841169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:24.842290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:24.842752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:24.866594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:24.885697 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-52786b1f-fa8a-4fc5-9cd5-8f46a8426273 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1497 microversion: 2.1 time: 0.671652 Apr 02 21:08:24.896484 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2387/4465] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:24 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1497 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:24.917424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3065bbd2-1a5e-40d2-bb50-0487d6e98537 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:24.941507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_groups [None req-3065bbd2-1a5e-40d2-bb50-0487d6e98537 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Querying cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) for 1 instances {{(pid=136518) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 02 21:08:24.943341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3065bbd2-1a5e-40d2-bb50-0487d6e98537 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:24.944166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3065bbd2-1a5e-40d2-bb50-0487d6e98537 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:24.972160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3065bbd2-1a5e-40d2-bb50-0487d6e98537 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/916b947c-a8c5-4589-80bd-f24f0ec2d75a" status: 200 len: 221 microversion: 2.1 time: 0.064998 Apr 02 21:08:24.973150 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2388/4466] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:08:24 2022] GET /compute/v2.1/os-server-groups/916b947c-a8c5-4589-80bd-f24f0ec2d75a => generated 221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:24.985236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:24.986142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:25.003700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:25.004437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:25.005794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:25.006412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:25.059140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:08:25.274161 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4af941ce-0dbe-4334-b88b-077f6d490cd2 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 204 len: 0 microversion: 2.1 time: 0.292750 Apr 02 21:08:25.275583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2389/4467] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:08:24 2022] DELETE /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:25.293535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:25.295522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:25.304939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:25.305558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:25.306573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:25.308408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:25.477349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:25.493616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:25.502853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d62689ce-8066-40fe-9bea-d70e52ceced0 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.687017 Apr 02 21:08:25.504094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2079/4468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:24 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:25.510147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c679e7b5-ae08-426e-b6c3-ea430563cf71 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1503 microversion: 2.1 time: 0.227571 Apr 02 21:08:25.510983 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2390/4469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:25 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:26.528840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:26.529562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:26.539402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:26.546038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:26.562815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:26.564183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:26.570768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:26.572437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:26.575326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:26.576675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:26.600447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:26.602829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:26.832204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:26.846677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d6d2c06-8626-449a-96a1-1ad74bed1cf7 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1503 microversion: 2.1 time: 0.322623 Apr 02 21:08:26.859935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2391/4470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:26 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:27.026519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:27.038911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-18651855-4592-4aea-bf7e-b19f40fff09a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.521958 Apr 02 21:08:27.043116 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2080/4471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:26 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:27.812302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-6f46565c-ae6e-4f5d-bc0a-f83335a25fd2 req-e2e2032d-9117-40db-b1d9-12a4f72c9bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1027fad3-657a-46d6-bf7f-464a65a29b13", "name": "network-vif-deleted", "tag": "d9f4bba9-6424-4d62-9080-aee1431675bb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:27.825494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6f46565c-ae6e-4f5d-bc0a-f83335a25fd2 req-e2e2032d-9117-40db-b1d9-12a4f72c9bec service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:27.826373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6f46565c-ae6e-4f5d-bc0a-f83335a25fd2 req-e2e2032d-9117-40db-b1d9-12a4f72c9bec service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:27.843801 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-6f46565c-ae6e-4f5d-bc0a-f83335a25fd2 req-e2e2032d-9117-40db-b1d9-12a4f72c9bec service nova] Creating event network-vif-deleted:d9f4bba9-6424-4d62-9080-aee1431675bb for instance 1027fad3-657a-46d6-bf7f-464a65a29b13 on nch1-master-1 Apr 02 21:08:27.860063 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-6f46565c-ae6e-4f5d-bc0a-f83335a25fd2 req-e2e2032d-9117-40db-b1d9-12a4f72c9bec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047498 Apr 02 21:08:27.861226 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2392/4472] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:27.877303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:27.883777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:27.922322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:27.924843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:27.927245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:27.927979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:28.061342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:28.062336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:28.087520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:28.088854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:28.090906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:28.094747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:28.207912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b018df5174476da8718bc8cf5ea96c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26c2ad88757e44dca408afd7d040112f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:28.233421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c87f694-690d-40f8-becc-95c492d0d356 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 200 len: 1297 microversion: 2.1 time: 0.369994 Apr 02 21:08:28.235403 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2081/4473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:27 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 1297 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:28.560729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:28.567503 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f45b5d7-bd9e-4902-96fc-60697069309b tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.510788 Apr 02 21:08:28.568090 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2393/4474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:28 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:29.258791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.259461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:29.271706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.273706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.281616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.282434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.312352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance 1027fad3-657a-46d6-bf7f-464a65a29b13 could not be found. Apr 02 21:08:29.313687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance 1027fad3-657a-46d6-bf7f-464a65a29b13 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.314768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04d2c279-02fd-426e-b58a-7e4e88061b53 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 404 len: 111 microversion: 2.1 time: 0.065456 Apr 02 21:08:29.319715 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2082/4475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:29 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.342214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87d4f82c-c5fb-45b9-9c81-c812b1d12e45 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.373928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_groups [None req-87d4f82c-c5fb-45b9-9c81-c812b1d12e45 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Querying cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) for 1 instances {{(pid=136518) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 02 21:08:29.376902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87d4f82c-c5fb-45b9-9c81-c812b1d12e45 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.377343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87d4f82c-c5fb-45b9-9c81-c812b1d12e45 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.396145 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87d4f82c-c5fb-45b9-9c81-c812b1d12e45 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.058208 Apr 02 21:08:29.397211 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2394/4476] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:08:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:29.421725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-661b5d16-bfa7-48d9-9d2c-6122e980dccd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.440811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.server_groups [None req-661b5d16-bfa7-48d9-9d2c-6122e980dccd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Querying cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) for 1 instances {{(pid=136517) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 02 21:08:29.441705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-661b5d16-bfa7-48d9-9d2c-6122e980dccd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.442767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-661b5d16-bfa7-48d9-9d2c-6122e980dccd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.456118 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-661b5d16-bfa7-48d9-9d2c-6122e980dccd tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/916b947c-a8c5-4589-80bd-f24f0ec2d75a" status: 200 len: 183 microversion: 2.1 time: 0.044454 Apr 02 21:08:29.457286 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2083/4477] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:08:29 2022] GET /compute/v2.1/os-server-groups/916b947c-a8c5-4589-80bd-f24f0ec2d75a => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:29.469248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.470141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:29.482756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.483556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.485210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.486016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.501245 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance 1027fad3-657a-46d6-bf7f-464a65a29b13 could not be found. Apr 02 21:08:29.502091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance 1027fad3-657a-46d6-bf7f-464a65a29b13 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.503130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2c6ef13-8b50-4d6b-a05f-de63a6413d54 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 404 len: 111 microversion: 2.1 time: 0.038723 Apr 02 21:08:29.504100 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2395/4478] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:08:29 2022] DELETE /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.513630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.515378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] [instance: 1027fad3-657a-46d6-bf7f-464a65a29b13] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:29.523088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.523817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.525255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.526058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.555861 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance 1027fad3-657a-46d6-bf7f-464a65a29b13 could not be found. Apr 02 21:08:29.557273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance 1027fad3-657a-46d6-bf7f-464a65a29b13 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.560524 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e49c60cd-ebfe-412f-a4fe-76bc29ce9271 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13" status: 404 len: 111 microversion: 2.1 time: 0.050588 Apr 02 21:08:29.562724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2084/4479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:29 2022] GET /compute/v2.1/servers/1027fad3-657a-46d6-bf7f-464a65a29b13 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.573991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f466e226-8729-4223-bdd7-95c67e5a3e05 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.583153 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f466e226-8729-4223-bdd7-95c67e5a3e05 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance group e786faf5-1974-4fa1-b738-0fc039a42a6b could not be found. Apr 02 21:08:29.584843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f466e226-8729-4223-bdd7-95c67e5a3e05 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance group e786faf5-1974-4fa1-b738-0fc039a42a6b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.586393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f466e226-8729-4223-bdd7-95c67e5a3e05 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/e786faf5-1974-4fa1-b738-0fc039a42a6b" status: 404 len: 117 microversion: 2.1 time: 0.017786 Apr 02 21:08:29.587372 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2396/4480] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:29 2022] DELETE /compute/v2.1/os-server-groups/e786faf5-1974-4fa1-b738-0fc039a42a6b => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.590241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.591916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:29.599295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21033cf7-2395-4f25-9e67-f8a0afa1f73d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.603553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.604650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.607444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:29.608496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:29.616075 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-21033cf7-2395-4f25-9e67-f8a0afa1f73d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance group 85c8dff4-5e24-4c9b-891c-ac6774aee41c could not be found. Apr 02 21:08:29.621811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21033cf7-2395-4f25-9e67-f8a0afa1f73d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance group 85c8dff4-5e24-4c9b-891c-ac6774aee41c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.623461 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21033cf7-2395-4f25-9e67-f8a0afa1f73d tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/85c8dff4-5e24-4c9b-891c-ac6774aee41c" status: 404 len: 117 microversion: 2.1 time: 0.031880 Apr 02 21:08:29.626705 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2397/4481] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:29 2022] DELETE /compute/v2.1/os-server-groups/85c8dff4-5e24-4c9b-891c-ac6774aee41c => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.636028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d460f93c-8b1b-41d1-99f1-f132bf7381a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.654676 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d460f93c-8b1b-41d1-99f1-f132bf7381a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance group 56b71fa0-5fcf-435a-b5c1-343d611a878a could not be found. Apr 02 21:08:29.655267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d460f93c-8b1b-41d1-99f1-f132bf7381a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance group 56b71fa0-5fcf-435a-b5c1-343d611a878a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.657584 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d460f93c-8b1b-41d1-99f1-f132bf7381a8 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/56b71fa0-5fcf-435a-b5c1-343d611a878a" status: 404 len: 117 microversion: 2.1 time: 0.025167 Apr 02 21:08:29.663525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2398/4482] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:29 2022] DELETE /compute/v2.1/os-server-groups/56b71fa0-5fcf-435a-b5c1-343d611a878a => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.682908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67db0b3e-f2c8-4df1-9734-b84e0de43622 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.706536 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-67db0b3e-f2c8-4df1-9734-b84e0de43622 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] HTTP exception thrown: Instance group 2ff3820e-0113-49f1-acc9-3f237d3d66b9 could not be found. Apr 02 21:08:29.707360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67db0b3e-f2c8-4df1-9734-b84e0de43622 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Returning 404 to user: Instance group 2ff3820e-0113-49f1-acc9-3f237d3d66b9 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:29.717161 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67db0b3e-f2c8-4df1-9734-b84e0de43622 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/2ff3820e-0113-49f1-acc9-3f237d3d66b9" status: 404 len: 117 microversion: 2.1 time: 0.041579 Apr 02 21:08:29.718358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2399/4483] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:29 2022] DELETE /compute/v2.1/os-server-groups/2ff3820e-0113-49f1-acc9-3f237d3d66b9 => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:29.731183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95bddc86-96fe-49c5-95ca-9df8b7c98637 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:29.778817 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95bddc86-96fe-49c5-95ca-9df8b7c98637 tempest-ServerGroupTestJSON-25945447 tempest-ServerGroupTestJSON-25945447-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/916b947c-a8c5-4589-80bd-f24f0ec2d75a" status: 204 len: 0 microversion: 2.1 time: 0.051883 Apr 02 21:08:29.779659 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2400/4484] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:08:29 2022] DELETE /compute/v2.1/os-server-groups/916b947c-a8c5-4589-80bd-f24f0ec2d75a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:29.836702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:29.850533 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-29dc36f1-447b-43b5-9ced-42c1cbf0de54 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.267460 Apr 02 21:08:29.852233 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2085/4485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:29 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:30.876234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:30.877035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:30.891737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:30.892977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:30.894499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:30.895259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:31.111942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:31.128049 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f28c63bb-11dd-4e1b-8337-ec43702e3196 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.257730 Apr 02 21:08:31.129175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2401/4486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:30 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:32.146122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:32.147404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:32.155532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:32.156638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:32.166741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:32.171820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:33.132484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:33.147848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d17adeb7-08dd-4a7b-ae12-2c6920862f49 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 1.003429 Apr 02 21:08:33.151282 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2086/4487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:32 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:34.168117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:34.168870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:34.191368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:34.192819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:34.194505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:34.195249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:34.839061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:34.847243 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b80a422c-b254-49b0-8ea6-5ddb44696ab7 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.684136 Apr 02 21:08:34.858920 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2402/4488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:34 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:35.866458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:35.867054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:35.880940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:35.881571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:35.882216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:35.882672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:36.461186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:36.473780 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d593ee58-1973-4c58-8d55-581698e732aa tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.610497 Apr 02 21:08:36.489839 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2087/4489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:35 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:37.496229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:37.497665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:37.513594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:37.526525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:37.529966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:37.536723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:38.036416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:38.046745 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03c48781-f9a3-463d-a066-95bf2a1e1269 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.554218 Apr 02 21:08:38.047367 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2403/4490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:37 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:39.065225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:39.067993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:39.089708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:39.094301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:39.095484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:39.096266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:39.465043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:39.466522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:39.478501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:39.479402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:39.481194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:39.481980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:39.862926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:39.891245 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0ca627a-b2ca-4d99-a198-e11e3f353f29 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1522 microversion: 2.1 time: 0.830546 Apr 02 21:08:39.907117 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2088/4491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:39 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1522 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:40.538292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:40.555561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:40.560496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:40.571994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5990d971-b07c-484d-a799-dd61a63a7697 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2954 microversion: 2.42 time: 1.111708 Apr 02 21:08:40.589580 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2404/4492] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:08:39 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2954 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:08:40.618535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:40.625631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:40.634287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:40.635105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:40.636624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:40.638501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:40.917616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:40.920000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:40.961711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:40.962187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:40.966790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:40.971361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:41.065550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5097bef-44f0-4399-a7dc-12050cbe3434 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.459820 Apr 02 21:08:41.078355 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2089/4493] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Apr 2 21:08:40 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746/os-interface => generated 1831 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:08:41.603254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:41.615436 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67950e4f-6df3-468f-829b-a355eacbcf47 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1499 microversion: 2.1 time: 0.708897 Apr 02 21:08:41.629245 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2405/4494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:40 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1499 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:41.635639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:41.649710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:41.653789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:41.671112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:41.674995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:41.678811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:41.679689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:41.726173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:41.769077 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f11cf8c6-0406-47c4-a913-f731449276d3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.138333 Apr 02 21:08:41.784364 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2090/4495] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Apr 2 21:08:41 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:41.799923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba5c7417-eea0-4a29-946a-e81240e2e41e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:41.822632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5c7417-eea0-4a29-946a-e81240e2e41e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:41.823439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5c7417-eea0-4a29-946a-e81240e2e41e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:41.881877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba5c7417-eea0-4a29-946a-e81240e2e41e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Going to try to start instance {{(pid=136518) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:08:41.991442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba5c7417-eea0-4a29-946a-e81240e2e41e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "POST /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5/action" status: 202 len: 0 microversion: 2.1 time: 0.196367 Apr 02 21:08:41.995724 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2406/4496] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:08:41 2022] POST /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:08:42.005143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:42.005766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:42.015594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:42.016054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:42.016954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:42.017342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:42.448147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:42.462889 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23703aa2-4860-44bd-95dc-f2b6e0dc8c6d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1508 microversion: 2.1 time: 0.462322 Apr 02 21:08:42.463487 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2091/4497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:41 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:43.060026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-327134963", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:43.127931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] validate_networks() for [('fd76cca2-af28-4582-8f95-9239b6ffeadc', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:08:43.488961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:43.490198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:43.503960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:43.509062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:43.509930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:43.510393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:43.775050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:43.791215 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-495cd825-237d-406f-863f-5de7e30ff52d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1508 microversion: 2.1 time: 0.314283 Apr 02 21:08:43.793107 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2092/4498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:43 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:44.402114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:08:44.403257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:08:44.403924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:08:44.404682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:08:44.405108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:08:44.420783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:44.432246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:44.433898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:44.434560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:44.476636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Getting quotas for project bcc988d584ef47dd99506305e1c7d45a. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:08:44.485327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Getting quotas for user 20f75a3bb7e8417791babaae0fda1c39 and project bcc988d584ef47dd99506305e1c7d45a. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:08:44.509459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:08:44.514286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:08:44.610774 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36bf98b2-8db5-4279-a99e-f1cccc2b2485 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.748909 Apr 02 21:08:44.614589 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2407/4499] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:08:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:08:44.626866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-70885f67-a769-4e32-bf0d-0a6490b2ef25 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:44.627583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-70885f67-a769-4e32-bf0d-0a6490b2ef25 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:44.729352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-70885f67-a769-4e32-bf0d-0a6490b2ef25 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:44.739630 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-70885f67-a769-4e32-bf0d-0a6490b2ef25 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1222 microversion: 2.1 time: 0.118153 Apr 02 21:08:44.742359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2093/4500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:44 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1222 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:44.812328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:44.813353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:44.826459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:44.826934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:44.834769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:44.845698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.272680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:45.282088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a4922b6-083d-46e4-80e6-0fa44d58eb65 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1512 microversion: 2.1 time: 0.475562 Apr 02 21:08:45.298704 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2408/4501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:44 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:45.307380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:45.314404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:45.315296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.compute.servers [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Removing options 'limit' from query {{(pid=136517) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 02 21:08:45.318919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:45.321542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.322402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.323505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.324926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.327281 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-162535cc-ddd5-428b-8c24-12d90c997c69 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.026149 Apr 02 21:08:45.328726 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2094/4502] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Apr 2 21:08:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:08:45.342010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:45.342664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:45.353753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.356187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.357247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.358713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.741164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:45.756659 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06ca05fa-4e24-41b4-b005-d8260dc8c179 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1512 microversion: 2.1 time: 0.417358 Apr 02 21:08:45.770569 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2409/4503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:45 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:45.778946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:45.780214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:45.781756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:45.783732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:45.801077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.801893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.802941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.803665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.825043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.825543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.826688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:45.827406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:45.937406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:45.949747 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0988aa07-5920-4b98-8f45-5681f4af4b26 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1274 microversion: 2.1 time: 0.192729 Apr 02 21:08:45.951984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2095/4504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:45 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:46.304551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:46.325893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a88be809-47a7-4d03-add4-92d61148444c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 200 len: 1512 microversion: 2.1 time: 0.547794 Apr 02 21:08:46.326735 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2410/4505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:45 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:46.350037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:46.351009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:46.371452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:46.375034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:46.376092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:46.376580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:46.726675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:46.744272 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f7c45bee-d160-400e-92f8-f86b4d8dc45c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1511 microversion: 2.1 time: 0.400496 Apr 02 21:08:46.745309 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2096/4506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:46 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:46.763532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:46.767506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:46.771122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:46.972011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:46.973032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:46.987588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:46.988152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:46.991857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:46.993182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:47.096545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:47.108167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:47.108662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:47.109705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:47.110363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:47.110646 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51763624-b077-4129-bc8b-648bae87696f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1280 microversion: 2.1 time: 0.145172 Apr 02 21:08:47.124395 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2097/4507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:46 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:47.298351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:47.406125 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a331e7c6-aac9-447c-ab50-a27b3dec4007 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.639228 Apr 02 21:08:47.407305 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2411/4508] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Apr 2 21:08:46 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:47.421404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:47.421748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:47.430301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:47.431590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:47.434785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:47.435611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:47.659344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:47.672648 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f17a8cfa-6019-4eba-977b-5b07637656bc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1512 microversion: 2.1 time: 0.254989 Apr 02 21:08:47.674146 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2098/4509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:47 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:47.699553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:47.701270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:47.713305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:47.716094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:47.718012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:47.718721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:48.128034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:48.128751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:48.142020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:48.145359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:48.146464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:48.147499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:48.153679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:48.165578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9acd38d8-3596-45a6-bf24-fe2aee35c8af tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 200 len: 1512 microversion: 2.1 time: 0.476484 Apr 02 21:08:48.166173 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2412/4510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:47 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:48.185533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:48.186598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:48.201746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:48.203193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:48.204780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:48.206707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:48.515024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:48.532737 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-265d753d-4c8a-4778-a262-c54c0e06989f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.408188 Apr 02 21:08:48.547447 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2099/4511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:48 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:49.400970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:49.412934 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1b4ba08-26ac-4601-8ab7-24e500442e27 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1511 microversion: 2.1 time: 1.230682 Apr 02 21:08:49.413568 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2413/4512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:48 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1511 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:49.432158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:49.437427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:49.440252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:49.465207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:49.465871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:49.470123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:49.471330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:49.544734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:49.554376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:49.555029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:49.571651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:49.572290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:49.576377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:49.579361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:49.640417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:49.655118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:49.655630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:49.911514 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b568273a-0979-4dd1-a7a9-9591b6754523 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.483682 Apr 02 21:08:49.912821 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2100/4513] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:08:49 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:49.933957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:49.938221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:49.942106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:50.080321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:50.092641 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6ffb842-88f2-4166-967c-cba131cf2fe8 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.543666 Apr 02 21:08:50.093575 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2414/4514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:49 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:50.163470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.164388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:50.165770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.166423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:50.290408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:50.429707 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55e5f528-4416-42e2-8008-2921d81b9a1e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.500205 Apr 02 21:08:50.430316 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2101/4515] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Apr 2 21:08:49 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:50.451609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:50.461533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:50.466160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:50.484842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.486918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:50.498499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.500008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:50.515313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-cd6b2abc-f2c8-40f8-ad50-d4d8e3ad104a req-6bbc0941-3386-4529-a606-71b8c637df3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:50.535650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cd6b2abc-f2c8-40f8-ad50-d4d8e3ad104a req-6bbc0941-3386-4529-a606-71b8c637df3e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.536445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cd6b2abc-f2c8-40f8-ad50-d4d8e3ad104a req-6bbc0941-3386-4529-a606-71b8c637df3e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:50.564942 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-cd6b2abc-f2c8-40f8-ad50-d4d8e3ad104a req-6bbc0941-3386-4529-a606-71b8c637df3e service nova] Creating event network-changed:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:08:50.575671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-cd6b2abc-f2c8-40f8-ad50-d4d8e3ad104a req-6bbc0941-3386-4529-a606-71b8c637df3e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064002 Apr 02 21:08:50.579187 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2102/4516] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:50.681002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:50.761300 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49c21371-fb15-46ee-bc4c-d90102b71c7e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.321533 Apr 02 21:08:50.762608 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2415/4517] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Apr 2 21:08:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:50.773603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:50.777579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:50.780549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:50.791054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.795803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:50.797438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:50.798309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.030247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:51.119020 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ba10bf29-35a6-406f-89dc-a45740c886c4 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.347437 Apr 02 21:08:51.121450 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2103/4518] 10.222.0.18 () {58 vars in 1195 bytes} [Sat Apr 2 21:08:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:51.126387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:51.128527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:51.132029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:51.139344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:51.140217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': '1700778975', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:51.146956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.147717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.148113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.148593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.149541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.149994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.150134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.150656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.290859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:51.366200 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc4119ac-acfc-401b-bfb7-c5a3ccf11639 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?name=1700778975" status: 200 len: 346 microversion: 2.1 time: 0.239121 Apr 02 21:08:51.368076 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2104/4519] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Apr 2 21:08:51 2022] GET /compute/v2.1/servers?name=1700778975 => generated 346 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:51.380299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:51.384490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:51.385262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:51.390633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.391260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.392124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.393176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.484111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:51.496179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09b55e67-6028-415a-b8bb-288ece086f97 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.389138 Apr 02 21:08:51.497065 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2416/4520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:51 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:51.520437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:51.595818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-867dd0d6-9aad-49ac-88c8-af311e7f140c tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.220347 Apr 02 21:08:51.602237 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2105/4521] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Apr 2 21:08:51 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:51.608820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:51.614178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:51.614869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-170077897', 'deleted': False, 'project_id': '93da813e266e41509229a1e99815d9ab'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:08:51.623067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.624293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.626092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.627187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.733236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.multi_cell_list [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136518) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:08:51.805132 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0946ce28-a011-4341-90d6-f0ecf93e2d53 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-170077897" status: 200 len: 346 microversion: 2.1 time: 0.200010 Apr 02 21:08:51.806416 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2417/4522] 10.222.0.18 () {58 vars in 1227 bytes} [Sat Apr 2 21:08:51 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-170077897 => generated 346 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:51.822803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:51.823570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:51.848728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.854955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.856137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:51.857196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:51.911292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:08:52.045001 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9abaabf-11c5-430f-8b7d-d577a4397499 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 204 len: 0 microversion: 2.1 time: 0.226194 Apr 02 21:08:52.048749 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2106/4523] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:08:51 2022] DELETE /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:52.055167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:52.055793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:52.064218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:52.065120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:52.066880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:52.067584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:52.299035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:52.320514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-beca97ad-af04-4c8c-aad0-00c62d60dfbc tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1517 microversion: 2.1 time: 0.269829 Apr 02 21:08:52.325851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2418/4524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:52 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:52.517475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:52.518500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:52.537835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:52.538511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:52.539391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:52.540153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:52.769907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:52.778768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fad8b947-545b-40c5-9f1a-bbf07917ac45 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.268147 Apr 02 21:08:52.788775 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2107/4525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:52 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:53.338066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:53.338748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:53.347027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:53.347500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:53.348325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:53.348867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:53.573491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:53.582944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1bea6c1-0095-4ea8-b228-c35397297597 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1517 microversion: 2.1 time: 0.248609 Apr 02 21:08:53.587257 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2419/4526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:53 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1517 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:53.799582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:53.800201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:53.807799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:53.808601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:53.809608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:53.810175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:54.153797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:54.164165 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aadf9f62-3da1-4bc4-94a0-21326d09d64f tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.372107 Apr 02 21:08:54.165460 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2108/4527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:53 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:54.605201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:54.606735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:54.616735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-93f646e7-278d-4622-ad8f-05af58337062 req-142617bf-92d4-4de5-ae7d-56fd3dbaf246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da1fde6-a875-46d3-b37c-48141af6c351", "name": "network-vif-deleted", "tag": "b0db797e-0c06-416a-9943-2bde82ea66bd"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:54.640216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:54.645490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-93f646e7-278d-4622-ad8f-05af58337062 req-142617bf-92d4-4de5-ae7d-56fd3dbaf246 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:54.652847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:54.654189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:54.655126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-93f646e7-278d-4622-ad8f-05af58337062 req-142617bf-92d4-4de5-ae7d-56fd3dbaf246 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:54.656035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:54.684254 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-93f646e7-278d-4622-ad8f-05af58337062 req-142617bf-92d4-4de5-ae7d-56fd3dbaf246 service nova] Creating event network-vif-deleted:b0db797e-0c06-416a-9943-2bde82ea66bd for instance 0da1fde6-a875-46d3-b37c-48141af6c351 on nch2-master-1 Apr 02 21:08:54.694640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-93f646e7-278d-4622-ad8f-05af58337062 req-142617bf-92d4-4de5-ae7d-56fd3dbaf246 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083034 Apr 02 21:08:54.697948 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2109/4528] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:54.756539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:54.769564 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-206f8cc8-fd64-4a52-8d50-8559af81d779 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 200 len: 1305 microversion: 2.1 time: 0.170104 Apr 02 21:08:54.785085 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2420/4529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:54 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 1305 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:55.186307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:55.188565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:55.228995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.229802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.233834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.234302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.428013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:55.436126 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc1d0212-0564-41c8-a375-46772d424500 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.257146 Apr 02 21:08:55.436786 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2110/4530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:55 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:55.634152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-da5b064b-22ad-4864-beb6-c9837b656569 req-53fb6b3e-4d21-4f90-be95-34b1119def35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "name": "network-vif-plugged", "status": "completed", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:55.649445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-da5b064b-22ad-4864-beb6-c9837b656569 req-53fb6b3e-4d21-4f90-be95-34b1119def35 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.650412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-da5b064b-22ad-4864-beb6-c9837b656569 req-53fb6b3e-4d21-4f90-be95-34b1119def35 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.668269 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-da5b064b-22ad-4864-beb6-c9837b656569 req-53fb6b3e-4d21-4f90-be95-34b1119def35 service nova] Creating event network-vif-plugged:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:08:55.677633 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-da5b064b-22ad-4864-beb6-c9837b656569 req-53fb6b3e-4d21-4f90-be95-34b1119def35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048051 Apr 02 21:08:55.679471 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2421/4531] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:08:55.791313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:55.792430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 0da1fde6-a875-46d3-b37c-48141af6c351] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:55.798935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.799717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.801163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.801770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.818357 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] HTTP exception thrown: Instance 0da1fde6-a875-46d3-b37c-48141af6c351 could not be found. Apr 02 21:08:55.819311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Returning 404 to user: Instance 0da1fde6-a875-46d3-b37c-48141af6c351 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:08:55.820228 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0cb0041f-546d-47fe-96ec-d755d0256f32 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351" status: 404 len: 111 microversion: 2.1 time: 0.032801 Apr 02 21:08:55.820883 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2111/4532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:55 2022] GET /compute/v2.1/servers/0da1fde6-a875-46d3-b37c-48141af6c351 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:08:55.829833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:55.830932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:55.837460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.838110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.838897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:55.839340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:55.867677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:08:55.978964 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b03cf2e-9f81-41ad-b17d-3d3192a1a69e tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 204 len: 0 microversion: 2.1 time: 0.151989 Apr 02 21:08:55.983331 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2422/4533] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:08:55 2022] DELETE /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:08:55.991100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:55.992124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:56.002085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:56.003491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:56.005336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:56.006090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:56.068194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:56.068868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:56.077933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:56.078765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:56.079786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:56.081036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:56.122646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9903f67-a44d-4ed5-b8c7-aa470d0858b0 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/ips" status: 200 len: 151 microversion: 2.1 time: 0.059324 Apr 02 21:08:56.124919 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2423/4534] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:08:56 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:56.223567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:56.235720 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ff68ba42-d297-461c-ab04-0a9ec56d28b3 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 200 len: 1518 microversion: 2.1 time: 0.251028 Apr 02 21:08:56.236640 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2112/4535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:55 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:08:56.459870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:56.461446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:56.484622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:56.485302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:56.486675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:56.487467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:57.116462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:57.131727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a9901f2-b583-4c22-a86a-597a970511da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1322 microversion: 2.1 time: 0.673431 Apr 02 21:08:57.132259 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2424/4536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:56 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:57.254592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:57.255432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:57.262242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:57.262710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:57.263547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:57.264038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:57.508006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:57.515868 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6710142f-89f7-42f2-bcac-bb2cad7cccc9 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 200 len: 1518 microversion: 2.1 time: 0.265949 Apr 02 21:08:57.516468 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2113/4537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:57 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:57.586500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "696f5abc-2112-4bfb-bb0e-51027fe32d7f"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:57.587573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:57.594277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:57.594831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:57.595717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:57.596309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.045938 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72cb8e96-6566-4172-aa63-990dca4f04bc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.463315 Apr 02 21:08:58.046483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2425/4538] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:08:57 2022] POST /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:08:58.153533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:58.154961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:58.163200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.164231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.165279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.165993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.504376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:58.512891 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b77fe78-bd91-4ef2-a8d7-7e40eabfa499 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1515 microversion: 2.1 time: 0.368131 Apr 02 21:08:58.513467 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2114/4539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:58 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1515 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:58.533346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:58.535219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:58.546427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:58.547045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:58.549106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.549778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.551501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.551941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.565180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.566493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.571317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.571770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.600562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lazy-loading 'flavor' on Instance uuid d8cf911b-a146-449c-b688-0e4c1c9d1d98 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:08:58.687469 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-066f6570-8a28-4415-b0de-fbefd841a4a6 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action" status: 200 len: 32 microversion: 2.1 time: 0.161327 Apr 02 21:08:58.689079 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2426/4540] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:08:58 2022] POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:08:58.700063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:08:58.701119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:08:58.709400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.710750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:58.711703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:58.713376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:59.119889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:59.140189 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b343b99f-43c0-496e-9b13-b80135e26833 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 200 len: 1518 microversion: 2.1 time: 0.599521 Apr 02 21:08:59.142716 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2115/4541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:58 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 1518 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:59.152893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:08:59.157395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b858e599-ac1b-41be-b198-9ba47112e3cc req-0167c4dd-3018-4f7a-8795-1bb3c12e021f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b714f238-380f-4ce0-b87b-d7beb9873704", "name": "network-vif-deleted", "tag": "cee15827-0ae8-4256-97c2-7bf6108378c3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:08:59.161013 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a054d11-a8e8-4ee9-9b8d-1d1c35fcc16d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.465961 Apr 02 21:08:59.170716 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2427/4542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:08:58 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:08:59.180814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b858e599-ac1b-41be-b198-9ba47112e3cc req-0167c4dd-3018-4f7a-8795-1bb3c12e021f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:08:59.181830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b858e599-ac1b-41be-b198-9ba47112e3cc req-0167c4dd-3018-4f7a-8795-1bb3c12e021f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:08:59.236848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b858e599-ac1b-41be-b198-9ba47112e3cc req-0167c4dd-3018-4f7a-8795-1bb3c12e021f service nova] Creating event network-vif-deleted:cee15827-0ae8-4256-97c2-7bf6108378c3 for instance b714f238-380f-4ce0-b87b-d7beb9873704 on nch2-master-1 Apr 02 21:08:59.243871 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b858e599-ac1b-41be-b198-9ba47112e3cc req-0167c4dd-3018-4f7a-8795-1bb3c12e021f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097879 Apr 02 21:08:59.246913 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2116/4543] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:00.159374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:00.160218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: b714f238-380f-4ce0-b87b-d7beb9873704] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:00.167180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.167639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.168423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.168896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.182455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:00.183376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:00.184622 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] HTTP exception thrown: Instance b714f238-380f-4ce0-b87b-d7beb9873704 could not be found. Apr 02 21:09:00.185226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Returning 404 to user: Instance b714f238-380f-4ce0-b87b-d7beb9873704 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:00.186385 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07db07ca-36f0-4b01-a9a7-755bd1601544 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704" status: 404 len: 111 microversion: 2.1 time: 0.031155 Apr 02 21:09:00.187604 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2428/4544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:00 2022] GET /compute/v2.1/servers/b714f238-380f-4ce0-b87b-d7beb9873704 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:09:00.196882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:00.197906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:00.198236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.198891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.202542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.203322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.204874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.205378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.206695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.207192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.238661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:09:00.346488 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8950bcef-bd5b-48d5-b8a5-9db764b30f4a tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 204 len: 0 microversion: 2.1 time: 0.153848 Apr 02 21:09:00.349259 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2429/4545] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:09:00 2022] DELETE /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:09:00.360097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:00.361163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:00.369941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.370618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.371575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:00.372270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:00.466951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:00.476852 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e732459-58c5-42a1-bc5d-73b5e69a4c87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.300371 Apr 02 21:09:00.487365 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2117/4546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:00 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:00.547363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:00.555992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2055d55c-247e-483f-b593-1e625cad970d tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1518 microversion: 2.1 time: 0.201845 Apr 02 21:09:00.556980 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2430/4547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:00 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1518 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:01.420501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "696f5abc-2112-4bfb-bb0e-51027fe32d7f"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:01.421551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:01.428957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.429421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.430233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.430677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.497277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:01.498667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:01.509386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.510432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.511524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.511652 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Invalid volume: volume 696f5abc-2112-4bfb-bb0e-51027fe32d7f is already attached to instances: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 Apr 02 21:09:01.512227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 400 to user: Invalid volume: volume 696f5abc-2112-4bfb-bb0e-51027fe32d7f is already attached to instances: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:01.512657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.513493 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e29f80e8-bc70-462f-b427-8b9621495630 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097232 Apr 02 21:09:01.514066 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2118/4548] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:09:01 2022] POST /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:09:01.573834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:01.575034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:01.581380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.582144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.582933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.583448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.756562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:01.766134 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5a0794d-e00e-486b-acf5-3ea2e889e31a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.274539 Apr 02 21:09:01.766757 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2431/4549] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:01 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:01.771774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:01.772596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:01.779320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.779883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.780798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:01.781456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:01.785914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:01.797302 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76779998-4a0c-4c4e-8f3d-8d7d1413b7fd tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1518 microversion: 2.1 time: 0.227181 Apr 02 21:09:01.798722 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2119/4550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:01 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1518 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:01.905055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lazy-loading 'services' on Instance uuid c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:09:01.989682 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a51666b-2c31-41bf-a81d-8b5d3365e999 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments/696f5abc-2112-4bfb-bb0e-51027fe32d7f" status: 202 len: 0 microversion: 2.1 time: 0.221459 Apr 02 21:09:01.990364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2432/4551] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:09:01 2022] DELETE /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments/696f5abc-2112-4bfb-bb0e-51027fe32d7f => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:09:02.000331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:02.002797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:02.010423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:02.010891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:02.012322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:02.012949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:02.052813 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eea91ab2-6d35-43d2-9fe6-7ce09366fa88 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056707 Apr 02 21:09:02.054944 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2120/4552] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:09:01 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:02.785190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:02.785905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:02.796551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:02.797453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:02.799919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:02.801440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:02.815627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:02.816278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:02.827467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:02.827923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:02.839091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:02.840574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.260724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8027ca8086469999ae8a73639fca90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93da813e266e41509229a1e99815d9ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:03.269516 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f91a8a42-2d22-43d4-a342-b7c94cf68b8f tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 200 len: 1518 microversion: 2.1 time: 0.457662 Apr 02 21:09:03.271866 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2121/4553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:02 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 1518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:03.286010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:03.293189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:03.303435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.303894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.304734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.305180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.320507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:03.337336 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90705898-4565-4e20-9a49-eec0ec09956a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.556817 Apr 02 21:09:03.338232 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2433/4554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:02 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:03.354754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b17cbe94-b8cb-4fc0-ad16-d8e4e905f26a req-922f8069-c7a5-4189-b222-8f7132fe1ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f06abe1-8723-4cef-87af-ecf16cc21db5", "name": "network-vif-deleted", "tag": "ca836671-e4c3-48a2-a13b-3b83b10b9123"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:03.381170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-977dc17a-acf1-475e-a762-88fc4e245b47 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105054 Apr 02 21:09:03.387958 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2122/4555] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:09:03 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:09:03.402952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b17cbe94-b8cb-4fc0-ad16-d8e4e905f26a req-922f8069-c7a5-4189-b222-8f7132fe1ee9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.403465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b17cbe94-b8cb-4fc0-ad16-d8e4e905f26a req-922f8069-c7a5-4189-b222-8f7132fe1ee9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.447193 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b17cbe94-b8cb-4fc0-ad16-d8e4e905f26a req-922f8069-c7a5-4189-b222-8f7132fe1ee9 service nova] Creating event network-vif-deleted:ca836671-e4c3-48a2-a13b-3b83b10b9123 for instance 3f06abe1-8723-4cef-87af-ecf16cc21db5 on nch1-master-1 Apr 02 21:09:03.464913 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b17cbe94-b8cb-4fc0-ad16-d8e4e905f26a req-922f8069-c7a5-4189-b222-8f7132fe1ee9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123511 Apr 02 21:09:03.466450 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2434/4556] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:03.507902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:03.508714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:03.514852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.515289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.516277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.516926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.545888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:09:03.678563 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9cd4eb34-1bb4-43c9-befe-54c8f2d2f4a5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 204 len: 0 microversion: 2.1 time: 0.175060 Apr 02 21:09:03.679331 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2123/4557] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:09:03 2022] DELETE /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:09:03.693678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:03.694744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:03.710407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.711885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:03.717341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:03.721136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:04.210943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:04.219861 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-198e26e0-7ad9-400e-89ae-4edfa8b1c335 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1683 microversion: 2.1 time: 0.534938 Apr 02 21:09:04.220625 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2435/4558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:03 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1683 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:04.289953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:04.290922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] [instance: 3f06abe1-8723-4cef-87af-ecf16cc21db5] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:04.298844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:04.299716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:04.301127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:04.301749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:04.318919 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] HTTP exception thrown: Instance 3f06abe1-8723-4cef-87af-ecf16cc21db5 could not be found. Apr 02 21:09:04.319527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] Returning 404 to user: Instance 3f06abe1-8723-4cef-87af-ecf16cc21db5 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:04.320623 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3aacf705-f566-4c75-af42-7ff9f9b0fe56 tempest-ListServerFiltersTestJSON-1829464164 tempest-ListServerFiltersTestJSON-1829464164-project] 10.222.0.18 "GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5" status: 404 len: 111 microversion: 2.1 time: 0.035931 Apr 02 21:09:04.321703 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2124/4559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:04 2022] GET /compute/v2.1/servers/3f06abe1-8723-4cef-87af-ecf16cc21db5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:09:04.354896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:04.355513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:04.362912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:04.363764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:04.364595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:04.365039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:04.698845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:04.709952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d9ae39c-2188-4b12-aaaf-08ae721f9e87 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.359185 Apr 02 21:09:04.723266 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2436/4560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:04 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:05.237165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:05.238241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:05.245804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:05.246929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:05.247095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:05.247487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:05.609141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:05.629493 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f5c30fb7-6043-4cf1-923a-f5a05f8938b8 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1683 microversion: 2.1 time: 0.396189 Apr 02 21:09:05.631125 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2125/4561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:05 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1683 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:05.732959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:05.735290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:05.744388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:05.744895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:05.745709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:05.746159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:06.163730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:06.175280 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2bc8157-96f5-49a5-b9b5-d190944e3927 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.449042 Apr 02 21:09:06.176718 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2437/4562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:05 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:06.649325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:06.650694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:06.664152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:06.665080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:06.666101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:06.667473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:07.161501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:07.177384 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-161fac58-0607-4416-a9c2-9251699a525f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1683 microversion: 2.1 time: 0.533850 Apr 02 21:09:07.177986 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2126/4563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:06 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1683 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:07.194858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:07.196297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:07.214291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:07.215195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:07.217934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:07.220045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:07.665299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3c8ec34f-751c-4bad-8772-4c6ba30d9da4 req-be272d9b-d4c2-4d57-b96d-3c9510cf2850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36", "name": "network-vif-deleted", "tag": "96ce7472-2a62-45dc-8a1e-fe0e2262b5aa"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:07.677783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3c8ec34f-751c-4bad-8772-4c6ba30d9da4 req-be272d9b-d4c2-4d57-b96d-3c9510cf2850 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:07.678557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3c8ec34f-751c-4bad-8772-4c6ba30d9da4 req-be272d9b-d4c2-4d57-b96d-3c9510cf2850 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:07.721061 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3c8ec34f-751c-4bad-8772-4c6ba30d9da4 req-be272d9b-d4c2-4d57-b96d-3c9510cf2850 service nova] Creating event network-vif-deleted:96ce7472-2a62-45dc-8a1e-fe0e2262b5aa for instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 on nch2-master-1 Apr 02 21:09:07.731222 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3c8ec34f-751c-4bad-8772-4c6ba30d9da4 req-be272d9b-d4c2-4d57-b96d-3c9510cf2850 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069576 Apr 02 21:09:07.734603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2127/4564] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:08.112266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:08.125042 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2acf58b3-7c67-438c-bf88-519d390f588a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.935840 Apr 02 21:09:08.130811 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2438/4565] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:07 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:08.201143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:08.201864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:08.214000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:08.214601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:08.225120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:08.225767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:08.323268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:08.324177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:08.325617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lazy-loading 'fault' on Instance uuid c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:09:08.493353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:08.506612 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0328ae6-9ebf-4d1f-a265-671a8d9269d5 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 200 len: 1331 microversion: 2.1 time: 0.311127 Apr 02 21:09:08.507608 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2128/4566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:08 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 1331 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:08.681728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1654066281", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": "none"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:08.782412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:09:08.783151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:09:08.783868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:09:08.785074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:09:08.785740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:09:08.798297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:08.799896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:08.801542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:08.802227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:08.837428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Getting quotas for project 7623755f811741a0ac8fe7ca2f08e42b. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:08.844486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Getting quotas for user ae4eb2db87694abe80feb344bb617c46 and project 7623755f811741a0ac8fe7ca2f08e42b. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:08.860508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:09:08.864444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:09:08.942459 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-259af26d-398f-4042-94d2-9c5b185345ff tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.448718 Apr 02 21:09:08.949411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2439/4567] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 21:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 02 21:09:08.963490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8854aa63-ed2c-43b5-9d05-78d0e0960650 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:08.964271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8854aa63-ed2c-43b5-9d05-78d0e0960650 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:09.087773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8854aa63-ed2c-43b5-9d05-78d0e0960650 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:09.096394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8854aa63-ed2c-43b5-9d05-78d0e0960650 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:09.101683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8854aa63-ed2c-43b5-9d05-78d0e0960650 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:09.105756 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8854aa63-ed2c-43b5-9d05-78d0e0960650 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1281 microversion: 2.47 time: 0.154682 Apr 02 21:09:09.108100 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2129/4568] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:08 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:09:09.151252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:09.158039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:09.167474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:09.168160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:09.173668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:09.174316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:09.529793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:09.531050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:09.545295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:09.546686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:09.548290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:09.548999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:09.570422 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 could not be found. Apr 02 21:09:09.571519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:09.573519 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa48942d-09bb-46e6-92b6-fbc1f7e4845b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 404 len: 111 microversion: 2.1 time: 0.053532 Apr 02 21:09:09.574331 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2130/4569] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:09 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:09:09.585659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5381c58-771d-42a3-806e-a4ad6098053b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '.version_select at 0x7f54c7ee3dc0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:09.643249 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5381c58-771d-42a3-806e-a4ad6098053b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750947612" status: 202 len: 0 microversion: 2.1 time: 0.062929 Apr 02 21:09:09.647171 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2131/4570] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:09:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750947612 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:09:09.660203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:09.668390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-042bb49c-8101-490c-9fab-5de9fd9786ff tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.525496 Apr 02 21:09:09.682925 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2440/4571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:09 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:10.127037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:10.127904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:10.140639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:10.142843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:10.145556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:10.146210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:10.283008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:10.295489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:10.302150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:10.303366 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bdb7d32b-d4a2-4be2-b2bc-e1c875b4c0a6 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1333 microversion: 2.47 time: 0.182496 Apr 02 21:09:10.314049 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2132/4572] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:10 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1333 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:10.692116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:10.693522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:10.700959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:10.702361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:10.703212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:10.703670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:11.014858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d6f03a7-971e-4e3b-a2c2-3a0e86069e9b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: .version_select at 0x7f54d424a430>, body: {"keypair": {"name": "tempest-keypair-1017652606"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:11.034705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9d6f03a7-971e-4e3b-a2c2-3a0e86069e9b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:11.040881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9d6f03a7-971e-4e3b-a2c2-3a0e86069e9b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:11.063976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:11.076714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1c5e1ca-d079-47bc-8e2c-7961e7842dad tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.386907 Apr 02 21:09:11.078650 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2441/4573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:10 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:11.244315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9d6f03a7-971e-4e3b-a2c2-3a0e86069e9b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:11.250258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9d6f03a7-971e-4e3b-a2c2-3a0e86069e9b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:11.265323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d6f03a7-971e-4e3b-a2c2-3a0e86069e9b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.258101 Apr 02 21:09:11.266206 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2133/4574] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:09:11 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:11.327548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:11.328486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:11.336448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:11.337527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:11.338545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:11.339168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:11.450423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:11.469064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:11.472798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:11.475236 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e151373-aa3d-4c3a-907e-2a3d2599afa7 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1339 microversion: 2.47 time: 0.155697 Apr 02 21:09:11.490179 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2442/4575] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:11 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:12.095295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:12.096193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:12.102631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:12.103157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:12.103943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:12.104615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:12.466288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:12.493174 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f78ab893-63f5-424b-bdbe-d777056f6a48 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.399366 Apr 02 21:09:12.496084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:12.497345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:12.506586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:12.507367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:12.508419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:12.509121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:12.509521 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2134/4576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:12 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:12.594782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:12.615840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:12.618129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:12.619755 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5249a868-45ce-4257-8450-d5147ee37f63 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1339 microversion: 2.47 time: 0.129211 Apr 02 21:09:12.621103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2443/4577] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:12 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1339 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:09:13.512202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:13.512857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:13.520121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:13.520620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:13.521418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:13.521870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:13.646413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:13.648028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:13.655905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:13.656752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:13.657798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:13.658649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:13.774807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:13.789614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:13.791379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:13.792673 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-64f286ff-93a5-4cba-8eae-b890be50623e tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1360 microversion: 2.47 time: 0.153895 Apr 02 21:09:13.794609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2444/4578] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:13 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:13.821117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-975510304"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:13.823153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:13.851861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:13.853157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:13.854098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:13.854653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:14.227197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:14.246714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4e20579-e875-48e1-8477-265536e255d3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.735667 Apr 02 21:09:14.253934 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2135/4579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:13 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:14.272212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-314865775", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e11fe41-71ae-4517-9435-793475d4d7b5"}], "security_groups": [{"name": "tempest-securitygroup--904794042"}], "key_name": "tempest-keypair-1017652606", "user_data": "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:14.330665 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce44eee4-b4ed-4e59-b948-9e7c04728b2f tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "POST /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11/action" status: 202 len: 52 microversion: 2.47 time: 0.520177 Apr 02 21:09:14.331744 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2445/4580] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Apr 2 21:09:13 2022] POST /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11/action => generated 52 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Apr 02 21:09:14.343417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:14.344034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:14.370770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:14.372674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:14.373631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:14.375514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:14.457572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:09:14.648293 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4709ffb5-4337-440a-ad26-d8ed9bd23b69 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 204 len: 0 microversion: 2.47 time: 0.308815 Apr 02 21:09:14.650230 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2446/4581] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:09:14 2022] DELETE /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 02 21:09:14.668069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:14.669902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:14.681565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:14.689076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:14.693920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:14.694390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:14.810566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:14.820808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:14.833986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:14.835298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-45727e2e-05b4-4423-8f6b-a0d2ddacb6fe tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1366 microversion: 2.47 time: 0.176717 Apr 02 21:09:14.839814 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2447/4582] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:14 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:15.175386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] validate_networks() for [('8e11fe41-71ae-4517-9435-793475d4d7b5', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:09:15.268209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:15.269385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:15.275672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:15.276296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:15.277361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:15.277814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:15.500437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:15.511582 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5b200f1-8dc4-4501-b435-5d5efe82b08a tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.250035 Apr 02 21:09:15.521812 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2448/4583] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:15 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:15.854740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:15.856318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:15.865616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:15.866194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:15.867081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:15.867600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:15.945004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:15.954670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:15.956375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:15.957727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab4c144e-4aa9-40d3-848a-8229ba48179c tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1366 microversion: 2.47 time: 0.107412 Apr 02 21:09:15.958371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2449/4584] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:15 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:16.528855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:16.529635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:16.536853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:16.537382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:16.538256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:16.538701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:16.646773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:09:16.647288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:09:16.647682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:09:16.648385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:09:16.649221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:09:16.668960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:16.669429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:16.670474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:16.670933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:16.714574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:16.727785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Getting quotas for user 2fed8f5059c44a8fa1a9526e81fa73e8 and project bb31a4915e1341839e229bc3786bb4b2. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:16.741281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:16.750758 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cc21269-8ad5-452e-818f-cbea507e5b9d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.225728 Apr 02 21:09:16.751247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:09:16.754050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2450/4585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:16 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:16.754641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:09:16.820802 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72c7884c-98ba-4ff7-94d2-ebdfa4ce041b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.563214 Apr 02 21:09:16.822621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2136/4586] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:09:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:09:16.833460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42760ef3-5e5d-4256-a68e-e111885342ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:16.836840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42760ef3-5e5d-4256-a68e-e111885342ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:16.977928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:16.978614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:16.984274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42760ef3-5e5d-4256-a68e-e111885342ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:16.994206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:16.995857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42760ef3-5e5d-4256-a68e-e111885342ea tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1241 microversion: 2.1 time: 0.166959 Apr 02 21:09:16.996652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:16.997473 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2451/4587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:16 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:17.004788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:17.005363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:17.139766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:17.154706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:17.156995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:17.162587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1aff1b8d-f3fe-4377-92f7-a0681d3aaf9a tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1366 microversion: 2.47 time: 0.187642 Apr 02 21:09:17.172636 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2137/4588] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:16 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:17.767508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:17.768334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:17.775817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:17.776603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:17.777719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:17.779641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:18.021597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:18.022868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:18.043537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:18.053361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:18.055313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:18.057111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:18.061332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:18.072604 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eeb4bf6d-6424-421b-9d1f-ca69cb4d7a2d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.308815 Apr 02 21:09:18.073211 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2452/4589] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:17 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:18.181452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:18.182525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:18.200019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:18.200858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:18.202022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:18.202656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:18.272170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:18.273182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:18.273859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lazy-loading 'fault' on Instance uuid f3988c25-5602-4f39-b082-e2e97f2d4b11 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:09:18.282185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:18.295374 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-28b0e4b8-4fc5-44ad-babe-bacce17859d4 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1293 microversion: 2.1 time: 0.285041 Apr 02 21:09:18.295978 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2138/4590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:18 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1293 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:18.782569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:18.803163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:18.806636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae4eb2db87694abe80feb344bb617c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7623755f811741a0ac8fe7ca2f08e42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:18.809642 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-83c387de-b8ea-4604-9512-0db1d3e857f4 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 200 len: 1371 microversion: 2.47 time: 0.632566 Apr 02 21:09:18.826655 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2453/4591] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:18 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 1371 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:09:19.089534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:19.090831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:19.099601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:19.100297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:19.101326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:19.101955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:19.304443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:19.313482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:19.314235 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd448950-8681-43cf-ad31-987d5f638a82 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.228517 Apr 02 21:09:19.315733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:19.323841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:19.324446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:19.325458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:19.325898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:19.327536 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2139/4592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:19 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:19.430117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:19.443836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35593c00-7191-42d4-a0c7-3af87071b5d2 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1299 microversion: 2.1 time: 0.133631 Apr 02 21:09:19.454427 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2454/4593] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:19 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:19.835017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:19.836019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] [instance: f3988c25-5602-4f39-b082-e2e97f2d4b11] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:19.843309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:19.844164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:19.845258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:19.845881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:19.877529 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] HTTP exception thrown: Instance f3988c25-5602-4f39-b082-e2e97f2d4b11 could not be found. Apr 02 21:09:19.879296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] Returning 404 to user: Instance f3988c25-5602-4f39-b082-e2e97f2d4b11 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:19.880577 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24f6c0a6-5ed5-4344-ae21-67e4992902f9 tempest-ServersAaction247Test-864920443 tempest-ServersAaction247Test-864920443-project] 10.222.0.18 "GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11" status: 404 len: 111 microversion: 2.47 time: 0.052146 Apr 02 21:09:19.881779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2140/4594] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:19 2022] GET /compute/v2.1/servers/f3988c25-5602-4f39-b082-e2e97f2d4b11 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:09:20.331796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:20.333274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:20.340007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:20.340478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:20.341255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:20.352403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:20.573506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7f908d5-c631-45ef-befd-f5a9d3f8f2bb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Action: 'create', calling method: .version_select at 0x7f54c7cb28b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1778237776"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:20.592920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7f908d5-c631-45ef-befd-f5a9d3f8f2bb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:20.602024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7f908d5-c631-45ef-befd-f5a9d3f8f2bb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for user 912051f37cf84f30942319efc614fc12 and project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:20.616531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:20.623988 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7fd4c62d-27fd-4c8d-9215-172130a85c8e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.296771 Apr 02 21:09:20.634124 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2141/4595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:20 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:20.639204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:20.640163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:20.653154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:20.653872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:20.656939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:20.657580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:20.707623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7f908d5-c631-45ef-befd-f5a9d3f8f2bb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:20.715046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c7f908d5-c631-45ef-befd-f5a9d3f8f2bb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for user 912051f37cf84f30942319efc614fc12 and project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:20.736542 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7f908d5-c631-45ef-befd-f5a9d3f8f2bb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.509765 Apr 02 21:09:20.742435 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2455/4596] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:09:20 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:21.036155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:21.058810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e9a7da67-c2ea-4786-84b8-a53f1405ab23 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.423403 Apr 02 21:09:21.060419 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2142/4597] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:20 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:21.158280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-50baf9d6-2bda-4297-99be-ac30e2683401 req-ecfd3ea0-ca4f-4f75-9476-0da04fc5bac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3797b801-c405-4915-bbed-847fd1fc1379", "tag": "5f72d76a-13d8-4fed-8238-44c944f41159"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:21.176007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-50baf9d6-2bda-4297-99be-ac30e2683401 req-ecfd3ea0-ca4f-4f75-9476-0da04fc5bac5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:21.178528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-50baf9d6-2bda-4297-99be-ac30e2683401 req-ecfd3ea0-ca4f-4f75-9476-0da04fc5bac5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:21.205127 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-50baf9d6-2bda-4297-99be-ac30e2683401 req-ecfd3ea0-ca4f-4f75-9476-0da04fc5bac5 service nova] Creating event network-changed:5f72d76a-13d8-4fed-8238-44c944f41159 for instance 3797b801-c405-4915-bbed-847fd1fc1379 on nch1-master-1 Apr 02 21:09:21.214282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-50baf9d6-2bda-4297-99be-ac30e2683401 req-ecfd3ea0-ca4f-4f75-9476-0da04fc5bac5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059705 Apr 02 21:09:21.215027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2456/4598] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:21.642478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:21.644056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:21.657501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:21.657965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:21.661030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:21.661647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:21.953919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:21.970392 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-461ebd3e-eded-4af7-b8ce-6f554d19b471 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.328921 Apr 02 21:09:21.971975 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2143/4599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:21 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:22.080586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:22.080586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:22.088186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:22.088678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:22.089477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:22.090000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:22.459242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:22.470495 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-067412c1-fa18-43a0-9eee-ebf6bc042bb3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.396447 Apr 02 21:09:22.473708 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2457/4600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:22 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:22.719189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1645437521", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1778237776", "security_groups": [{"name": "tempest-secgroup-smoke-21748699"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "aee8d11f-d662-404a-a036-49c72755f56d"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:22.923942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] validate_networks() for [('aee8d11f-d662-404a-a036-49c72755f56d', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:09:22.989896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:22.990555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:22.997245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:22.997586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:22.998395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:22.998851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:23.214927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:23.234463 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1234f710-d809-4311-841b-5c3c95429b84 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.249142 Apr 02 21:09:23.235085 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2458/4601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:22 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:23.492072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:23.493369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:23.501337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:23.502122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:23.503191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:23.503815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:23.727472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:23.738403 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7633eee0-ba72-4491-957c-4699826a33d7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.251881 Apr 02 21:09:23.748774 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2459/4602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:23 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:24.115369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:24.122355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for user 912051f37cf84f30942319efc614fc12 and project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: dict_keys(['metadata_items']) {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:24.137796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:09:24.138231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:09:24.138719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:09:24.139138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:09:24.139561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:09:24.149308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:24.149776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:24.150600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:24.151045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:24.168762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:24.175063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Getting quotas for user 912051f37cf84f30942319efc614fc12 and project 3e69485d6b5e4cd6ba0ffbb3b210952b. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:24.189213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:09:24.192993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:09:24.257033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:24.258440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:24.275008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:24.275485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:24.276310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:24.277221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:24.289398 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58252e2b-2e9e-455d-8539-0a2f4406616a tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.573502 Apr 02 21:09:24.290665 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2144/4603] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:09:22 2022] POST /compute/v2.1/servers => generated 404 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:09:24.304842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02dd82f0-d3b2-48d0-b45a-639a789c2eca tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:24.308447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02dd82f0-d3b2-48d0-b45a-639a789c2eca tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:24.402700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02dd82f0-d3b2-48d0-b45a-639a789c2eca tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:24.413629 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02dd82f0-d3b2-48d0-b45a-639a789c2eca tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1303 microversion: 2.1 time: 0.116992 Apr 02 21:09:24.414672 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2145/4604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:24 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:24.680039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:24.694821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-203cf2a0-0138-48ce-85f4-9e39f8af0e76 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.443473 Apr 02 21:09:24.695864 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2460/4605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:24 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:24.758718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:24.759374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:24.772212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:24.773306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:24.775703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:24.777719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:25.042092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:25.054043 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4900a9c9-604b-40ae-814a-45ac7d197519 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.302047 Apr 02 21:09:25.055135 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2146/4606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:24 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:25.430929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:25.431566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:25.467221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:25.467725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:25.470350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:25.470795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:25.712570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:25.714066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:25.724610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:25.727502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:25.728339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:25.732136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:26.098641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:26.117323 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23c3f1af-db93-416b-a15a-5345116623be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1355 microversion: 2.1 time: 0.690927 Apr 02 21:09:26.119136 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2461/4607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:25 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1355 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:26.137149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:26.137804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:26.150665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:26.153838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:26.154927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:26.155376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:26.230320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:26.241936 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79a06cf5-611a-4299-b67d-b2c582130e7e tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.533949 Apr 02 21:09:26.245607 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2147/4608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:25 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:26.712641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:26.727610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1536d2d1-680e-4998-a7fb-755490125c04 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.606552 Apr 02 21:09:26.729054 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2462/4609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:26 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:27.134642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:27.135268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:27.150493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:27.150951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:27.151950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:27.152647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:27.262268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:27.263140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:27.272672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:27.278360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:27.279420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:27.280078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:27.552533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:27.574004 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47f8a2a0-f84a-47fe-9007-ae2ca1817904 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.443049 Apr 02 21:09:27.588840 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2148/4610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:27 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:27.745972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:27.753235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:27.764738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:27.772296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:27.773306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:27.773829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:27.992886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:28.014600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06a7202b-3991-44f1-9000-fe5086da16ba tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1521 microversion: 2.1 time: 0.756083 Apr 02 21:09:28.037624 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2463/4611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:27 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1521 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:28.384923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:28.409198 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6e2f624b-f5da-4550-947b-670ce51a6346 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.665184 Apr 02 21:09:28.414848 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2149/4612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:27 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:28.423876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2c315c47-e978-44b8-a718-a731e5252ece req-ed78b35a-7d0b-4524-8ac3-1d4d55754d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c962256b-4bd5-4520-863d-008d7e17cc57", "tag": "8276a875-ff1a-4096-8a72-2a3dd85f50d2"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:28.437774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2c315c47-e978-44b8-a718-a731e5252ece req-ed78b35a-7d0b-4524-8ac3-1d4d55754d0e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:28.449572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2c315c47-e978-44b8-a718-a731e5252ece req-ed78b35a-7d0b-4524-8ac3-1d4d55754d0e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:28.499911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2c315c47-e978-44b8-a718-a731e5252ece req-ed78b35a-7d0b-4524-8ac3-1d4d55754d0e service nova] Creating event network-changed:8276a875-ff1a-4096-8a72-2a3dd85f50d2 for instance c962256b-4bd5-4520-863d-008d7e17cc57 on nch2-master-1 Apr 02 21:09:28.508006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2c315c47-e978-44b8-a718-a731e5252ece req-ed78b35a-7d0b-4524-8ac3-1d4d55754d0e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088448 Apr 02 21:09:28.509758 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2464/4613] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:28.599980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:28.600970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:28.607224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:28.607954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:28.609022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:28.609670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:29.046269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:29.047672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:29.056882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:29.057648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:29.058642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:29.059289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:29.290489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:29.300300 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-914f2516-ecde-41c0-8cf4-c587e526d9ed tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.709821 Apr 02 21:09:29.311246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:29.319734 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2150/4614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:28 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:29.323483 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4fc341a-58ce-4464-9657-254ee6286d5b tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1501 microversion: 2.1 time: 0.281561 Apr 02 21:09:29.348776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2465/4615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:29 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:29.356881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8e0ea94-ada0-4118-a0c7-1e79f99d77b3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'create', calling method: .version_select at 0x7f54d4d89670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1025744171", "description": "tempest-description-745657583"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:29.434604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:29.435678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:29.454696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:29.456098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:29.462964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:29.463671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:29.790529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:29.799836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4c107d9c-9b5a-493f-bbe6-6e5bbdfe1e49 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.370307 Apr 02 21:09:29.805263 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2466/4616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:29 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:29.974859 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8e0ea94-ada0-4118-a0c7-1e79f99d77b3 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.624163 Apr 02 21:09:29.976040 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2151/4617] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Apr 2 21:09:29 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:29.991409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1025744171"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:29.992616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:30.007884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.009247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:30.011895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.013460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:30.134492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c10d4eda-6c97-4a04-b451-cff54ad71f15 req-b9f712cd-76ae-4a63-87da-2aa29d76c163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3797b801-c405-4915-bbed-847fd1fc1379", "name": "network-vif-plugged", "status": "completed", "tag": "5f72d76a-13d8-4fed-8238-44c944f41159"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:30.179162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c10d4eda-6c97-4a04-b451-cff54ad71f15 req-b9f712cd-76ae-4a63-87da-2aa29d76c163 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.186754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c10d4eda-6c97-4a04-b451-cff54ad71f15 req-b9f712cd-76ae-4a63-87da-2aa29d76c163 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:30.218322 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c10d4eda-6c97-4a04-b451-cff54ad71f15 req-b9f712cd-76ae-4a63-87da-2aa29d76c163 service nova] Creating event network-vif-plugged:5f72d76a-13d8-4fed-8238-44c944f41159 for instance 3797b801-c405-4915-bbed-847fd1fc1379 on nch1-master-1 Apr 02 21:09:30.231833 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c10d4eda-6c97-4a04-b451-cff54ad71f15 req-b9f712cd-76ae-4a63-87da-2aa29d76c163 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102053 Apr 02 21:09:30.234513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2152/4618] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:30.324965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:30.325992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:30.347102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.347930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:30.349012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.349672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:30.740701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.network.security_group_api [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Adding security group 0426a9b8-1cf3-405c-8a6f-fcdd54eb5573 to port b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 Apr 02 21:09:30.755583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:30.763555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b25cf657-2ea4-4806-9161-f80fdce606be tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.445225 Apr 02 21:09:30.773337 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2153/4619] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:30 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:30.827018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:30.827958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:30.839338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.840104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:30.841267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:30.841959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:31.096967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:31.106756 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-691ecc25-80b5-4b60-b281-0d1cf8bb14cb tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.283737 Apr 02 21:09:31.108157 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2154/4620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:30 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:31.782073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:31.782699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:31.795569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:31.796033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:31.800115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:31.802174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:32.133212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:32.146255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e9e37ff-a36e-41cd-ae8d-43d47d63b060 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.369323 Apr 02 21:09:32.146860 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2155/4621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:31 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:32.166675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:32.172680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:32.181023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:32.181751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:32.182012 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bae6e27b-93b4-4e72-933f-bc9c2ecc7907 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action" status: 202 len: 0 microversion: 2.1 time: 2.197756 Apr 02 21:09:32.187216 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2467/4622] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:09:29 2022] POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action => generated 0 bytes in 2204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:09:32.190723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:32.191783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:32.195185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1025744171"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:32.198180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:32.216821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:32.218108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:32.219237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:32.221574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:32.384285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:32.397556 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44059502-dc34-45a5-aee1-337ec8adb55f tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1366 microversion: 2.1 time: 0.239806 Apr 02 21:09:32.398184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2156/4623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:32 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:32.402861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a21734db-35a2-45f7-8c81-7011af877778 req-3b684724-d087-4c55-9b34-d1ebcfe845ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:32.410927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a21734db-35a2-45f7-8c81-7011af877778 req-3b684724-d087-4c55-9b34-d1ebcfe845ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:32.411706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a21734db-35a2-45f7-8c81-7011af877778 req-3b684724-d087-4c55-9b34-d1ebcfe845ad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:32.423897 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a21734db-35a2-45f7-8c81-7011af877778 req-3b684724-d087-4c55-9b34-d1ebcfe845ad service nova] Creating event network-changed:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:09:32.429957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a21734db-35a2-45f7-8c81-7011af877778 req-3b684724-d087-4c55-9b34-d1ebcfe845ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030358 Apr 02 21:09:32.431323 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2157/4624] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:32.795002 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.network.security_group_api [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Removing security group 0426a9b8-1cf3-405c-8a6f-fcdd54eb5573 from port b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 Apr 02 21:09:33.167013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:33.168621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:33.188796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:33.189373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:33.190526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:33.191072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:33.474185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:33.485642 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8fc6c4ec-5c3a-424e-a8de-1131c6d9171e tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.324900 Apr 02 21:09:33.487210 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2158/4625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:33 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:33.682846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0855db7e-e2b1-4f2a-838c-411eeb86f183 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action" status: 202 len: 0 microversion: 2.1 time: 1.494259 Apr 02 21:09:33.684057 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2468/4626] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:09:32 2022] POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action => generated 0 bytes in 1496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:09:33.695815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:33.697304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:33.713139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1549491995", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:33.727411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:33.728716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:33.729731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:33.731683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:33.810324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] validate_networks() for [('506a0cbe-9c07-48c1-9815-b2435759867a', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:09:33.914992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:33.925029 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5e46d45-ea42-4ee0-b4af-1ae4aed68f7b tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1556 microversion: 2.1 time: 0.239173 Apr 02 21:09:33.925630 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2469/4627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:33 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:33.931897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-915ae5a3-88cc-4119-95b0-10f6c58657a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'create', calling method: .version_select at 0x7f54c7cc5a60>, body: {"pool": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:35.129216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:09:35.129747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:09:35.130923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:09:35.131342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:09:35.131772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:09:35.152122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:35.152878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:35.153701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:35.154195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:35.200049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for project e9e9483710f0424b9c347c74a9da708a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:35.227595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for user d7ebf8694d674ee38bb5f58a3687a415 and project e9e9483710f0424b9c347c74a9da708a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:35.274445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:09:35.282004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:09:35.381510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45c3bfcd-4c73-4baf-a942-99bd6ae95188 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.892076 Apr 02 21:09:35.384943 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2159/4628] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:09:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:09:35.399171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:35.400660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:35.419031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:35.419962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:35.424111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:35.424906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:35.764054 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2b4df60f-fca0-4fbf-96aa-011ea9b25b67 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.377336 Apr 02 21:09:35.764821 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2160/4629] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:09:35 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:35.776904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:35.777783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:35.810542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:35.812480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:35.815162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:35.817491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:36.178815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:36.188356 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-892ac846-79ae-4e39-b827-d7221a8f9b0d tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.421896 Apr 02 21:09:36.190324 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2161/4630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:35 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:36.195534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-01568324-2d82-4d49-8b8f-c7afd44564fa req-93fb50aa-85c5-495d-81e1-eadcaaa1c8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:36.205113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-01568324-2d82-4d49-8b8f-c7afd44564fa req-93fb50aa-85c5-495d-81e1-eadcaaa1c8c3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:36.206106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-01568324-2d82-4d49-8b8f-c7afd44564fa req-93fb50aa-85c5-495d-81e1-eadcaaa1c8c3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:36.221767 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-01568324-2d82-4d49-8b8f-c7afd44564fa req-93fb50aa-85c5-495d-81e1-eadcaaa1c8c3 service nova] Creating event network-changed:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:09:36.253466 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-01568324-2d82-4d49-8b8f-c7afd44564fa req-93fb50aa-85c5-495d-81e1-eadcaaa1c8c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049103 Apr 02 21:09:36.263218 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2162/4631] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:36.276742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:36.278093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:36.286904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:36.287556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:36.288788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:36.289659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:36.474281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:36.488708 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cfe85ffb-75e8-46e9-afc7-34498608feae tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1226 microversion: 2.1 time: 0.222534 Apr 02 21:09:36.490946 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2163/4632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:36 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:36.508148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-02a3938b-9ab0-48b6-9daa-7ce4e531784b req-ad62a69e-ef8a-4a96-a087-5903ce7a1043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c962256b-4bd5-4520-863d-008d7e17cc57", "name": "network-vif-plugged", "status": "completed", "tag": "8276a875-ff1a-4096-8a72-2a3dd85f50d2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:36.527361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-02a3938b-9ab0-48b6-9daa-7ce4e531784b req-ad62a69e-ef8a-4a96-a087-5903ce7a1043 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:36.528233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-02a3938b-9ab0-48b6-9daa-7ce4e531784b req-ad62a69e-ef8a-4a96-a087-5903ce7a1043 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:36.560283 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-02a3938b-9ab0-48b6-9daa-7ce4e531784b req-ad62a69e-ef8a-4a96-a087-5903ce7a1043 service nova] Creating event network-vif-plugged:8276a875-ff1a-4096-8a72-2a3dd85f50d2 for instance c962256b-4bd5-4520-863d-008d7e17cc57 on nch2-master-1 Apr 02 21:09:36.568067 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-02a3938b-9ab0-48b6-9daa-7ce4e531784b req-ad62a69e-ef8a-4a96-a087-5903ce7a1043 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075246 Apr 02 21:09:36.570314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2164/4633] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:36.607998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-934703139", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:36.708029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] validate_networks() for [('506a0cbe-9c07-48c1-9815-b2435759867a', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:09:36.980953 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-915ae5a3-88cc-4119-95b0-10f6c58657a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.053084 Apr 02 21:09:36.982947 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2470/4634] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Apr 2 21:09:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:36.997594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.107"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:37.001833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:37.014177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:37.015588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:37.017221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:37.018577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:37.069777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Acquired lock "refresh_cache-d8cf911b-a146-449c-b688-0e4c1c9d1d98" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 21:09:37.584489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:09:37.588397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:09:37.589694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:09:37.590617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:09:37.591106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:09:37.605330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:37.605854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:37.607592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:37.610109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:37.647076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for project e9e9483710f0424b9c347c74a9da708a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:09:37.656039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for user d7ebf8694d674ee38bb5f58a3687a415 and project e9e9483710f0424b9c347c74a9da708a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:09:37.672285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:09:37.675375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:09:37.735179 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-136a7e39-20da-4b5d-9da2-3e34288a9f54 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.138259 Apr 02 21:09:37.741513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2165/4635] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:09:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:09:37.747001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:37.747864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:37.755480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:37.756185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:37.757219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:37.757841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:38.050325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:38.061722 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1764ccda-1c2f-48f1-960e-4cae29d3f521 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1427 microversion: 2.1 time: 0.314909 Apr 02 21:09:38.063344 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2166/4636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:37 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1427 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:38.070458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c52765b4-bd1c-4fc0-86b5-da77af20816b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:38.071357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c52765b4-bd1c-4fc0-86b5-da77af20816b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:38.395788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c52765b4-bd1c-4fc0-86b5-da77af20816b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:38.404160 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c52765b4-bd1c-4fc0-86b5-da77af20816b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1221 microversion: 2.1 time: 0.338538 Apr 02 21:09:38.426619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2167/4637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:38 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1221 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:39.079722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:39.080466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:39.094853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:39.094998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:39.095736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:39.096191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:39.713352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:39.723597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bac47e9a-8775-461c-a2b1-d5fedb938d85 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1606 microversion: 2.1 time: 0.647706 Apr 02 21:09:39.730285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2168/4638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:39 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1606 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:39.748148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:39.752822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:39.773571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:39.774112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:39.774906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:39.781740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:40.030264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:40.045419 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e7c2265d-667a-4f8c-a208-2d1183868fcc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1273 microversion: 2.1 time: 0.313527 Apr 02 21:09:40.073019 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2169/4639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:39 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:40.097880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:40.101141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:40.113142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:40.114405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:40.115914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:40.116657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:40.366080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:40.378148 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71942978-e403-41ef-80c9-e522c11155fb tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1606 microversion: 2.1 time: 0.302901 Apr 02 21:09:40.382587 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2170/4640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:40 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1606 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:40.397125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-df87a193-f5a1-4f4a-8c1a-1554ef5e7f38 req-577d21a8-8433-4ad6-b821-b444ec484c3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3797b801-c405-4915-bbed-847fd1fc1379", "tag": "5f72d76a-13d8-4fed-8238-44c944f41159"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:40.417129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-df87a193-f5a1-4f4a-8c1a-1554ef5e7f38 req-577d21a8-8433-4ad6-b821-b444ec484c3c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:40.417909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-df87a193-f5a1-4f4a-8c1a-1554ef5e7f38 req-577d21a8-8433-4ad6-b821-b444ec484c3c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:40.435669 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-df87a193-f5a1-4f4a-8c1a-1554ef5e7f38 req-577d21a8-8433-4ad6-b821-b444ec484c3c service nova] Creating event network-changed:5f72d76a-13d8-4fed-8238-44c944f41159 for instance 3797b801-c405-4915-bbed-847fd1fc1379 on nch1-master-1 Apr 02 21:09:40.451808 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-df87a193-f5a1-4f4a-8c1a-1554ef5e7f38 req-577d21a8-8433-4ad6-b821-b444ec484c3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065792 Apr 02 21:09:40.455816 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2171/4641] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:40.469024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:40.474533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:40.492940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:40.493417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:40.495566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:40.496895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:41.201538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:41.215560 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-edde890a-6c0c-42dd-9802-041b41e48582 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1606 microversion: 2.1 time: 0.757362 Apr 02 21:09:41.230109 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2172/4642] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:40 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1606 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:41.232320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:41.234691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:41.254016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:41.256003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:41.258169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:41.259957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:41.415589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:41.426861 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afaf563d-cf6d-4ad5-ba0e-9b18e660d3ce tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1279 microversion: 2.1 time: 0.203382 Apr 02 21:09:41.427467 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2173/4643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:41 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:42.460208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:42.461518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:42.470287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:42.474613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:42.475821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:42.476479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:42.590939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:42.609247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-10b851b9-c870-4914-80ee-655dc4f73c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1279 microversion: 2.1 time: 0.163399 Apr 02 21:09:42.611339 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2174/4644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:42 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:42.926549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Building network info cache for instance {{(pid=136518) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 21:09:42.951260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c7e2b16d-7776-4e98-880e-5876454cf6ab req-3f5c780d-5ca8-40f2-8d43-e5aa384e6364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:42.966202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c7e2b16d-7776-4e98-880e-5876454cf6ab req-3f5c780d-5ca8-40f2-8d43-e5aa384e6364 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:42.970034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c7e2b16d-7776-4e98-880e-5876454cf6ab req-3f5c780d-5ca8-40f2-8d43-e5aa384e6364 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:42.992132 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c7e2b16d-7776-4e98-880e-5876454cf6ab req-3f5c780d-5ca8-40f2-8d43-e5aa384e6364 service nova] Creating event network-changed:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:09:43.005749 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c7e2b16d-7776-4e98-880e-5876454cf6ab req-3f5c780d-5ca8-40f2-8d43-e5aa384e6364 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057889 Apr 02 21:09:43.006502 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2175/4645] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:43.629869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:43.630712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:43.653427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:43.654057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:43.658356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:43.658831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:44.127542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:44.137430 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c0acdb5-6e38-4177-9201-63e1bf36e3c9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.514404 Apr 02 21:09:44.150577 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2176/4646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:43 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:44.441204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:44.442326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:44.452131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:44.453099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:44.454354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:44.455011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:44.487073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:09:44.679187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c829ed02-e51d-4e76-a985-7ab2a876311d tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 204 len: 0 microversion: 2.32 time: 0.243767 Apr 02 21:09:44.681288 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2177/4647] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:09:44 2022] DELETE /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:09:44.694438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:44.695800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:44.711661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:44.712723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:44.715095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:44.716018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:45.114218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Updating instance_info_cache with network_info: [{"id": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0", "address": "fa:16:3e:7a:ba:e8", "network": {"id": "fd76cca2-af28-4582-8f95-9239b6ffeadc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-76568670-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bcc988d584ef47dd99506305e1c7d45a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb28fcbaf-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 21:09:45.118073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:45.128100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Releasing lock "refresh_cache-d8cf911b-a146-449c-b688-0e4c1c9d1d98" {{(pid=136518) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 21:09:45.129654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:45.131050 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-574c00cd-d8b3-4681-b1cb-197cd688db44 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action" status: 202 len: 0 microversion: 2.1 time: 8.141716 Apr 02 21:09:45.132115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:45.138800 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2471/4648] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:09:36 2022] POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action => generated 0 bytes in 8150 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 21:09:45.139835 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eedad75e-db8c-4f33-9f7c-f999753a84a1 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2955 microversion: 2.32 time: 0.453546 Apr 02 21:09:45.143427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2178/4649] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:44 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2955 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:09:45.149157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-31975362-48af-413d-94f9-3983fd6945cb req-75ba82d3-3a4f-4fd5-a949-fb48f3790e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b178f6-4dca-4aeb-84ae-389b11f090d3", "tag": "d4a0a867-2de9-4d5e-8133-dcadf215b3ae"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:45.156657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.107"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:45.170898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-31975362-48af-413d-94f9-3983fd6945cb req-75ba82d3-3a4f-4fd5-a949-fb48f3790e0c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:45.171765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-31975362-48af-413d-94f9-3983fd6945cb req-75ba82d3-3a4f-4fd5-a949-fb48f3790e0c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:45.190170 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-31975362-48af-413d-94f9-3983fd6945cb req-75ba82d3-3a4f-4fd5-a949-fb48f3790e0c service nova] Creating event network-changed:d4a0a867-2de9-4d5e-8133-dcadf215b3ae for instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 on nch2-master-1 Apr 02 21:09:45.196292 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-31975362-48af-413d-94f9-3983fd6945cb req-75ba82d3-3a4f-4fd5-a949-fb48f3790e0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054213 Apr 02 21:09:45.197473 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2472/4650] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:45.209212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:45.210138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:45.217762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:45.218221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:45.219374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:45.219883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:45.687906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:45.697054 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a5a4a03-03dc-4d6e-b970-97b309bb4563 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.497697 Apr 02 21:09:45.701186 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2473/4651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:45 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:45.995884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:46.002376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.003129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:46.004183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.004877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:46.091801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3c174b23-d714-4ef6-b15a-bfbdd2c2cb18 req-9eed6c40-56e3-4ad5-983a-10e89aee61a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c962256b-4bd5-4520-863d-008d7e17cc57", "tag": "8276a875-ff1a-4096-8a72-2a3dd85f50d2"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:46.111861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3c174b23-d714-4ef6-b15a-bfbdd2c2cb18 req-9eed6c40-56e3-4ad5-983a-10e89aee61a4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.113042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3c174b23-d714-4ef6-b15a-bfbdd2c2cb18 req-9eed6c40-56e3-4ad5-983a-10e89aee61a4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:46.154717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3c174b23-d714-4ef6-b15a-bfbdd2c2cb18 req-9eed6c40-56e3-4ad5-983a-10e89aee61a4 service nova] Creating event network-changed:8276a875-ff1a-4096-8a72-2a3dd85f50d2 for instance c962256b-4bd5-4520-863d-008d7e17cc57 on nch2-master-1 Apr 02 21:09:46.177965 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3c174b23-d714-4ef6-b15a-bfbdd2c2cb18 req-9eed6c40-56e3-4ad5-983a-10e89aee61a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089823 Apr 02 21:09:46.178921 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2474/4652] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:46.197188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:46.198496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:46.211542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.212498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:46.213553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.214230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:46.675458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Acquired lock "refresh_cache-d8cf911b-a146-449c-b688-0e4c1c9d1d98" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 02 21:09:46.838275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:46.849358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:46.850941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:46.852285 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5406d59-a554-44b8-93e8-94c50cadf189 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2955 microversion: 2.32 time: 0.672021 Apr 02 21:09:46.853233 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2475/4653] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:46 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2955 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:46.858478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:46.859097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:46.866677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.867075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:46.867934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:46.868391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:47.231098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:47.241752 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-632612ac-cee5-4e4f-9bcb-e313fd739634 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.387208 Apr 02 21:09:47.242778 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2476/4654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:46 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:47.248699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-fbb5daa8-8fa4-40df-8047-846e6ec463d0 req-954baa17-f7d1-4658-80d4-d346013dda8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7840fc-ecb4-4758-b217-7e306ad61475", "tag": "d871d984-4afc-4adb-8fe8-d37565f55a01"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:47.258133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fbb5daa8-8fa4-40df-8047-846e6ec463d0 req-954baa17-f7d1-4658-80d4-d346013dda8c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:47.258936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fbb5daa8-8fa4-40df-8047-846e6ec463d0 req-954baa17-f7d1-4658-80d4-d346013dda8c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:47.274695 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-fbb5daa8-8fa4-40df-8047-846e6ec463d0 req-954baa17-f7d1-4658-80d4-d346013dda8c service nova] Creating event network-changed:d871d984-4afc-4adb-8fe8-d37565f55a01 for instance 8b7840fc-ecb4-4758-b217-7e306ad61475 on nch1-master-1 Apr 02 21:09:47.280447 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-fbb5daa8-8fa4-40df-8047-846e6ec463d0 req-954baa17-f7d1-4658-80d4-d346013dda8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036151 Apr 02 21:09:47.281371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2477/4655] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:47.874656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:47.875911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:47.884235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:47.884934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:47.886704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:47.887322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:47.927756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Building network info cache for instance {{(pid=136517) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 02 21:09:48.487044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:48.500215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:48.510059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:48.513610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fadef4cd-e7aa-4b17-b50a-74550ebb80cb tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2955 microversion: 2.32 time: 0.642076 Apr 02 21:09:48.514553 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2478/4656] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:47 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2955 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:09:48.520703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:48.521343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:48.529005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:48.529480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:48.530914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:48.531572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:48.600266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Updating instance_info_cache with network_info: [{"id": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0", "address": "fa:16:3e:7a:ba:e8", "network": {"id": "fd76cca2-af28-4582-8f95-9239b6ffeadc", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-76568670-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bcc988d584ef47dd99506305e1c7d45a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb28fcbaf-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136517) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 21:09:48.632168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Releasing lock "refresh_cache-d8cf911b-a146-449c-b688-0e4c1c9d1d98" {{(pid=136517) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 02 21:09:48.635341 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-70096438-e3bd-4998-8c16-9d9859dbbce1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action" status: 202 len: 0 microversion: 2.1 time: 3.489572 Apr 02 21:09:48.636297 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2179/4657] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:09:45 2022] POST /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98/action => generated 0 bytes in 3492 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 02 21:09:48.643717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-12c8f1d4-76b9-49ba-9f62-3bccccdbcc64 req-d65d5eed-5bcb-4bcc-a5c0-c251d995ce31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:48.660367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-12c8f1d4-76b9-49ba-9f62-3bccccdbcc64 req-d65d5eed-5bcb-4bcc-a5c0-c251d995ce31 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:48.662419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-12c8f1d4-76b9-49ba-9f62-3bccccdbcc64 req-d65d5eed-5bcb-4bcc-a5c0-c251d995ce31 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:48.691575 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-12c8f1d4-76b9-49ba-9f62-3bccccdbcc64 req-d65d5eed-5bcb-4bcc-a5c0-c251d995ce31 service nova] Creating event network-changed:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:09:48.697431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-12c8f1d4-76b9-49ba-9f62-3bccccdbcc64 req-d65d5eed-5bcb-4bcc-a5c0-c251d995ce31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059835 Apr 02 21:09:48.698409 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2180/4658] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:48.703736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62f3fee8-3f80-4e67-990c-e27cc298edca tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '.version_select at 0x7f54d5052670>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:49.098166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:49.110760 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4297453-d970-4a0b-9a2c-009bbed783a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.594956 Apr 02 21:09:49.121898 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2479/4659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:48 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:49.541309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:49.542101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:49.556898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:49.557368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:49.560223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:49.563347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:50.242842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:50.257714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:50.263933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:50.268090 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81eea19d-1075-43f5-9d71-d3e97c5e6990 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2934 microversion: 2.32 time: 0.732540 Apr 02 21:09:50.269193 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2480/4660] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:49 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2934 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:09:50.293512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:50.296279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:50.306091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:50.306923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:50.308294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:50.309019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:50.605766 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62f3fee8-3f80-4e67-990c-e27cc298edca tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/cc0ac36c-bc58-4ffb-99c4-783f1ab94bb1" status: 202 len: 0 microversion: 2.1 time: 1.905947 Apr 02 21:09:50.606356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2181/4661] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:09:48 2022] DELETE /compute/v2.1/os-floating-ips/cc0ac36c-bc58-4ffb-99c4-783f1ab94bb1 => generated 0 bytes in 1907 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:09:50.616906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3434878b-0594-47c9-9025-d06323dbe7c9 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '.version_select at 0x7f54d41f2160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:50.825726 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3434878b-0594-47c9-9025-d06323dbe7c9 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0426a9b8-1cf3-405c-8a6f-fcdd54eb5573" status: 202 len: 0 microversion: 2.1 time: 0.213274 Apr 02 21:09:50.826874 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2182/4662] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:09:50 2022] DELETE /compute/v2.1/os-security-groups/0426a9b8-1cf3-405c-8a6f-fcdd54eb5573 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:09:50.842416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:50.843083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:50.850956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:50.851412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:50.852218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:50.852709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:50.881126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:09:50.978111 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e79c5e5-b2b6-4e63-a119-bf25494aa3da tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 204 len: 0 microversion: 2.1 time: 0.145553 Apr 02 21:09:50.979651 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2183/4663] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:09:50 2022] DELETE /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:09:50.989971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:50.991217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:50.998507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:50.999321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:51.000695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:51.001363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:51.043669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:51.068667 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a6f51eb-0107-4ae3-92a9-531720b6d9fa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.782491 Apr 02 21:09:51.069338 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2481/4664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:50 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:51.223383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:51.254662 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21ce274f-3615-4b96-b23a-495aefd13827 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1507 microversion: 2.1 time: 0.269351 Apr 02 21:09:51.268872 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2184/4665] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:50 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:51.293834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:51.294819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:51.313603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:51.316134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:51.317013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:51.317928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:51.505780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-dffbd536-b27b-40d7-8528-1448eb8ca169 req-ba67aeb8-c6f4-4c92-a47c-54e9da6abe5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b178f6-4dca-4aeb-84ae-389b11f090d3", "name": "network-vif-plugged", "status": "completed", "tag": "d4a0a867-2de9-4d5e-8133-dcadf215b3ae"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:51.527781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dffbd536-b27b-40d7-8528-1448eb8ca169 req-ba67aeb8-c6f4-4c92-a47c-54e9da6abe5c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:51.534600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dffbd536-b27b-40d7-8528-1448eb8ca169 req-ba67aeb8-c6f4-4c92-a47c-54e9da6abe5c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:51.552576 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-dffbd536-b27b-40d7-8528-1448eb8ca169 req-ba67aeb8-c6f4-4c92-a47c-54e9da6abe5c service nova] Creating event network-vif-plugged:d4a0a867-2de9-4d5e-8133-dcadf215b3ae for instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 on nch2-master-1 Apr 02 21:09:51.558233 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-dffbd536-b27b-40d7-8528-1448eb8ca169 req-ba67aeb8-c6f4-4c92-a47c-54e9da6abe5c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058510 Apr 02 21:09:51.559153 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2185/4666] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:51.704179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:51.718324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:51.722519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:51.725060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e791b6be-1f9e-4f84-81b8-2a3d67ba83b2 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2913 microversion: 2.32 time: 0.437235 Apr 02 21:09:51.728024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2482/4667] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:51 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2913 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:52.087128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:52.088589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:52.095668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.096423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:52.097486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.098167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:52.258972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:52.266945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4430a4b0-0e77-4e10-bb7f-8e6f50c8b105 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.184550 Apr 02 21:09:52.276545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2186/4668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:52 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:52.281498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:52.283535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:52.290461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.290931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:52.292697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.293523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:52.483346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-1a9073cf-9f0e-486f-a55c-55a31b71bec4 req-e4b3d599-ba11-407c-bf0a-6fafc661430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-deleted", "tag": "f4c519a1-4b21-4dac-b3f9-1667e9aca676"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:52.491576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1a9073cf-9f0e-486f-a55c-55a31b71bec4 req-e4b3d599-ba11-407c-bf0a-6fafc661430d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.492167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1a9073cf-9f0e-486f-a55c-55a31b71bec4 req-e4b3d599-ba11-407c-bf0a-6fafc661430d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:52.504663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-1a9073cf-9f0e-486f-a55c-55a31b71bec4 req-e4b3d599-ba11-407c-bf0a-6fafc661430d service nova] Creating event network-vif-deleted:f4c519a1-4b21-4dac-b3f9-1667e9aca676 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:52.510034 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-1a9073cf-9f0e-486f-a55c-55a31b71bec4 req-e4b3d599-ba11-407c-bf0a-6fafc661430d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Apr 02 21:09:52.510645 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2187/4669] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:52.685347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:52.695190 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6175885b-393a-4fdc-9c1f-ea5dcaabec04 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1507 microversion: 2.1 time: 0.417527 Apr 02 21:09:52.696687 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2483/4670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:52 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:09:52.750936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:52.752069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:52.758683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.759435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:52.761185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:52.762196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:53.209662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:53.222681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:53.224820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:53.226399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c3a26f15-fef2-4a5f-afaa-230b8fdb6b65 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2753 microversion: 2.32 time: 0.480052 Apr 02 21:09:53.229221 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2188/4671] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:52 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2753 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:53.285699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:53.288411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:53.299909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:53.300775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:53.301991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:53.302696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:53.593369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "9aa225bb-5f59-4695-9481-c8b83a23a8f6"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "54ba32fa-f94c-4790-91a7-b7d8bc9665c3"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "a43c7f16-83a8-4758-918d-0bd3f2393170"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "adcb837b-7ab2-4b3e-98c2-1a56402cc8a9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:53.613982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:53.614969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:53.654772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Creating event network-vif-unplugged:9aa225bb-5f59-4695-9481-c8b83a23a8f6 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:53.655317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Creating event network-vif-unplugged:54ba32fa-f94c-4790-91a7-b7d8bc9665c3 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:53.657416 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Creating event network-vif-unplugged:a43c7f16-83a8-4758-918d-0bd3f2393170 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:53.660247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] Creating event network-vif-unplugged:adcb837b-7ab2-4b3e-98c2-1a56402cc8a9 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:53.676015 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-aac81dd9-f677-4290-a49f-432190404a5f req-2c5a7176-cb81-4471-ae95-cee31ccfa7d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.090785 Apr 02 21:09:53.678998 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2189/4672] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:53.682236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:53.694068 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9ea0692-3c74-4427-8f28-fe00030d0f73 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.413334 Apr 02 21:09:53.712000 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2484/4673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:53 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:53.713855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:53.714567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:53.722813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:53.723284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:53.724214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:53.724690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.087750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:54.100893 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8133ba60-580a-4b33-85b3-0cc1921ec1ee tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1507 microversion: 2.1 time: 0.391140 Apr 02 21:09:54.101685 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2190/4674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:53 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:54.249549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:54.250184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:54.259172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:54.259652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.260603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:54.260935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.539621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a043c0fb-601a-4a32-8a86-799a91bbf397 req-8fd9f718-9c6b-4097-86e6-1e82c43e2a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-deleted", "tag": "54ba32fa-f94c-4790-91a7-b7d8bc9665c3"}, {"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-deleted", "tag": "a43c7f16-83a8-4758-918d-0bd3f2393170"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:54.555021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a043c0fb-601a-4a32-8a86-799a91bbf397 req-8fd9f718-9c6b-4097-86e6-1e82c43e2a67 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:54.556020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a043c0fb-601a-4a32-8a86-799a91bbf397 req-8fd9f718-9c6b-4097-86e6-1e82c43e2a67 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.602554 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a043c0fb-601a-4a32-8a86-799a91bbf397 req-8fd9f718-9c6b-4097-86e6-1e82c43e2a67 service nova] Creating event network-vif-deleted:54ba32fa-f94c-4790-91a7-b7d8bc9665c3 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:54.605154 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a043c0fb-601a-4a32-8a86-799a91bbf397 req-8fd9f718-9c6b-4097-86e6-1e82c43e2a67 service nova] Creating event network-vif-deleted:a43c7f16-83a8-4758-918d-0bd3f2393170 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:54.613761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a043c0fb-601a-4a32-8a86-799a91bbf397 req-8fd9f718-9c6b-4097-86e6-1e82c43e2a67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079365 Apr 02 21:09:54.615246 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2191/4675] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:54.708836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:54.716953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:54.718298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:54.737584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:54.741176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:54.742425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.744908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:54.745871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.759996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:54.764007 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aaf5346f-43d9-40b1-a13b-122b658716b0 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2659 microversion: 2.32 time: 0.520611 Apr 02 21:09:54.778036 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2485/4676] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:54 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2659 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:54.799562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-dbddaa99-5259-48bc-b02d-467533e5af50 req-101976e1-d86a-4ae1-b872-de98db69f22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cf911b-a146-449c-b688-0e4c1c9d1d98", "name": "network-vif-deleted", "tag": "b28fcbaf-3ff6-425d-9d5f-94717a20f5a0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:54.828691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-dbddaa99-5259-48bc-b02d-467533e5af50 req-101976e1-d86a-4ae1-b872-de98db69f22c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:54.831196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-dbddaa99-5259-48bc-b02d-467533e5af50 req-101976e1-d86a-4ae1-b872-de98db69f22c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:54.859032 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-dbddaa99-5259-48bc-b02d-467533e5af50 req-101976e1-d86a-4ae1-b872-de98db69f22c service nova] Creating event network-vif-deleted:b28fcbaf-3ff6-425d-9d5f-94717a20f5a0 for instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 on nch1-master-1 Apr 02 21:09:54.867762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-dbddaa99-5259-48bc-b02d-467533e5af50 req-101976e1-d86a-4ae1-b872-de98db69f22c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088081 Apr 02 21:09:54.869309 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2486/4677] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:55.112726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:55.121899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:55.123140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:55.127909 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e64b8cf3-9adf-4510-9d31-4a8d7a62c4db tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.418518 Apr 02 21:09:55.129811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2192/4678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:54 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:55.139633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:55.141354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:55.142816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:55.146595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:55.239761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:55.241253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:55.242734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lazy-loading 'fault' on Instance uuid d8cf911b-a146-449c-b688-0e4c1c9d1d98 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:09:55.460736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f75a3bb7e8417791babaae0fda1c39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc988d584ef47dd99506305e1c7d45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:55.471305 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a601ff08-b3e8-421d-b86f-777ba3d2718d tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 200 len: 1312 microversion: 2.1 time: 0.353491 Apr 02 21:09:55.471960 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2487/4679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:55 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 1312 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:55.788754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:55.789878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:55.796337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:55.797001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:55.798586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:55.799478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.023853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:56.035476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:56.037501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:56.039172 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a1d2782-e958-4085-9d78-cca5072998c8 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 2385 microversion: 2.32 time: 0.254776 Apr 02 21:09:56.040200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2193/4680] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:55 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 2385 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:56.151087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:56.151907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:56.159787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:56.160305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.161292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:56.161822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.499609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:56.503854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] [instance: d8cf911b-a146-449c-b688-0e4c1c9d1d98] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:56.509989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:56.518920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:56.519838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.520881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:56.521571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.521714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea0ee2e5-57ff-4459-b214-2c96050b3334 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.378693 Apr 02 21:09:56.525978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2488/4681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:56 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:56.557567 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] HTTP exception thrown: Instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 could not be found. Apr 02 21:09:56.557800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] Returning 404 to user: Instance d8cf911b-a146-449c-b688-0e4c1c9d1d98 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:56.558885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-740e172f-8818-409a-a723-ee48510174a1 tempest-ServerRescueTestJSONUnderV235-438275540 tempest-ServerRescueTestJSONUnderV235-438275540-project] 10.222.0.18 "GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98" status: 404 len: 111 microversion: 2.1 time: 0.073699 Apr 02 21:09:56.560257 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2194/4682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:56 2022] GET /compute/v2.1/servers/d8cf911b-a146-449c-b688-0e4c1c9d1d98 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:09:56.649849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e1a85161-7c1b-4ed7-bc0e-bb7961c69bf7 req-93364ae7-0812-4b58-b0b2-a8968a5417f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-deleted", "tag": "adcb837b-7ab2-4b3e-98c2-1a56402cc8a9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:56.672038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e1a85161-7c1b-4ed7-bc0e-bb7961c69bf7 req-93364ae7-0812-4b58-b0b2-a8968a5417f4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:56.672038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e1a85161-7c1b-4ed7-bc0e-bb7961c69bf7 req-93364ae7-0812-4b58-b0b2-a8968a5417f4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.692636 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e1a85161-7c1b-4ed7-bc0e-bb7961c69bf7 req-93364ae7-0812-4b58-b0b2-a8968a5417f4 service nova] Creating event network-vif-deleted:adcb837b-7ab2-4b3e-98c2-1a56402cc8a9 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:56.703539 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e1a85161-7c1b-4ed7-bc0e-bb7961c69bf7 req-93364ae7-0812-4b58-b0b2-a8968a5417f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059633 Apr 02 21:09:56.710776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2489/4683] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:09:56.912573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3d659307-7a28-4f8c-8309-2f3de0a1dce3 req-2b86b2a8-c692-49d5-8969-f9fb07af9627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7840fc-ecb4-4758-b217-7e306ad61475", "name": "network-vif-plugged", "status": "completed", "tag": "d871d984-4afc-4adb-8fe8-d37565f55a01"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:56.934607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3d659307-7a28-4f8c-8309-2f3de0a1dce3 req-2b86b2a8-c692-49d5-8969-f9fb07af9627 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:56.935783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3d659307-7a28-4f8c-8309-2f3de0a1dce3 req-2b86b2a8-c692-49d5-8969-f9fb07af9627 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:56.963608 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3d659307-7a28-4f8c-8309-2f3de0a1dce3 req-2b86b2a8-c692-49d5-8969-f9fb07af9627 service nova] Creating event network-vif-plugged:d871d984-4afc-4adb-8fe8-d37565f55a01 for instance 8b7840fc-ecb4-4758-b217-7e306ad61475 on nch1-master-1 Apr 02 21:09:56.972106 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3d659307-7a28-4f8c-8309-2f3de0a1dce3 req-2b86b2a8-c692-49d5-8969-f9fb07af9627 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065048 Apr 02 21:09:56.973296 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2195/4684] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:57.064194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:57.065380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:57.077426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:57.081298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:57.084971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:57.085907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:57.236956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:57.254241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:57.261921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee1c48c096304c819e0eac11e84aef26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fad5516982b843a9a35e49795fda0844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:57.268870 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2a6f35b2-da9a-4c4e-a4eb-24ca0bf07b9a tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 200 len: 1605 microversion: 2.32 time: 0.208903 Apr 02 21:09:57.272553 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2490/4685] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:57 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 1605 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:09:57.542638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:57.543463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:57.561731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:57.562419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:57.565527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:57.568312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:58.287968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:58.288640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:58.301116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:58.302085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:58.303186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:58.304091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:58.338331 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] HTTP exception thrown: Instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 could not be found. Apr 02 21:09:58.339424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Returning 404 to user: Instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:09:58.341090 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe527f18-8b56-4e43-8707-6cd2c35b3c85 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 404 len: 111 microversion: 2.32 time: 0.056924 Apr 02 21:09:58.342064 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2491/4686] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:09:58 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:09:58.352530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7d8b6651-51e4-4de0-b5d3-f201c876dc45 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '.version_select at 0x7f54c7a63f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:58.366663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:58.374829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5f15f8b-c7c1-4c8e-a374-a998904f1c66 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1321 microversion: 2.1 time: 0.838607 Apr 02 21:09:58.375431 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2196/4687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:57 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1321 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:58.388067 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7d8b6651-51e4-4de0-b5d3-f201c876dc45 tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949193056" status: 204 len: 0 microversion: 2.32 time: 0.040574 Apr 02 21:09:58.389015 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2492/4688] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Apr 2 21:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949193056 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:09:58.731224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a979745f-772a-4816-b176-bc6bec14ea30 req-25dd61ac-0b1b-4ca9-b1ae-84cc94718bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5906eb78-b7a6-4251-ba3c-70af5d16e9a2", "name": "network-vif-deleted", "tag": "9aa225bb-5f59-4695-9481-c8b83a23a8f6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:58.776131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a979745f-772a-4816-b176-bc6bec14ea30 req-25dd61ac-0b1b-4ca9-b1ae-84cc94718bf2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:58.781264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a979745f-772a-4816-b176-bc6bec14ea30 req-25dd61ac-0b1b-4ca9-b1ae-84cc94718bf2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:58.827628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a979745f-772a-4816-b176-bc6bec14ea30 req-25dd61ac-0b1b-4ca9-b1ae-84cc94718bf2 service nova] Creating event network-vif-deleted:9aa225bb-5f59-4695-9481-c8b83a23a8f6 for instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 on nch2-master-1 Apr 02 21:09:58.836586 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a979745f-772a-4816-b176-bc6bec14ea30 req-25dd61ac-0b1b-4ca9-b1ae-84cc94718bf2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116179 Apr 02 21:09:58.838139 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2197/4689] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:09:59.393515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:59.394238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:59.406066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:59.406760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:59.408115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:59.409474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:59.696364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:09:59.713060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1caea063-3313-4dbe-a4de-14a763f51c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1515 microversion: 2.1 time: 0.325293 Apr 02 21:09:59.714864 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2493/4690] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:59 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:09:59.738829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:09:59.740632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:59.756839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:59.768726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:59.772388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:59.778631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:59.826032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'flavor' on Instance uuid 8b7840fc-ecb4-4758-b217-7e306ad61475 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:09:59.939171 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4930887-3534-4f44-a23e-5e1a676979e9 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475/action" status: 200 len: 32 microversion: 2.1 time: 0.207711 Apr 02 21:09:59.940089 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2198/4691] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:09:59 2022] POST /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:09:59.950318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:09:59.951101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:09:59.958791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:59.959132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:09:59.960650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:09:59.961153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:00.447394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:00.464996 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a9bd609-29a3-4c78-95b2-86aa80213c33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.518382 Apr 02 21:10:00.466425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2494/4692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:09:59 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:01.485374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:01.486268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:01.492867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:01.493666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:01.494421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:01.494855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:02.054751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:02.066205 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-185e8684-58d3-48bd-99a4-5f7fbc8a5146 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.583775 Apr 02 21:10:02.076436 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2199/4693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:01 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:03.083841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:03.084479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:03.102800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:03.103854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:03.105131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:03.105628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:03.252823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:03.266289 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a1cb8be-f16f-43ae-8e77-69751f28c497 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.186670 Apr 02 21:10:03.267212 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2495/4694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:03 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:04.030145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:04.034245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:04.045702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.046436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.047426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.048666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.065693 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] HTTP exception thrown: Instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 could not be found. Apr 02 21:10:04.066793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Returning 404 to user: Instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:04.069440 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dffbe1b9-c79e-4ac7-8e36-4ca0455454ed tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 404 len: 111 microversion: 2.32 time: 0.058532 Apr 02 21:10:04.070568 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2200/4695] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:10:04 2022] DELETE /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:10:04.080675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:04.081601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] [instance: 5906eb78-b7a6-4251-ba3c-70af5d16e9a2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:04.090965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.092132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.093683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.094327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.113752 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] HTTP exception thrown: Instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 could not be found. Apr 02 21:10:04.114517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] Returning 404 to user: Instance 5906eb78-b7a6-4251-ba3c-70af5d16e9a2 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:04.115722 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae5aab82-e59a-4c0b-9d45-3a5fb61412df tempest-TaggedBootDevicesTest-776080868 tempest-TaggedBootDevicesTest-776080868-project] 10.222.0.18 "GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2" status: 404 len: 111 microversion: 2.32 time: 0.041026 Apr 02 21:10:04.119282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2496/4696] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:04 2022] GET /compute/v2.1/servers/5906eb78-b7a6-4251-ba3c-70af5d16e9a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 02 21:10:04.283187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:04.283819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:04.290790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.294581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.295895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.296565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.495514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:04.504562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f3b9eed-dc3f-4a5a-a643-f3cd8d3beef4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.225165 Apr 02 21:10:04.505551 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2201/4697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:04 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:04.674552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1117951572", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": "none"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:04.730970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:10:04.731394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:10:04.732077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:10:04.732691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:10:04.733278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:10:04.743573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.744031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.744944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:04.745386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:04.763713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Getting quotas for project 6b10b2726e7c4fb385dd98063b209656. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:10:04.769393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Getting quotas for user 3156f3a86961452eac493ee89e4f56fd and project 6b10b2726e7c4fb385dd98063b209656. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:10:04.784018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:10:04.786411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:10:04.854893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a630d0f4-3abf-4f16-abd1-4b3e16d62725 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.324268 Apr 02 21:10:04.856072 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2497/4698] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Apr 2 21:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 02 21:10:04.867824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db51b656-ca05-41a3-9b53-8fb57cf29643 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:04.868712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db51b656-ca05-41a3-9b53-8fb57cf29643 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:04.949426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db51b656-ca05-41a3-9b53-8fb57cf29643 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:04.960763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db51b656-ca05-41a3-9b53-8fb57cf29643 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:04.962712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db51b656-ca05-41a3-9b53-8fb57cf29643 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:04.970219 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db51b656-ca05-41a3-9b53-8fb57cf29643 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1278 microversion: 2.54 time: 0.106973 Apr 02 21:10:04.970895 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2202/4699] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:04 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:05.524786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:05.527061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:05.537423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:05.537888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:05.538813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:05.539370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:05.991180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:05.991734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:05.999325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:05.999914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:06.000832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:06.002074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:06.066302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:06.074942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:06.076482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:06.077638 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-936fd6f3-acad-4814-8b84-ba09bcaf51c1 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1336 microversion: 2.54 time: 0.090753 Apr 02 21:10:06.078204 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2203/4700] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:05 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:06.141109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:06.148619 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aafc3c6e-2531-4cde-abcf-fecc199d70fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.630410 Apr 02 21:10:06.149232 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2498/4701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:05 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:07.103936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:07.104600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:07.112234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:07.113217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:07.114098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:07.114838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:07.166339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:07.167131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:07.174995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:07.175632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:07.176817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:07.177502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:07.193191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:07.201245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:07.202763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:07.204636 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-80921614-4c77-453f-827c-31e3f1dfb155 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1336 microversion: 2.54 time: 0.111548 Apr 02 21:10:07.205531 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2204/4702] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:07 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:07.379845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:07.387977 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9421a7b5-6336-4bda-a30e-aa496e02225b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.226443 Apr 02 21:10:07.396846 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2499/4703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:07 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:08.224766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:08.225844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:08.237250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:08.237908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:08.238906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:08.239317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:08.341446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:08.350139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:08.351742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:08.353014 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3fc9c94-4d12-433b-9114-dc3a23ba1073 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1336 microversion: 2.54 time: 0.133280 Apr 02 21:10:08.353840 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2205/4704] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:08 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:08.405497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:08.406116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:08.412868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:08.413326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:08.414104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:08.414548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:08.654448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:08.662883 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-639160a8-5058-4d6e-aeda-09f184ce4a1b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.261382 Apr 02 21:10:08.663505 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2500/4705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:08 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:09.371472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:09.372115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:09.379681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:09.380142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:09.380979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:09.381426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:09.477915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:09.485866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:09.487399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:09.488577 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ccb5c000-4675-4d6d-a059-d5f89e3ca37a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1336 microversion: 2.54 time: 0.121195 Apr 02 21:10:09.489149 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2206/4706] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:09 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:09.680120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:09.685326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:09.694183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:09.694642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:09.695521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:09.695974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:09.841912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:09.852842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-743cd643-6688-4084-8bb1-c82bb95c5dc3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.176812 Apr 02 21:10:09.853593 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2501/4707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:09 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:10.507085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:10.508176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:10.515101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:10.515558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:10.516895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:10.517760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:10.617920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:10.626703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:10.628830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:10.630424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bd030df-37d0-42b9-a7cd-53e4bc4562e4 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1357 microversion: 2.54 time: 0.127098 Apr 02 21:10:10.631621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2207/4708] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:10 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1357 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:10.652725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5df5529c-a732-4d63-9065-0692c8379736 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Action: 'create', calling method: .version_select at 0x7f54c7cc5280>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1562687569"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:10.669119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5df5529c-a732-4d63-9065-0692c8379736 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Getting quotas for project 6b10b2726e7c4fb385dd98063b209656. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:10:10.675969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5df5529c-a732-4d63-9065-0692c8379736 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Getting quotas for user 3156f3a86961452eac493ee89e4f56fd and project 6b10b2726e7c4fb385dd98063b209656. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:10:10.869615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:10.870231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:10.877223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:10.877686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:10.878775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:10.879390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.014271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5df5529c-a732-4d63-9065-0692c8379736 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Getting quotas for project 6b10b2726e7c4fb385dd98063b209656. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:10:11.020669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5df5529c-a732-4d63-9065-0692c8379736 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Getting quotas for user 3156f3a86961452eac493ee89e4f56fd and project 6b10b2726e7c4fb385dd98063b209656. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:10:11.042109 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5df5529c-a732-4d63-9065-0692c8379736 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.54 time: 0.393147 Apr 02 21:10:11.043014 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2502/4709] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Apr 2 21:10:10 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 395 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:10:11.054330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1562687569", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:11.056508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:11.062952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:11.064049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.064967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:11.065627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.162580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:10:11.163006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:10:11.163484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:10:11.163915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:10:11.164352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:10:11.166684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:11.175550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc4fdfe3-0ba6-43ec-8659-5179ff69e96e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.309618 Apr 02 21:10:11.176792 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2208/4710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:10 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:11.256788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:11.261611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:11.262069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.262867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:11.263309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.301003 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2577d0f3-8b5f-4216-8468-b4825f31d72a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "POST /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810/action" status: 202 len: 1140 microversion: 2.54 time: 0.251342 Apr 02 21:10:11.301880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2503/4711] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Apr 2 21:10:11 2022] POST /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810/action => generated 1140 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Apr 02 21:10:11.317583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:11.318319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:11.324967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:11.325741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.326756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:11.327309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:11.407217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:11.421212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:11.425449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:11.426680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9950c00-1ef4-4f89-9d92-a179afe290fa tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.113571 Apr 02 21:10:11.431144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2209/4712] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:11 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:12.194769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:12.195547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:12.202735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:12.203437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:12.204990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:12.205524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:12.449258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:12.449891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:12.458280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:12.458753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:12.459831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:12.460800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:12.506362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:12.514608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-40a16f96-d6d9-4312-ab6b-78ccaed3008f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.324878 Apr 02 21:10:12.515284 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2504/4713] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:12 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:12.539975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:12.548367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:12.550239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:12.551525 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-43e9eae7-3a5b-4de1-aadf-c6f723767eae tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.106221 Apr 02 21:10:12.552194 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2210/4714] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:12 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:13.535474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:13.538407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:13.551879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:13.552216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:13.553256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:13.554591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:13.570504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:13.571709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:13.586156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:13.588215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:13.589707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:13.592171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:13.769232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:13.778820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:13.780562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:13.783265 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-505601b6-29a6-4c3d-b7c2-8c9531f1ee70 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.215485 Apr 02 21:10:13.790148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2211/4715] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:13 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:14.086095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:14.096703 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e80c1d07-6943-4d8e-a0bf-5c1aac1e2359 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.569229 Apr 02 21:10:14.109887 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2505/4716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:13 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:14.802713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:14.803272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:14.819876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:14.820350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:14.821205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:14.821661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:14.963695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:14.981610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:14.983443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:14.985375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25115c4d-fa5c-49b3-8c8f-0e28a06660ec tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.186957 Apr 02 21:10:14.986678 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2212/4717] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:14 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:15.118919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:15.120190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:15.128394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:15.129180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:15.130317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:15.130996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:15.429105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:15.465461 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e32cc9ce-dd73-486f-b892-e8bdb759cc0f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.348013 Apr 02 21:10:15.466785 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2506/4718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:15 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:16.014544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:16.015439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:16.034960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:16.035665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:16.039715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:16.040279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:16.146641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:16.159783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:16.164576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:16.170638 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a8ac9ea-1958-463c-9b24-360c0cae4be2 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.169972 Apr 02 21:10:16.173343 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2213/4719] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:15 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:16.483579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:16.484208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:16.498793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:16.499258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:16.500158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:16.503493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:17.137807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:17.147029 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99b27192-5ffe-4740-b240-c7f9a31755b2 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.667326 Apr 02 21:10:17.149646 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2507/4720] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:16 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:17.192268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:17.192927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:17.206546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:17.207034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:17.207854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:17.208616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:17.331221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:17.341030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:17.342582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:17.343783 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-77b33995-a4ee-4a8b-a8a8-9eb740245a91 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.156225 Apr 02 21:10:17.344791 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2214/4721] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:17 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:18.167571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:18.168633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:18.176367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:18.177109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:18.177904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:18.178606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:18.364549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:18.365254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:18.373860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:18.374428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:18.375862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:18.376583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:18.454470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:18.466078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:18.468326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:18.470260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11a2bfb9-4c02-4a2e-a888-adf2bd3118ed tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.111306 Apr 02 21:10:18.471304 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2215/4722] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:18 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:18.590455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:18.600695 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e9cb051-47b8-42e9-b366-71ce0a297eff tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.438661 Apr 02 21:10:18.602066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2508/4723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:18 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:19.490945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:19.491601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:19.498865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:19.499577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:19.500368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:19.501063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:19.599915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:19.618802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:19.619426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:19.619580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:19.621298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:19.622519 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0a009a70-dccc-44fa-8bd4-dd280da79d19 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.136628 Apr 02 21:10:19.623097 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2216/4724] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:19 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:19.627999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:19.628491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:19.629309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:19.629746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:19.879500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:19.888623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34fe69da-8342-40ab-8196-a989d99e2561 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.274665 Apr 02 21:10:19.899154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2509/4725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:19 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:20.643943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:20.645204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:20.655414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:20.656070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:20.657643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:20.658200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:20.737008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:20.756937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:20.760870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:20.762327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d8424f92-3635-414b-934a-6d2b07ff8ac3 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.123057 Apr 02 21:10:20.762977 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2217/4726] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:20 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:20.908722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:20.910599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:20.926046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:20.926515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:20.927595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:20.928194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:21.198042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:21.224734 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02dd51e0-9e45-432f-a9ad-9b2f22dc8c9b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.322000 Apr 02 21:10:21.225358 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2510/4727] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:20 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:21.635566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:21.636131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:21.644298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:21.645557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:21.646557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:21.647190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:21.680135 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-038d375b-e424-4e64-881a-18dbac042758 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.049727 Apr 02 21:10:21.681873 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2218/4728] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:10:21 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57/os-server-password => generated 116 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:21.781695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:21.782708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:21.793968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:21.794833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:21.796033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:21.796735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:21.910513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:21.928738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:21.932759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:21.934832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a38f9b0-0b28-49b9-ad43-2db5e9c0b378 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.156942 Apr 02 21:10:21.935535 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2511/4729] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:21 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:22.247511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:22.248592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:22.256926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:22.257399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:22.258263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:22.258944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:22.601009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:22.611425 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a91b929e-79be-401b-8a2c-09c1ac821db0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.373373 Apr 02 21:10:22.612674 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2219/4730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:22 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:22.956113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:22.956780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:22.968798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:22.969659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:22.971568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:22.973006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:23.071777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:23.085737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:23.087972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:23.089486 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76bddbbb-dccd-4e0c-9f50-80c694fd1e60 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.138242 Apr 02 21:10:23.100418 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2512/4731] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:22 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:23.628866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:23.629498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:23.639055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:23.639523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:23.640321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:23.641704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:24.029003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:24.051561 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40a94e2e-0e97-40d9-a331-8448a156c164 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.425931 Apr 02 21:10:24.061525 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2220/4732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:23 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:24.107200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:24.107828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:24.115660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:24.116132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:24.116956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:24.117608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:24.200759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:24.213716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:24.216288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:24.218458 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c7eab6d-8bde-4fe2-9d56-a694b6df8b54 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.115196 Apr 02 21:10:24.220323 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2513/4733] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:24 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:25.069944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:25.072166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:25.091179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:25.092018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:25.093031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:25.093646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:25.239121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:25.239765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:25.247029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:25.247751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:25.248924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:25.249582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:25.341192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:25.355510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:25.370613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:25.372289 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6e01687-5947-45a7-8206-6e236cd46559 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.137868 Apr 02 21:10:25.377349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2514/4734] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:25 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:25.787708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:25.797710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd639bf2-994f-423c-a252-70a802518cf7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.731671 Apr 02 21:10:25.799121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2221/4735] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:25 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:26.396824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:26.398642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:26.410057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:26.410664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:26.411543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:26.412015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:26.414665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd21aa80-85cc-4259-be71-b567b637922a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'create', calling method: .version_select at 0x7f54c7d5b3a0>, body: {"keypair": {"name": "tempest-keypair-1695385279"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:26.480200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dd21aa80-85cc-4259-be71-b567b637922a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:10:26.490295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dd21aa80-85cc-4259-be71-b567b637922a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:10:26.558112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:26.571923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:26.574256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:26.576046 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-02e29b8b-ab03-40fe-8cc1-03df2d3070fe tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.184789 Apr 02 21:10:26.576933 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2222/4736] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:26 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:26.633665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dd21aa80-85cc-4259-be71-b567b637922a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:10:26.639130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dd21aa80-85cc-4259-be71-b567b637922a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:10:26.658293 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd21aa80-85cc-4259-be71-b567b637922a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.389772 Apr 02 21:10:26.659231 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2515/4737] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:10:26 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:26.817358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:26.818699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:26.826605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:26.827416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:26.828706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:26.829383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:27.026643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:27.036679 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74ef21de-4671-4920-8a59-fb3f11d32e33 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.223987 Apr 02 21:10:27.038060 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2223/4738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:26 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:27.595493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:27.596112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:27.622478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:27.623368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:27.624467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:27.625653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:27.807920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:27.826511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:27.830722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:27.836671 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5aaf4df-5302-4dc7-9b97-1a3c51283cd7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.244705 Apr 02 21:10:27.837391 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2516/4739] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:27 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:28.054707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:28.055319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:28.063960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:28.064847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:28.066052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:28.066771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:28.416897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:28.436113 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4119bcca-075a-40d2-99c7-0ab20050fc77 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.385246 Apr 02 21:10:28.446538 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2224/4740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:28 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:28.856131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:28.857218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:28.865923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:28.877723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:28.879452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:28.880081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:28.988108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:29.010586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:29.014928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:29.017581 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-acd8fee7-a827-475a-95e2-07be624758f7 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.166154 Apr 02 21:10:29.019119 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2517/4741] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:28 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:29.095153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-615590166", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fced4c-1a00-48a4-a6cd-17c45563c707"}], "security_groups": [{"name": "tempest-securitygroup--1330717944"}], "key_name": "tempest-keypair-1695385279", "user_data": "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:29.220665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] validate_networks() for [('31fced4c-1a00-48a4-a6cd-17c45563c707', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:10:29.455003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:29.455922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:29.475996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:29.476588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:29.477993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:29.478400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:29.928600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:10:29.929040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:10:29.929541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:10:29.930094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:10:29.931027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:10:29.942678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:29.943395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:29.944527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:29.945292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:29.968303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:10:29.975951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:10:29.990811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:10:29.993976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:10:30.056045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9785715c-427b-4f95-8dba-e4fe945c4357 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.965392 Apr 02 21:10:30.063223 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2225/4742] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:10:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:10:30.073313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:30.074902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:30.083174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:30.083929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:30.085108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:30.086068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:30.100174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:30.114430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3d361573-0872-4705-aa39-ca39f20a4956 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1521 microversion: 2.1 time: 0.664580 Apr 02 21:10:30.117213 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2518/4743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:29 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1521 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:30.123480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68d2cb47-10b8-4942-8015-2a3a3913a73b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:30.132715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68d2cb47-10b8-4942-8015-2a3a3913a73b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:30.204736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:30.217589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:30.222001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:30.224126 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b82296c2-07fb-4288-8a94-15ffd6e1a9ea tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.158885 Apr 02 21:10:30.239652 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2226/4744] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:30 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:30.297513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-68d2cb47-10b8-4942-8015-2a3a3913a73b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:30.305644 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68d2cb47-10b8-4942-8015-2a3a3913a73b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1238 microversion: 2.1 time: 0.186131 Apr 02 21:10:30.306244 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2519/4745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:30 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1238 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:31.133642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:31.134267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:31.144734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.145193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.146202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.147763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.244716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:31.245546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:31.259447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.260306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.262748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.264200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.358077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:31.377466 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f821c12-8522-4cf5-948d-303692ba0dd1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1501 microversion: 2.1 time: 0.248353 Apr 02 21:10:31.379557 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2227/4746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:31 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:31.386314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:31.387297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:31.396856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.397617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.398586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.399207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.463105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:31.478891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:31.483483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:31.488055 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9cecda6-c1dc-41aa-8356-c843365d253e tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.247553 Apr 02 21:10:31.489953 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2520/4747] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:31 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:31.505510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:31.506400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:31.518121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:31.528412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.528990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.529854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.530314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.531963 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a385d070-a452-48c8-807a-b43d3529ef86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1298 microversion: 2.1 time: 0.150434 Apr 02 21:10:31.532772 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2228/4748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:31 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:31.891749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:31.899882 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a391e88-eaed-4704-a385-ca5cd3c1563d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1516 microversion: 2.1 time: 0.408453 Apr 02 21:10:31.900497 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2521/4749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:31 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1516 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:31.917594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d0f120e-8d5e-421e-818c-c8604d501933 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:31.918864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d0f120e-8d5e-421e-818c-c8604d501933 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 26dc862d-9349-4bb7-bb23-3209724a9f59] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:31.924570 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-9d0f120e-8d5e-421e-818c-c8604d501933 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Instance 26dc862d-9349-4bb7-bb23-3209724a9f59 could not be found. Apr 02 21:10:31.925170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d0f120e-8d5e-421e-818c-c8604d501933 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 404 to user: Instance 26dc862d-9349-4bb7-bb23-3209724a9f59 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:31.926205 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d0f120e-8d5e-421e-818c-c8604d501933 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/26dc862d-9349-4bb7-bb23-3209724a9f59/action" status: 404 len: 111 microversion: 2.1 time: 0.012684 Apr 02 21:10:31.927116 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2229/4750] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:31 2022] POST /compute/v2.1/servers/26dc862d-9349-4bb7-bb23-3209724a9f59/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:10:31.937939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:31.938483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:31.944548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.945007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:31.946212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:31.946662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.019042 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-65ac0ccb-8323-487f-b7a2-2a6622835d4f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action" status: 202 len: 0 microversion: 2.1 time: 0.085913 Apr 02 21:10:32.019766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2522/4751] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:31 2022] POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:10:32.034346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:32.034745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:32.045865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:32.046419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.047394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:32.048205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.218157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:32.229628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ffd84c3f-3416-4378-9e66-dec9d75d6922 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1521 microversion: 2.1 time: 0.205585 Apr 02 21:10:32.231434 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2230/4752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:32 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:32.512823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:32.513680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:32.520297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:32.520785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.521564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:32.522004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.549052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:32.549852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:32.557510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:32.558021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.558954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:32.559500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:32.631693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:32.636083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:32.643879 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e760479-c8a3-40c2-b401-10cc07365c7c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1296 microversion: 2.1 time: 0.099408 Apr 02 21:10:32.651719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:32.654207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2231/4753] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:32 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:32.654670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:32.656937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7859d747-5ae6-4b29-9277-b95e6afc9038 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.148845 Apr 02 21:10:32.657674 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2523/4754] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:32 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:33.248862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:33.249488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:33.256409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.256905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.257766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.258130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.408870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:33.417873 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aec9836a-3738-47e2-a701-6873079eee12 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1501 microversion: 2.1 time: 0.172467 Apr 02 21:10:33.418768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2232/4755] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:33 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:33.436999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:33.439645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:33.452009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.452714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.454288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.455759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.491742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'flavor' on Instance uuid f1b178f6-4dca-4aeb-84ae-389b11f090d3 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:10:33.506009 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Cannot 'rescue' instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 while it is in vm_state paused Apr 02 21:10:33.506624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 409 to user: Cannot 'rescue' instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 while it is in vm_state paused {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:33.507484 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea606b23-ef5a-4290-934a-b0cb1e2f4d8e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action" status: 409 len: 144 microversion: 2.1 time: 0.076008 Apr 02 21:10:33.525739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:33.526300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:33.537141 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2524/4756] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:33 2022] POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action => generated 144 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:10:33.542086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.545502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.546285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.550973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.661356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:33.662243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:33.662790 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c5fdaf7-aa7b-4390-a1bf-4a4fa1b5d0b7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action" status: 202 len: 0 microversion: 2.1 time: 0.148880 Apr 02 21:10:33.665566 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2233/4757] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:33 2022] POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:10:33.674530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:33.678211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.678878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.679882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.680605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.684717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:33.705188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.710053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.712927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.713529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.976052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:33.985054 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d1204451-d4ba-4d8d-9a91-c1f2467471b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1364 microversion: 2.1 time: 0.326977 Apr 02 21:10:33.985668 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2525/4758] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:33 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:33.990923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:33.991540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:33.997726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.998204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:33.998973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:33.999599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:34.087351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:34.098488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:34.100353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:34.101814 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86e2c83b-1b71-474f-bfcb-80b4551d61db tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.114583 Apr 02 21:10:34.102564 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2526/4759] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:33 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:34.226097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:34.237503 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34ccadff-f745-436c-a4af-277a0f47292c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1508 microversion: 2.1 time: 0.569995 Apr 02 21:10:34.248402 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2234/4760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:33 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:34.319682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d31707f5-638f-4c7b-8de5-d8d28a7bbdb7 req-ee2f7b2c-792d-44f3-836b-3d23d97d9ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:34.333948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d31707f5-638f-4c7b-8de5-d8d28a7bbdb7 req-ee2f7b2c-792d-44f3-836b-3d23d97d9ac9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:34.334463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d31707f5-638f-4c7b-8de5-d8d28a7bbdb7 req-ee2f7b2c-792d-44f3-836b-3d23d97d9ac9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:34.382700 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d31707f5-638f-4c7b-8de5-d8d28a7bbdb7 req-ee2f7b2c-792d-44f3-836b-3d23d97d9ac9 service nova] Creating event network-changed:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:10:34.391605 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d31707f5-638f-4c7b-8de5-d8d28a7bbdb7 req-ee2f7b2c-792d-44f3-836b-3d23d97d9ac9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075409 Apr 02 21:10:34.392829 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2527/4761] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:35.001825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:35.003432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:35.011989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:35.012989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:35.014189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:35.014645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:35.121675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:35.123682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:35.131266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:35.132062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:35.133240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:35.134121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:35.186753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:35.195330 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ddc97f6d-73e2-4417-9b8b-2353f5653be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1364 microversion: 2.1 time: 0.197439 Apr 02 21:10:35.201139 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2235/4762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:34 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:35.255478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:35.260884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:35.270478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:35.289276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:35.289530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:35.289856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:35.290810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:35.290935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:35.291267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:35.292335 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba48f56e-1aad-4bb1-a53c-3c34b8887a08 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.174565 Apr 02 21:10:35.293363 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2528/4763] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:35 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:35.457728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:35.466979 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bfe424a-94e8-46e1-b112-891532eee24e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1516 microversion: 2.1 time: 0.216228 Apr 02 21:10:35.467569 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2236/4764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:35 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:36.215276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:36.216964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:36.228033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:36.229487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:36.230786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:36.231275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:36.311570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:36.312939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:36.323554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:36.324012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:36.324836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:36.325282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:36.410686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:36.418756 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9727fe7-7516-4f11-bc20-2234123c855e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1364 microversion: 2.1 time: 0.208395 Apr 02 21:10:36.419716 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2529/4765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:36 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:36.473616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:36.482468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:36.484724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:36.485995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eab9cd14-b942-45e8-b84f-eaaf04e41d1a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.178674 Apr 02 21:10:36.486827 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2237/4766] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:36 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:36.961809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:36.962837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:36.970620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:36.971090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:36.972261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:36.972855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.004779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'flavor' on Instance uuid f1b178f6-4dca-4aeb-84ae-389b11f090d3 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:10:37.091372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b1116bd5-90b2-4575-a179-94d32b578e38 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action" status: 200 len: 32 microversion: 2.1 time: 0.134117 Apr 02 21:10:37.092409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2530/4767] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:36 2022] POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action => generated 32 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:10:37.111031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:37.111957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:37.120194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:37.121190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.125229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:37.125879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.414595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:37.424273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-095f802e-b3b5-4b94-ba97-f7b5e09ec3c5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.325900 Apr 02 21:10:37.427672 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2238/4768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:37 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:37.440751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:37.441491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:37.459196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:37.459677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.460925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:37.461376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.506657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:37.507303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:37.515201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:37.515665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.516505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:37.516947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:37.658850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:37.667579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:37.669453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:37.670963 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f4c12f2-6a4c-4b06-8033-11c02e23270a tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1409 microversion: 2.54 time: 0.168302 Apr 02 21:10:37.684026 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2239/4769] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:37 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1409 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:37.764223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:37.772487 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e2de838-7705-4efd-8400-f7438f5adb96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1364 microversion: 2.1 time: 0.339476 Apr 02 21:10:37.776240 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2531/4770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:37 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:38.445921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:38.447215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:38.459802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:38.460354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:38.461251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:38.461692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:38.693541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:38.694709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:38.703619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:38.704374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:38.705417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:38.706038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:38.778875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:38.789375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:38.791037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:38.792328 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90206b73-0b93-4cfa-8ea3-7eb92497ebf8 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1415 microversion: 2.54 time: 0.104077 Apr 02 21:10:38.793000 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2532/4771] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:38 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1415 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:38.797958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:38.798642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:38.804854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:38.805625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:38.806732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:38.807034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:38.857807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:38.867673 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9528da21-8f11-4b99-805c-0ee27d77431e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.424874 Apr 02 21:10:38.869635 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2240/4772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:38 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:38.964368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:38.972328 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed38865e-d6fb-49cd-a628-93fe78453b24 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1364 microversion: 2.1 time: 0.178045 Apr 02 21:10:38.973258 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2533/4773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:39.586364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d35da22c-aaf9-4789-a694-d8fe79d1f887 req-11cbfacb-d38e-4870-b2c3-92671cb22eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-plugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:39.603023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d35da22c-aaf9-4789-a694-d8fe79d1f887 req-11cbfacb-d38e-4870-b2c3-92671cb22eaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.604350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d35da22c-aaf9-4789-a694-d8fe79d1f887 req-11cbfacb-d38e-4870-b2c3-92671cb22eaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:39.629464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d35da22c-aaf9-4789-a694-d8fe79d1f887 req-11cbfacb-d38e-4870-b2c3-92671cb22eaf service nova] Creating event network-vif-plugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:10:39.636256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d35da22c-aaf9-4789-a694-d8fe79d1f887 req-11cbfacb-d38e-4870-b2c3-92671cb22eaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056628 Apr 02 21:10:39.638078 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2241/4774] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:10:39.814538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:39.815815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:39.825010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.825742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:39.826715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.827325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:39.887898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:39.890764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:39.898436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.898895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:39.899923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.900367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:39.929128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:39.942382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:39.943896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:39.945311 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c9ebf69f-218d-4f84-98c4-b0cb8fcfbd48 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1415 microversion: 2.54 time: 0.137337 Apr 02 21:10:39.957128 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2534/4775] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:39 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1415 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:39.989530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:39.990302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:39.997375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.998140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:39.999078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:39.999755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:40.150284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:40.158398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc38032c-848c-4e6b-ac97-5bc5ce6652de tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1364 microversion: 2.1 time: 0.172962 Apr 02 21:10:40.158988 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2535/4776] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:39 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:40.211158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:40.220699 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ee11577-8e07-410f-8a06-0582fae2d9be tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.337929 Apr 02 21:10:40.230804 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2242/4777] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:39 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:40.964170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:40.964794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:40.971633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:40.972089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:40.972891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:40.973333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.038413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:41.046678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:41.048200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:41.049408 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e59ea1b-31e7-4c2e-8952-fef95e3ce5ce tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1415 microversion: 2.54 time: 0.089172 Apr 02 21:10:41.049984 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2536/4778] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:40 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1415 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:41.175406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:41.176167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:41.183307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:41.183692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.184648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:41.185111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.238175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:41.238897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:41.244955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:41.245481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.246463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:41.247087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.387315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:41.395650 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a6483d5-d745-4c7c-bfe0-f7d1843a4fd7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.161778 Apr 02 21:10:41.396245 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2537/4779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:41 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:41.506665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:41.514191 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c6182271-3698-4369-9686-2d01206fac7d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1550 microversion: 2.1 time: 0.342897 Apr 02 21:10:41.514850 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2243/4780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:41 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1550 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:41.530628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:41.531136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:41.537112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:41.537600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.538378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:41.538823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:41.623045 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-251570d5-3d47-43ad-be7f-d592cf50844a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096383 Apr 02 21:10:41.623788 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2538/4781] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:10:41 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:42.069619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:42.070810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:42.084162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.084852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.085828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.086378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.177673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.189871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.192624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.195161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd2cefa2-57b6-4c4b-bd35-2663e7601e51 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1400 microversion: 2.54 time: 0.129482 Apr 02 21:10:42.196222 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2244/4782] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:42 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1400 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:42.217109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c25a23ab-cf69-446e-8cde-29166ec1a880 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '.version_select at 0x7f54da20e310>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:42.240445 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c25a23ab-cf69-446e-8cde-29166ec1a880 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1562687569" status: 204 len: 0 microversion: 2.54 time: 0.029166 Apr 02 21:10:42.241097 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2539/4783] 10.222.0.18 () {60 vars in 1318 bytes} [Sat Apr 2 21:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1562687569 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:10:42.254105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:42.254742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:42.261372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.262006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.262895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.263466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.290316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:10:42.391027 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af66745c-d673-4b27-928e-149be8a22570 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 204 len: 0 microversion: 2.54 time: 0.135312 Apr 02 21:10:42.395440 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2245/4784] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:10:42 2022] DELETE /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:10:42.401014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:42.401642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:42.417721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:42.418447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:42.426012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.426480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.427283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.427837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.434285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.435102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.436241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:42.436727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:42.587717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.596899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.599149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.601234 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5cf18b4-babb-445c-b949-55a441b60faf tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1406 microversion: 2.54 time: 0.204397 Apr 02 21:10:42.603115 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2540/4785] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:42 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:42.853439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:42.863979 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ce9a9a8-8340-40d5-96de-e46e7c6366d8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.451462 Apr 02 21:10:42.864772 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2246/4786] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:42 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:43.619297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:43.620139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:43.627926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.628388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:43.629201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.629653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:43.747552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:43.756495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:43.758032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:43.759371 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f53bb4e-6460-4d53-b982-0ca9b6d1e276 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1406 microversion: 2.54 time: 0.144167 Apr 02 21:10:43.760144 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2541/4787] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:43 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:43.781705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:43.782687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:43.789777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.790220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:43.791013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.791457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:43.820484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a8830f51-3bc4-4288-ae75-766a77ec452b req-28ca0a2b-1a57-43df-920c-be3300f2f96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:43.850929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a8830f51-3bc4-4288-ae75-766a77ec452b req-28ca0a2b-1a57-43df-920c-be3300f2f96b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.851574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a8830f51-3bc4-4288-ae75-766a77ec452b req-28ca0a2b-1a57-43df-920c-be3300f2f96b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:43.866808 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a8830f51-3bc4-4288-ae75-766a77ec452b req-28ca0a2b-1a57-43df-920c-be3300f2f96b service nova] Creating event network-changed:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:10:43.872541 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a8830f51-3bc4-4288-ae75-766a77ec452b req-28ca0a2b-1a57-43df-920c-be3300f2f96b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055834 Apr 02 21:10:43.873858 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2542/4788] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:43.883022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:43.884857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:43.894928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.896498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:43.897962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:43.898712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:44.109542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:44.117565 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad9d627e-9338-44b5-ac53-071366c19661 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1550 microversion: 2.1 time: 0.339697 Apr 02 21:10:44.118207 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2247/4789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:43 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1550 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:44.134476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:44.135107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:44.141841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:44.142303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:44.143102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:44.144093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:44.173476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:44.186178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e158f6b-39bc-40b5-ba13-2e3b799b4c71 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.307961 Apr 02 21:10:44.187530 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2543/4790] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:43 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:44.371895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:44.386376 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24a50da9-df24-43fc-85db-cdd4aa3f8066 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1550 microversion: 2.1 time: 0.255439 Apr 02 21:10:44.387912 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2248/4791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:44 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1550 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:44.787278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:44.791093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:44.809255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:44.811199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:44.812534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:44.813267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:44.878188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:44.878998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:44.879776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lazy-loading 'fault' on Instance uuid d4f9fa3e-c1ca-4856-b725-a681a491e810 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:10:44.941141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:44.949228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:44.950767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3156f3a86961452eac493ee89e4f56fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b10b2726e7c4fb385dd98063b209656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:44.951994 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32245c3b-ce02-48d3-8628-3f27b2f494ac tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 200 len: 1411 microversion: 2.54 time: 0.177247 Apr 02 21:10:44.956483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2544/4792] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:44 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 1411 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:45.204487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:45.205282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:45.213456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.214079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.215071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.215706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.405779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:45.406458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:45.413123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.413838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.415082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.415660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.530198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:45.539433 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86b4d2e9-d931-43da-bbab-c5b6f46e5e2e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.340018 Apr 02 21:10:45.550088 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2249/4793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:45 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:45.563638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:45.571347 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09593069-3e46-41d3-a244-3dbe57e9dcf9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.170355 Apr 02 21:10:45.571926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2545/4794] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:45 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:10:45.589521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:45.590140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:45.596782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.597236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.598495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.598944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.899530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:45.907357 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-663fd32c-5084-44c1-b8ff-793aecf72f8a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.322397 Apr 02 21:10:45.907942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2250/4795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:45 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:45.924158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-301548609"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:45.925401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:45.932230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.932718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.933573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.934018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.962008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:45.963174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:45.970971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.971549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.972641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:45.973205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:45.999296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:10:46.085998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 204 len: 0 microversion: 2.42 time: 0.127096 Apr 02 21:10:46.089651 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2251/4796] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:10:45 2022] DELETE /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 02 21:10:46.093980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:46.095109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] [instance: d4f9fa3e-c1ca-4856-b725-a681a491e810] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:46.102358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:46.103059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:46.104310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:46.104968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:46.122499 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] HTTP exception thrown: Instance d4f9fa3e-c1ca-4856-b725-a681a491e810 could not be found. Apr 02 21:10:46.123362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] Returning 404 to user: Instance d4f9fa3e-c1ca-4856-b725-a681a491e810 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:46.124678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c013926-8ee8-42bd-9913-7735bcc82d14 tempest-ServerShowV254Test-2051583545 tempest-ServerShowV254Test-2051583545-project] 10.222.0.18 "GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810" status: 404 len: 111 microversion: 2.54 time: 0.036593 Apr 02 21:10:46.125693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2252/4797] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:46 2022] GET /compute/v2.1/servers/d4f9fa3e-c1ca-4856-b725-a681a491e810 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:10:46.133709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:46.134943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:46.147045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:46.149077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:46.150164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:46.151002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:46.255222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e9d1963-8580-4a8c-9962-f271aa25841f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.335329 Apr 02 21:10:46.256172 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2546/4798] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:45 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 02 21:10:46.554842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:46.563472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:46.564559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:46.567291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:46.569221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:46.571187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7bc53a6-5939-47dc-abc3-f9c80df16ced tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2960 microversion: 2.42 time: 0.444256 Apr 02 21:10:46.572774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:46.573181 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2253/4799] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:46 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2960 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:46.573319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:46.574230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:46.574674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:46.815308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:46.822965 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abd53f9b-aec1-4c09-9701-8bf7e3e6f4ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.265890 Apr 02 21:10:46.823957 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2547/4800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:46 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:47.599010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:47.600395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:47.609953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:47.610779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:47.611912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:47.613027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:47.841028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:47.841774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:47.853678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:47.854232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:47.855461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:47.856166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:48.125988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:48.136020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ee6dff6-c474-44b9-b7f7-91f8f1578434 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.298864 Apr 02 21:10:48.147208 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2548/4801] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:47 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:48.151450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:48.166508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:48.169118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:48.172324 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8e9a28d2-eb44-4860-8033-19a5a73d7d78 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2960 microversion: 2.42 time: 0.578345 Apr 02 21:10:48.173481 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2254/4802] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:47 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2960 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:48.335036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fbb276e-263b-4762-a080-e806f3da5174 tempest-ComputeTenantNetworksTest-112958387 tempest-ComputeTenantNetworksTest-112958387-project] Calling method '.version_select at 0x7f54c7d41160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:48.463604 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6fbb276e-263b-4762-a080-e806f3da5174 tempest-ComputeTenantNetworksTest-112958387 tempest-ComputeTenantNetworksTest-112958387-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.251882 Apr 02 21:10:48.464321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2549/4803] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 21:10:48 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:48.474627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdeaa594-c96e-4dae-8eae-86e28fa789dd tempest-ComputeTenantNetworksTest-112958387 tempest-ComputeTenantNetworksTest-112958387-project] Calling method '.version_select at 0x7f54d42dbca0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:48.606908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bdeaa594-c96e-4dae-8eae-86e28fa789dd tempest-ComputeTenantNetworksTest-112958387 tempest-ComputeTenantNetworksTest-112958387-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks/6d04b33d-a680-4d74-a1fa-9d0dd56cad59" status: 200 len: 139 microversion: 2.1 time: 0.135988 Apr 02 21:10:48.607496 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2255/4804] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:10:48 2022] GET /compute/v2.1/os-tenant-networks/6d04b33d-a680-4d74-a1fa-9d0dd56cad59 => generated 139 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:49.154711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:49.155455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:49.167665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:49.168130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:49.169187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:49.169971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:49.196506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:49.198007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:49.213348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:49.214501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:49.217206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:49.218753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:49.401388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:49.409453 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1354515e-061a-4a85-ae2d-be054a6c622a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.259623 Apr 02 21:10:49.422456 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2550/4805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:49 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:49.540547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:49.553497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:49.555476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:49.557781 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f09ed270-4edd-4c4d-81a0-3d2ac699ae07 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2960 microversion: 2.42 time: 0.368751 Apr 02 21:10:49.558890 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2256/4806] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:49 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2960 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:49.641792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-47340d2c-b836-4686-946c-25c9fcdb9447 req-600e2800-eaa2-4d3d-af8f-64165eac2675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-plugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:49.651308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-47340d2c-b836-4686-946c-25c9fcdb9447 req-600e2800-eaa2-4d3d-af8f-64165eac2675 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:49.652398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-47340d2c-b836-4686-946c-25c9fcdb9447 req-600e2800-eaa2-4d3d-af8f-64165eac2675 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:49.695749 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-47340d2c-b836-4686-946c-25c9fcdb9447 req-600e2800-eaa2-4d3d-af8f-64165eac2675 service nova] Creating event network-vif-plugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:10:49.711088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-47340d2c-b836-4686-946c-25c9fcdb9447 req-600e2800-eaa2-4d3d-af8f-64165eac2675 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072938 Apr 02 21:10:49.713849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2551/4807] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:50.430323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:50.431123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:50.442021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:50.444705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:50.445538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:50.445992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:50.579517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:50.580888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:50.597033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:50.602115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:50.605687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:50.606357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:50.853425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:50.867405 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d3ba107-e34f-4ae9-8aa0-e6ba71236005 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.441436 Apr 02 21:10:50.869504 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2257/4808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:50 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:51.014273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:51.029329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:51.035276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:51.038392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c1c3385-fc06-47d6-81c0-abddfbb387d1 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2939 microversion: 2.42 time: 0.463544 Apr 02 21:10:51.040844 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2552/4809] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:50 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2939 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:51.120864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85496bf2-de71-4ca9-a21a-4021d11ae28c tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Action: 'create', calling method: .version_select at 0x7f54d4c94040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-811670133", "metadata": {"Type": "work"}}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:51.122419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85496bf2-de71-4ca9-a21a-4021d11ae28c tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:51.123313 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85496bf2-de71-4ca9-a21a-4021d11ae28c tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.252494 Apr 02 21:10:51.128408 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2258/4810] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:10:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:10:51.133801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5be03565-fb98-4aad-bd70-7dceb0ba24c0 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Action: 'create', calling method: .version_select at 0x7f54d4650670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1844302684", "metadata": {"Type": "work"}}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:51.135201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5be03565-fb98-4aad-bd70-7dceb0ba24c0 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:51.136418 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5be03565-fb98-4aad-bd70-7dceb0ba24c0 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006437 Apr 02 21:10:51.138086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2553/4811] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:10:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:10:51.150856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5adc300c-405a-4e7e-9293-5d2f852eee26 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Action: 'create', calling method: .version_select at 0x7f54d5131670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-752309696", "metadata": {"Type": "work"}}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:51.152495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5adc300c-405a-4e7e-9293-5d2f852eee26 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:51.153518 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5adc300c-405a-4e7e-9293-5d2f852eee26 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007059 Apr 02 21:10:51.167486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-893b36eb-7600-445f-bc1a-4338c7e38155 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Calling method '.version_select at 0x7f54c7ca0ca0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:51.179244 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2259/4812] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:10:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:10:51.268821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-893b36eb-7600-445f-bc1a-4338c7e38155 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] HTTP exception thrown: Volume tempest-invalid-1133676191 could not be found. Apr 02 21:10:51.269742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-893b36eb-7600-445f-bc1a-4338c7e38155 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Returning 404 to user: Volume tempest-invalid-1133676191 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:51.272843 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-893b36eb-7600-445f-bc1a-4338c7e38155 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1133676191" status: 404 len: 99 microversion: 2.1 time: 0.109432 Apr 02 21:10:51.273697 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2554/4813] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:10:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1133676191 => generated 99 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:10:51.288872 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f331f3c4-f867-417a-bb38-1bfa7aa826d9 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009575 Apr 02 21:10:51.289765 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2260/4814] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Apr 2 21:10:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 02 21:10:51.299866 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e833a87-3398-480e-99ae-7370596f17d6 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004736 Apr 02 21:10:51.301190 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2555/4815] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:10:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 02 21:10:51.315800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a85b956-82b2-4eb2-a9d5-1535a43d9c4f tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Calling method '.version_select at 0x7f54d5131b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:51.364806 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-7a85b956-82b2-4eb2-a9d5-1535a43d9c4f tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] HTTP exception thrown: Volume acdd9781-2fbd-49c1-9684-50865c3a7725 could not be found. Apr 02 21:10:51.365546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a85b956-82b2-4eb2-a9d5-1535a43d9c4f tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Returning 404 to user: Volume acdd9781-2fbd-49c1-9684-50865c3a7725 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:51.366504 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a85b956-82b2-4eb2-a9d5-1535a43d9c4f tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/acdd9781-2fbd-49c1-9684-50865c3a7725" status: 404 len: 109 microversion: 2.1 time: 0.059243 Apr 02 21:10:51.367446 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2261/4816] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:10:51 2022] DELETE /compute/v2.1/os-volumes/acdd9781-2fbd-49c1-9684-50865c3a7725 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:10:51.378406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87d9c597-5b55-433b-bcf3-523c2a970a24 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Calling method '.version_select at 0x7f54c7c22c10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:51.474257 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-87d9c597-5b55-433b-bcf3-523c2a970a24 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] HTTP exception thrown: Volume 7cf74268-2dae-4b1a-abc9-953e77e73e5a could not be found. Apr 02 21:10:51.474875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87d9c597-5b55-433b-bcf3-523c2a970a24 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] Returning 404 to user: Volume 7cf74268-2dae-4b1a-abc9-953e77e73e5a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:51.476020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87d9c597-5b55-433b-bcf3-523c2a970a24 tempest-VolumesNegativeTest-1777162424 tempest-VolumesNegativeTest-1777162424-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/7cf74268-2dae-4b1a-abc9-953e77e73e5a" status: 404 len: 109 microversion: 2.1 time: 0.103086 Apr 02 21:10:51.476630 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2556/4817] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:10:51 2022] GET /compute/v2.1/os-volumes/7cf74268-2dae-4b1a-abc9-953e77e73e5a => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:10:51.885151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:51.885735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:51.899339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:51.899890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:51.901264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:51.903034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:52.060027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:52.061781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:52.074288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:52.075887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:52.078019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:52.083577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:52.399893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:52.422786 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd4dcea6-0625-46fa-9fee-f7bf04985ede tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.542250 Apr 02 21:10:52.448052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2262/4818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:51 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:52.510060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6c347149-7ba6-4d0c-a225-0c0eb547c4c3 req-f1dc048e-147f-4eec-97b9-a4d7a61ec9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-deleted", "tag": "7ae013e3-926a-45ea-aa70-0539b27a910a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:52.525776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6c347149-7ba6-4d0c-a225-0c0eb547c4c3 req-f1dc048e-147f-4eec-97b9-a4d7a61ec9e3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:52.527815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6c347149-7ba6-4d0c-a225-0c0eb547c4c3 req-f1dc048e-147f-4eec-97b9-a4d7a61ec9e3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:52.562383 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6c347149-7ba6-4d0c-a225-0c0eb547c4c3 req-f1dc048e-147f-4eec-97b9-a4d7a61ec9e3 service nova] Creating event network-vif-deleted:7ae013e3-926a-45ea-aa70-0539b27a910a for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:52.574754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6c347149-7ba6-4d0c-a225-0c0eb547c4c3 req-f1dc048e-147f-4eec-97b9-a4d7a61ec9e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065910 Apr 02 21:10:52.576421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2263/4819] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:10:52.822346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fe90686b-ebc3-4360-8650-8fcc86e00767 req-dcb3bc62-6dc6-4a23-a60f-8df26c3a8956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-unplugged", "status": "completed", "tag": "10107d8d-9752-412f-8706-611605cd57c7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:52.843738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fe90686b-ebc3-4360-8650-8fcc86e00767 req-dcb3bc62-6dc6-4a23-a60f-8df26c3a8956 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:52.844681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fe90686b-ebc3-4360-8650-8fcc86e00767 req-dcb3bc62-6dc6-4a23-a60f-8df26c3a8956 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:52.879855 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fe90686b-ebc3-4360-8650-8fcc86e00767 req-dcb3bc62-6dc6-4a23-a60f-8df26c3a8956 service nova] Creating event network-vif-unplugged:10107d8d-9752-412f-8706-611605cd57c7 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:52.893342 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fe90686b-ebc3-4360-8650-8fcc86e00767 req-dcb3bc62-6dc6-4a23-a60f-8df26c3a8956 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075599 Apr 02 21:10:52.896060 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2264/4820] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:10:53.388099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:53.389322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:53.402990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:53.403870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:53.404975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:53.405986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:53.455294 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9a8a9f3-ba11-4419-a16a-0f4180368f1e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/ips" status: 200 len: 150 microversion: 2.1 time: 0.557896 Apr 02 21:10:53.472778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2265/4821] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:10:52 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/ips => generated 150 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:53.486822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:53.489210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:53.510071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:53.510613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:53.511483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:53.516531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:53.570868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:53.583135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:53.598214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:53.612728 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3085d9b0-fbf8-4344-aacb-38570bf7814f tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2918 microversion: 2.42 time: 1.548341 Apr 02 21:10:53.613609 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2557/4822] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:52 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2918 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:54.637043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:54.637645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:54.648821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:54.651023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:54.651838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:54.652816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:54.970512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:54.979240 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ed20b00-19cc-4853-bd94-5545c6731fd5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 1.505061 Apr 02 21:10:54.979905 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2266/4823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:53 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:55.000827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f30501d3-107b-4e2f-939c-95969327bf31 req-3f8964af-b451-4386-a64a-862ed428a127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-deleted", "tag": "bf93e761-9d1c-42fd-90a1-2b5196433096"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:55.038640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f30501d3-107b-4e2f-939c-95969327bf31 req-3f8964af-b451-4386-a64a-862ed428a127 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:55.041242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f30501d3-107b-4e2f-939c-95969327bf31 req-3f8964af-b451-4386-a64a-862ed428a127 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:55.074730 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f30501d3-107b-4e2f-939c-95969327bf31 req-3f8964af-b451-4386-a64a-862ed428a127 service nova] Creating event network-vif-deleted:bf93e761-9d1c-42fd-90a1-2b5196433096 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:55.089180 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f30501d3-107b-4e2f-939c-95969327bf31 req-3f8964af-b451-4386-a64a-862ed428a127 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108029 Apr 02 21:10:55.096179 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2267/4824] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:55.101741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-43640c37-985d-488a-830d-a003fce0e664 req-b1af1f1c-8367-4087-9fc8-c26ac85b0d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-unplugged", "status": "completed", "tag": "da097fe9-f79d-4d6d-8d6c-d413f8913252"}, {"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-unplugged", "status": "completed", "tag": "5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:55.132832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-43640c37-985d-488a-830d-a003fce0e664 req-b1af1f1c-8367-4087-9fc8-c26ac85b0d9d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:55.133413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-43640c37-985d-488a-830d-a003fce0e664 req-b1af1f1c-8367-4087-9fc8-c26ac85b0d9d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:55.160109 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-43640c37-985d-488a-830d-a003fce0e664 req-b1af1f1c-8367-4087-9fc8-c26ac85b0d9d service nova] Creating event network-vif-unplugged:da097fe9-f79d-4d6d-8d6c-d413f8913252 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:55.164254 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-43640c37-985d-488a-830d-a003fce0e664 req-b1af1f1c-8367-4087-9fc8-c26ac85b0d9d service nova] Creating event network-vif-unplugged:5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:55.178176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-43640c37-985d-488a-830d-a003fce0e664 req-b1af1f1c-8367-4087-9fc8-c26ac85b0d9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.079796 Apr 02 21:10:55.179887 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2268/4825] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:55.352790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:55.354449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:55.369102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:55.379529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:55.380709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:55.382570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:55.384354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:55.389125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:55.391261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:55.410690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a41cad7-8320-4152-ba4c-2c7dc05cd848 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2710 microversion: 2.42 time: 0.759497 Apr 02 21:10:55.428337 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2558/4826] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:54 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2710 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:10:55.933267 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "POST /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585912 Apr 02 21:10:55.939163 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2269/4827] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:10:55 2022] POST /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:55.997131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:55.998641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:56.044434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.048208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.056957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.059047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.438613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:56.439259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:56.476871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.477699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.485026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.486245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.567525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:56.608074 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f512fbf0-f67e-42db-8942-f11cbc228f02 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1502 microversion: 2.1 time: 0.615586 Apr 02 21:10:56.624602 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2559/4828] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:55 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1502 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:56.643855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0a72472-a1aa-4b7e-a842-f0243245ada7"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:56.652955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:56.678036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.678561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.685043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.688136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.788999 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Cannot 'attach_volume' instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 while it is in vm_state rescued Apr 02 21:10:56.791953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 409 to user: Cannot 'attach_volume' instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 while it is in vm_state rescued {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:10:56.793131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e462ee37-1cf5-4702-adfb-d663f35f07a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.166440 Apr 02 21:10:56.800483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2560/4829] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:10:56 2022] POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/os-volume_attachments => generated 152 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:10:56.809086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:56.813193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:56.830314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.836243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.840072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:56.840783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:56.962954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:56.977270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:56.984925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:56.989569 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52eee59b-36a7-4ab5-939b-b0064249c6b6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2549 microversion: 2.42 time: 0.557266 Apr 02 21:10:56.990328 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2270/4830] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:56 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2549 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:57.009830 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f935e710-74f2-4469-a867-23a9acce0e2b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action" status: 202 len: 0 microversion: 2.1 time: 0.204416 Apr 02 21:10:57.010852 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2561/4831] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:10:56 2022] POST /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:10:57.030555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:57.037855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:57.055475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:57.058601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:57.065378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:57.068136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:57.269569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7fde6405-72c6-421f-819c-13c447cb5af9 req-aee5b247-822c-4b83-b12e-24cf7f4bc12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-deleted", "tag": "da097fe9-f79d-4d6d-8d6c-d413f8913252"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:57.283900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7fde6405-72c6-421f-819c-13c447cb5af9 req-aee5b247-822c-4b83-b12e-24cf7f4bc12f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:57.286057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7fde6405-72c6-421f-819c-13c447cb5af9 req-aee5b247-822c-4b83-b12e-24cf7f4bc12f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:57.306114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7fde6405-72c6-421f-819c-13c447cb5af9 req-aee5b247-822c-4b83-b12e-24cf7f4bc12f service nova] Creating event network-vif-deleted:da097fe9-f79d-4d6d-8d6c-d413f8913252 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:57.315344 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7fde6405-72c6-421f-819c-13c447cb5af9 req-aee5b247-822c-4b83-b12e-24cf7f4bc12f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051746 Apr 02 21:10:57.318491 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2562/4832] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:10:57.851144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:57.861950 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ccde55b-3854-40ff-8bf7-089b076dd5e7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1510 microversion: 2.1 time: 0.845731 Apr 02 21:10:57.866621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2271/4833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:57 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1510 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:58.019913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:58.021405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:58.031393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:58.035875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:58.037103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:58.038840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:58.639236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:58.665994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:58.670376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:58.673826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-206487c0-12cc-4f0f-9496-8af751955be6 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 2388 microversion: 2.42 time: 0.666127 Apr 02 21:10:58.690050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2563/4834] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:58 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 2388 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:10:58.883748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:58.884368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:58.898125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:58.898583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:58.899789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:58.899789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:59.467018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:59.512969 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25bd237e-90d5-46c6-aecc-3682e9490cf1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1510 microversion: 2.1 time: 0.633420 Apr 02 21:10:59.531142 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2272/4835] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:10:58 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1510 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:10:59.560785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a5588fa6-14f5-40d5-b706-e2dc5eb0f990 req-1f40279b-b35d-41ef-a0f0-ac90e90c9393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-deleted", "tag": "5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:10:59.582658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a5588fa6-14f5-40d5-b706-e2dc5eb0f990 req-1f40279b-b35d-41ef-a0f0-ac90e90c9393 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:59.583454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a5588fa6-14f5-40d5-b706-e2dc5eb0f990 req-1f40279b-b35d-41ef-a0f0-ac90e90c9393 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:59.613158 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a5588fa6-14f5-40d5-b706-e2dc5eb0f990 req-1f40279b-b35d-41ef-a0f0-ac90e90c9393 service nova] Creating event network-vif-deleted:5d5d2fc6-d7d7-4d42-bfa2-bd33cae47951 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:10:59.625122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a5588fa6-14f5-40d5-b706-e2dc5eb0f990 req-1f40279b-b35d-41ef-a0f0-ac90e90c9393 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069721 Apr 02 21:10:59.629596 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2564/4836] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:10:59.705135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:10:59.705758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:10:59.718184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:59.718941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:59.719906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:10:59.720531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:10:59.854439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:59.874332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:59.877874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:10:59.880036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-032e00a4-7d5a-4727-8ab6-dd16d6fc1c93 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1603 microversion: 2.42 time: 0.179432 Apr 02 21:10:59.893863 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2273/4837] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:10:59 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 02 21:11:00.533736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:00.534464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:00.550290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:00.550764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:00.551585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:00.561102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:00.900339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:00.900993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:00.918329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:00.918802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:00.919608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:00.920063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.017593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:01.018341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.019003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lazy-loading 'fault' on Instance uuid f07339c3-e46c-4c3c-928c-0e8775b21746 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:11:01.152234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:01.161993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:01.170358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5d1c36098a14436a0a10f4fb9937bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76098fb9c22b4f84bb0afb2bbe66e858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:01.171746 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39b0578a-ed3b-4f30-a51b-38a4efde09e4 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 200 len: 1370 microversion: 2.42 time: 0.276399 Apr 02 21:11:01.172588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2274/4838] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:11:00 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 1370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 02 21:11:01.191265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:01.191786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:01.210934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:01.212500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.213397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:01.214887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.320444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:01.329788 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-675c7c9a-3fab-4be5-9897-5460e5443e8a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1510 microversion: 2.1 time: 0.800703 Apr 02 21:11:01.342001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2565/4839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:00 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1510 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:01.355239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lazy-loading 'services' on Instance uuid 3797b801-c405-4915-bbed-847fd1fc1379 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:11:01.489544 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79149c6a-d140-41fe-8f32-59239dfc23b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments/6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9" status: 202 len: 0 microversion: 2.1 time: 0.305275 Apr 02 21:11:01.501441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:01.502714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:01.511549 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2275/4840] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:11:01 2022] DELETE /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments/6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:11:01.517052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:01.518746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.534899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:01.538020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.584358 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef1c514d-3c7f-4865-b621-680b9c37f5af tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089474 Apr 02 21:11:01.589181 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2566/4841] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:11:01 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:01.643868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a4197468-d865-4181-8dfb-5f9828e1c19e req-ae3f6321-0c6e-406e-8783-7fac20bff12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07339c3-e46c-4c3c-928c-0e8775b21746", "name": "network-vif-deleted", "tag": "10107d8d-9752-412f-8706-611605cd57c7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:01.661031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a4197468-d865-4181-8dfb-5f9828e1c19e req-ae3f6321-0c6e-406e-8783-7fac20bff12b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:01.662006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a4197468-d865-4181-8dfb-5f9828e1c19e req-ae3f6321-0c6e-406e-8783-7fac20bff12b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:01.674628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a4197468-d865-4181-8dfb-5f9828e1c19e req-ae3f6321-0c6e-406e-8783-7fac20bff12b service nova] Creating event network-vif-deleted:10107d8d-9752-412f-8706-611605cd57c7 for instance f07339c3-e46c-4c3c-928c-0e8775b21746 on nch1-master-1 Apr 02 21:11:01.683060 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a4197468-d865-4181-8dfb-5f9828e1c19e req-ae3f6321-0c6e-406e-8783-7fac20bff12b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042574 Apr 02 21:11:01.684741 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2276/4842] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:02.191750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:02.192671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:02.201618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.204214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.205262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.206942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.239436 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] HTTP exception thrown: Instance f07339c3-e46c-4c3c-928c-0e8775b21746 could not be found. Apr 02 21:11:02.241917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Returning 404 to user: Instance f07339c3-e46c-4c3c-928c-0e8775b21746 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:02.243972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f04103f4-6d9f-4a82-a097-5e86ce3f7de9 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 404 len: 111 microversion: 2.42 time: 0.056986 Apr 02 21:11:02.247504 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2567/4843] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:11:02 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:11:02.257622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f192613-8e44-4487-a865-4f6b23a9d436 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '.version_select at 0x7f54d4bc34c0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:02.302691 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f192613-8e44-4487-a865-4f6b23a9d436 tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151584740" status: 204 len: 0 microversion: 2.42 time: 0.051519 Apr 02 21:11:02.305509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2277/4844] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Apr 2 21:11:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151584740 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 02 21:11:02.349185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:02.351221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:02.375281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.379674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.382446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.386443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.605940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:02.607129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:02.618078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.618552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.619360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.620099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.716363 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b21fd40-8271-48a9-8a23-6ed0761333cc tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123857 Apr 02 21:11:02.737190 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2278/4845] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:11:02 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:11:02.846447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:02.846972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:02.857058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.857288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.858291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:02.858461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:02.950618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:11:03.126936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:03.139865 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01f7bdb5-e3d5-493b-b4bd-23e9ebbcab37 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 204 len: 0 microversion: 2.1 time: 0.296742 Apr 02 21:11:03.144587 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2279/4846] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:11:02 2022] DELETE /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:11:03.145603 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8fae531b-4858-4b00-ba0f-4492f8f7cdfa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1516 microversion: 2.1 time: 0.801022 Apr 02 21:11:03.146302 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2568/4847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:02 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1516 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:03.182032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:03.182672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:03.197228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:03.201769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:03.202858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:03.204530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:03.877829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:03.895067 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad87c994-e90b-43db-b22d-36b21fc953b7 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1681 microversion: 2.1 time: 0.748955 Apr 02 21:11:03.895669 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2280/4848] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:03 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1681 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:04.930307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:04.931588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:04.944284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:04.944817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:04.947935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:04.948644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:04.987082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2661f13c-7034-4b63-8cd2-2955cb3b263d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'create', calling method: .version_select at 0x7f54d4995790>, body: {"keypair": {"name": "tempest-keypair-1676697335"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:05.026405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2661f13c-7034-4b63-8cd2-2955cb3b263d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for project e9e9483710f0424b9c347c74a9da708a. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:11:05.057958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2661f13c-7034-4b63-8cd2-2955cb3b263d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for user d7ebf8694d674ee38bb5f58a3687a415 and project e9e9483710f0424b9c347c74a9da708a. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:11:05.269337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2661f13c-7034-4b63-8cd2-2955cb3b263d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for project e9e9483710f0424b9c347c74a9da708a. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:11:05.280683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2661f13c-7034-4b63-8cd2-2955cb3b263d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for user d7ebf8694d674ee38bb5f58a3687a415 and project e9e9483710f0424b9c347c74a9da708a. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:11:05.317465 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2661f13c-7034-4b63-8cd2-2955cb3b263d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.335310 Apr 02 21:11:05.324703 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2281/4849] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:11:04 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:11:05.585119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:05.595419 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0d433dd-8c42-4f29-854c-18a453688506 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1681 microversion: 2.1 time: 0.669659 Apr 02 21:11:05.596016 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2569/4850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:04 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1681 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:06.618700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:06.619354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:06.638532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:06.639007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:06.640397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:06.640883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:06.922689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:06.935531 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8de17be4-c3ea-454a-ab4b-6f2bc215e659 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1614 microversion: 2.1 time: 0.322098 Apr 02 21:11:06.943168 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2282/4851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:06 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1614 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:07.964549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:07.966474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:07.982830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:07.984927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:07.985974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:07.989532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:08.018764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b1730a11-059d-4264-998b-9cd188d9db69 req-9192d21e-7b5b-413e-81bf-148e7aac1082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3797b801-c405-4915-bbed-847fd1fc1379", "name": "network-vif-deleted", "tag": "5f72d76a-13d8-4fed-8238-44c944f41159"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:08.035152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b1730a11-059d-4264-998b-9cd188d9db69 req-9192d21e-7b5b-413e-81bf-148e7aac1082 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:08.037754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b1730a11-059d-4264-998b-9cd188d9db69 req-9192d21e-7b5b-413e-81bf-148e7aac1082 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:08.090102 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b1730a11-059d-4264-998b-9cd188d9db69 req-9192d21e-7b5b-413e-81bf-148e7aac1082 service nova] Creating event network-vif-deleted:5f72d76a-13d8-4fed-8238-44c944f41159 for instance 3797b801-c405-4915-bbed-847fd1fc1379 on nch1-master-1 Apr 02 21:11:08.101912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b1730a11-059d-4264-998b-9cd188d9db69 req-9192d21e-7b5b-413e-81bf-148e7aac1082 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107204 Apr 02 21:11:08.108908 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2283/4852] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:08.350756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fed8f5059c44a8fa1a9526e81fa73e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb31a4915e1341839e229bc3786bb4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:08.359947 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ac13b8b-e532-4b26-870d-9648f809a3fa tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 200 len: 1614 microversion: 2.1 time: 0.403444 Apr 02 21:11:08.372678 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2570/4853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:07 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 1614 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:09.390141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:09.392063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:09.409243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:09.411016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:09.412402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:09.415194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:09.460020 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 3797b801-c405-4915-bbed-847fd1fc1379 could not be found. Apr 02 21:11:09.460684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 3797b801-c405-4915-bbed-847fd1fc1379 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:09.461547 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0d4ac6b-297f-466a-86af-588fa495f812 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 404 len: 111 microversion: 2.1 time: 0.078517 Apr 02 21:11:09.462130 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2284/4854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:09 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:09.471719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86f46afc-8cd1-47b9-8605-3779e2db9813 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '.version_select at 0x7f54da25c790>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:09.524327 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86f46afc-8cd1-47b9-8605-3779e2db9813 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017652606" status: 202 len: 0 microversion: 2.1 time: 0.057240 Apr 02 21:11:09.525449 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2571/4855] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017652606 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:11:09.906341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-607736658", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "506a0cbe-9c07-48c1-9815-b2435759867a"}], "security_groups": [{"name": "tempest-securitygroup--1212535005"}], "key_name": "tempest-keypair-1676697335", "user_data": "}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:10.172748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] validate_networks() for [('506a0cbe-9c07-48c1-9815-b2435759867a', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:11:12.500896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:11:12.504116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:11:12.504672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:11:12.505785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:11:12.506469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:11:12.527506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:12.528338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:12.529502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:12.530255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:12.619055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for project e9e9483710f0424b9c347c74a9da708a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:11:12.630203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Getting quotas for user d7ebf8694d674ee38bb5f58a3687a415 and project e9e9483710f0424b9c347c74a9da708a. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:11:12.651438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:11:12.654568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:11:12.774821 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-10163b0e-59b1-42ee-b818-9fc4809e2932 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.872742 Apr 02 21:11:12.778454 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2285/4856] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:11:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:11:12.790918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5ef2dd7-e634-4c5d-985f-63a1d8f08a8b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:12.792157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5ef2dd7-e634-4c5d-985f-63a1d8f08a8b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:12.942719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d5ef2dd7-e634-4c5d-985f-63a1d8f08a8b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:12.953519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5ef2dd7-e634-4c5d-985f-63a1d8f08a8b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1245 microversion: 2.1 time: 0.168775 Apr 02 21:11:12.956153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2572/4857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:12 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1245 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:13.551840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:13.552399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:13.570285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:13.575238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:13.576074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:13.576640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:13.661457 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 3797b801-c405-4915-bbed-847fd1fc1379 could not be found. Apr 02 21:11:13.663763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 3797b801-c405-4915-bbed-847fd1fc1379 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:13.667686 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93262bbf-71a8-48c4-83f3-a795ab2540a3 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 404 len: 111 microversion: 2.1 time: 0.126444 Apr 02 21:11:13.672418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2286/4858] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:11:13 2022] DELETE /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:13.686259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:13.687112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 3797b801-c405-4915-bbed-847fd1fc1379] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:13.706871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:13.708031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:13.709502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:13.711306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:13.756131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 3797b801-c405-4915-bbed-847fd1fc1379 could not be found. Apr 02 21:11:13.759605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 3797b801-c405-4915-bbed-847fd1fc1379 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:13.761790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-561fe332-b552-4b77-9e6c-56bd1710a57c tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379" status: 404 len: 111 microversion: 2.1 time: 0.086601 Apr 02 21:11:13.764064 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2573/4859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:13 2022] GET /compute/v2.1/servers/3797b801-c405-4915-bbed-847fd1fc1379 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:13.973650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:13.974698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:13.991620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:13.994188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:13.997003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.001760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:14.017584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:14.018741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:14.048996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.049526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:14.050347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.050818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:14.120992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] HTTP exception thrown: Instance f07339c3-e46c-4c3c-928c-0e8775b21746 could not be found. Apr 02 21:11:14.121610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Returning 404 to user: Instance f07339c3-e46c-4c3c-928c-0e8775b21746 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:14.122480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54b57240-7ea8-410f-9029-461506f43f8c tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 404 len: 111 microversion: 2.42 time: 0.110512 Apr 02 21:11:14.126605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:14.133587 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2574/4860] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Apr 2 21:11:14 2022] DELETE /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:11:14.138348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de918f5d-01b0-4a8d-8da1-e45ab44e9204 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1241 microversion: 2.1 time: 0.168818 Apr 02 21:11:14.139211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2287/4861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:13 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1241 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:14.158213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:14.159808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] [instance: f07339c3-e46c-4c3c-928c-0e8775b21746] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:14.175174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.175932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:14.177093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.177856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:14.217922 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] HTTP exception thrown: Instance f07339c3-e46c-4c3c-928c-0e8775b21746 could not be found. Apr 02 21:11:14.219321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] Returning 404 to user: Instance f07339c3-e46c-4c3c-928c-0e8775b21746 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:14.220819 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a27fbd24-6f28-4a65-a205-26eb593a012b tempest-TaggedBootDevicesTest_v242-285856104 tempest-TaggedBootDevicesTest_v242-285856104-project] 10.222.0.18 "GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746" status: 404 len: 111 microversion: 2.42 time: 0.082625 Apr 02 21:11:14.226999 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2575/4862] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Apr 2 21:11:14 2022] GET /compute/v2.1/servers/f07339c3-e46c-4c3c-928c-0e8775b21746 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:11:14.638579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:14.641511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:14.660031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.661367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:14.664012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:14.666056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.095762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:15.097036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:15.115380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.116227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.117393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.118447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.158481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 could not be found. Apr 02 21:11:15.163659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:15.166097 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb54987c-3348-4aa1-88b6-b2ffa084af65 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 404 len: 111 microversion: 2.1 time: 0.074245 Apr 02 21:11:15.170734 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2576/4863] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:11:15 2022] DELETE /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:15.170879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:15.180238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:15.184318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:15.190649 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93422063-8670-422c-a85b-3f3d28480838 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.558741 Apr 02 21:11:15.199741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.200534 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2288/4864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:14 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:15.208337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.210218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.210831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.212234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:15.225105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:15.256970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.257440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.258300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.265621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.321987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 could not be found. Apr 02 21:11:15.322705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:15.323812 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a9cd30a-b4b2-4de3-b95e-8dec892121b1 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36" status: 404 len: 111 microversion: 2.1 time: 0.121474 Apr 02 21:11:15.327896 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2289/4865] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:15 2022] GET /compute/v2.1/servers/c9b45c75-e0a2-4bee-bbc5-3a1d101ccb36 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:15.333888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:15.334516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:15.341468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.342632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.343573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.344715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.360890 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 0ffaf327-24f7-4378-ae51-a4bd58d135df could not be found. Apr 02 21:11:15.361656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 0ffaf327-24f7-4378-ae51-a4bd58d135df could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:15.362612 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b346dec-37f1-4aa0-8f71-0d47315e896e tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 404 len: 111 microversion: 2.1 time: 0.033358 Apr 02 21:11:15.368502 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2290/4866] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:11:15 2022] DELETE /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:15.376384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:15.377312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 0ffaf327-24f7-4378-ae51-a4bd58d135df] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:15.385383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:15.396021 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7d53005-b9c4-4ddd-ad44-ef4422860ccc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1303 microversion: 2.1 time: 0.226226 Apr 02 21:11:15.400280 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2577/4867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:15 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:15.406116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.407909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.413108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:15.414226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:15.433760 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 0ffaf327-24f7-4378-ae51-a4bd58d135df could not be found. Apr 02 21:11:15.435027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 0ffaf327-24f7-4378-ae51-a4bd58d135df could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:15.436705 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-078ccc52-439d-4731-be53-19a4a340b888 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df" status: 404 len: 111 microversion: 2.1 time: 0.065704 Apr 02 21:11:15.438099 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2291/4868] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:15 2022] GET /compute/v2.1/servers/0ffaf327-24f7-4378-ae51-a4bd58d135df => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:16.242587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:16.275812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:16.324896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:16.327996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:16.334887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:16.339076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:16.417394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:16.418785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:16.472925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:16.477689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:16.490575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:16.494777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.169453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:17.190387 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30df8462-400a-481e-b554-90d949a4f28c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.976292 Apr 02 21:11:17.191237 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2578/4869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:16 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:17.219092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:17.219092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:17.245565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:17.246779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.248995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:17.249734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.289509 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 58df85ac-b402-424d-8354-fc927aad0d32 could not be found. Apr 02 21:11:17.296356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 58df85ac-b402-424d-8354-fc927aad0d32 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:17.298545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e871ae12-620b-46f3-a50c-052348d92e95 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 404 len: 111 microversion: 2.1 time: 0.104204 Apr 02 21:11:17.299306 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2579/4870] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:11:17 2022] DELETE /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:17.307091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-126884008"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:17.309227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:17.326062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:17.327849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.329435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:17.330183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.392738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:17.404626 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3cbb547-bb02-409c-82eb-01af38419eb6 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.991535 Apr 02 21:11:17.412777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2292/4871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:16 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:11:17.427750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:17.428377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] [instance: 58df85ac-b402-424d-8354-fc927aad0d32] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:17.453998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:17.455841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.457238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:17.458747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:17.496736 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] HTTP exception thrown: Instance 58df85ac-b402-424d-8354-fc927aad0d32 could not be found. Apr 02 21:11:17.499404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] Returning 404 to user: Instance 58df85ac-b402-424d-8354-fc927aad0d32 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:17.505004 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ece120e5-6aaa-4c0c-9b63-a4c6023a8700 tempest-AttachVolumeNegativeTest-1037508314 tempest-AttachVolumeNegativeTest-1037508314-project] 10.222.0.18 "GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32" status: 404 len: 111 microversion: 2.1 time: 0.090723 Apr 02 21:11:17.509385 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2293/4872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:17 2022] GET /compute/v2.1/servers/58df85ac-b402-424d-8354-fc927aad0d32 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:18.148112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ba0ac12-82ba-4753-8b47-7b25fc48c61e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.846574 Apr 02 21:11:18.149603 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2580/4873] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:11:17 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 02 21:11:18.290279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-012e1f11-c7b1-41bc-b042-810c9a9a1240 req-22bedacb-17af-43b1-8f8c-449b7cc24039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-unplugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:18.325720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-012e1f11-c7b1-41bc-b042-810c9a9a1240 req-22bedacb-17af-43b1-8f8c-449b7cc24039 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:18.329504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-012e1f11-c7b1-41bc-b042-810c9a9a1240 req-22bedacb-17af-43b1-8f8c-449b7cc24039 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:18.395285 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-012e1f11-c7b1-41bc-b042-810c9a9a1240 req-22bedacb-17af-43b1-8f8c-449b7cc24039 service nova] Creating event network-vif-unplugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:11:18.411911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-012e1f11-c7b1-41bc-b042-810c9a9a1240 req-22bedacb-17af-43b1-8f8c-449b7cc24039 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130177 Apr 02 21:11:18.414884 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2294/4874] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:18.424133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:18.426290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:18.472938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:18.475070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:18.476089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:18.479020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:18.975994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:18.986204 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0457be2a-fcb2-41fb-9e9d-d0779e60bd23 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.567290 Apr 02 21:11:18.986828 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2581/4875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:18 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:19.624747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-05eb6d39-1777-471d-85dc-a79e65154271 req-0c2b4b11-dc66-4c79-8703-424fad6a6e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eae82f6-fd72-4402-ad18-75441c6d7eec", "tag": "f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:19.658808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-05eb6d39-1777-471d-85dc-a79e65154271 req-0c2b4b11-dc66-4c79-8703-424fad6a6e9a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:19.661041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-05eb6d39-1777-471d-85dc-a79e65154271 req-0c2b4b11-dc66-4c79-8703-424fad6a6e9a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:19.686414 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-05eb6d39-1777-471d-85dc-a79e65154271 req-0c2b4b11-dc66-4c79-8703-424fad6a6e9a service nova] Creating event network-changed:f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3 for instance 1eae82f6-fd72-4402-ad18-75441c6d7eec on nch1-master-1 Apr 02 21:11:19.703402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-05eb6d39-1777-471d-85dc-a79e65154271 req-0c2b4b11-dc66-4c79-8703-424fad6a6e9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088385 Apr 02 21:11:19.707730 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2295/4876] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:20.005763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:20.006401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:20.023683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:20.024067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:20.024915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:20.032859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:20.473422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:20.487699 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f677e78-4195-4f0a-971f-674ab7b70f04 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.486747 Apr 02 21:11:20.488659 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2582/4877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:19 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:21.508323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:21.509158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:21.529017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:21.529712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:21.531155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:21.531943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:22.627996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:22.646485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0b0d024-3a89-437e-b419-740ed15c4d0a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 1.140812 Apr 02 21:11:22.648211 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2296/4878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:21 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:23.666756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:23.667390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:23.681265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:23.681736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:23.685216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:23.685723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:24.215080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:24.227441 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f2103ba2-b64f-49c9-9ab8-e363a0a21832 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.565715 Apr 02 21:11:24.234602 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2583/4879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:23 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:25.254336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:25.255895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:25.276605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:25.277805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:25.278825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:25.279501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:26.198199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:26.213436 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-95745848-186d-4670-80e9-24f336df87a7 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.960172 Apr 02 21:11:26.223046 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2297/4880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:25 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:27.235975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:27.239419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:27.265708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:27.271510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:27.299154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:27.302687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:27.917583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:27.938702 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fccefd97-e58d-4fc9-9350-e43f9e944627 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.711276 Apr 02 21:11:27.940061 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2584/4881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:27 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:28.959828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:28.962746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:29.000831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:29.001357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:29.009592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:29.011019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:29.762680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:29.775480 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d417afb-c02d-424e-8f39-9fe0437b9c1e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.820478 Apr 02 21:11:29.780118 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2298/4882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:28 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:30.803827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:30.806153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:30.825309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:30.825492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:30.836764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:30.837041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:31.367758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-732b2eb8-1f59-45b8-bd31-cafe56250649 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Action: 'create', calling method: .version_select at 0x7f54d455b0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1264017565"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:31.649887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:31.663353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13146177-d2de-4d59-9c44-7471cda3558b tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.865056 Apr 02 21:11:31.667414 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2299/4883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:30 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:11:31.925745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-bef2e3b0-e18c-4ec9-a082-07c81694b73c req-c21b603f-a553-4ba1-b200-e673c19fee07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-plugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:31.950658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bef2e3b0-e18c-4ec9-a082-07c81694b73c req-c21b603f-a553-4ba1-b200-e673c19fee07 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:31.955512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bef2e3b0-e18c-4ec9-a082-07c81694b73c req-c21b603f-a553-4ba1-b200-e673c19fee07 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:31.968769 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-732b2eb8-1f59-45b8-bd31-cafe56250649 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 1.222275 Apr 02 21:11:31.969894 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2585/4884] 10.222.0.18 () {60 vars in 1154 bytes} [Sat Apr 2 21:11:30 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 1224 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 02 21:11:31.983075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0ce7b9d-f218-4f2f-92a3-3486beaf9af1 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54da25ce50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:32.032247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-bef2e3b0-e18c-4ec9-a082-07c81694b73c req-c21b603f-a553-4ba1-b200-e673c19fee07 service nova] Creating event network-vif-plugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:11:32.054674 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-bef2e3b0-e18c-4ec9-a082-07c81694b73c req-c21b603f-a553-4ba1-b200-e673c19fee07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132563 Apr 02 21:11:32.063756 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2300/4885] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:32.119301 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0ce7b9d-f218-4f2f-92a3-3486beaf9af1 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 200 len: 338 microversion: 2.1 time: 0.141113 Apr 02 21:11:32.125123 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2586/4886] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:31 2022] GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 338 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:32.703858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:32.704984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:32.717842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:32.718312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:32.720422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:32.721531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:33.133553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-20222abf-3b77-4b01-a70c-7e4b074a76df tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d455be50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:33.239104 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-20222abf-3b77-4b01-a70c-7e4b074a76df tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 200 len: 339 microversion: 2.1 time: 0.109511 Apr 02 21:11:33.239988 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2587/4887] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:33 2022] GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:33.253344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46bab292-00f0-4da1-bf56-5a2296f3f2ed tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Action: 'create', calling method: .version_select at 0x7f54d45a41f0>, body: {"snapshot": {"volume_id": "be5d68a8-39e5-42c9-a3b7-74e6ec72b117", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1734481542"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:33.569185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46bab292-00f0-4da1-bf56-5a2296f3f2ed tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.320185 Apr 02 21:11:33.570097 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2588/4888] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Apr 2 21:11:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:33.580242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-826a781d-d72f-4342-93ca-3aa5e77019d2 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d45a4f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:33.618874 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-826a781d-d72f-4342-93ca-3aa5e77019d2 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b" status: 200 len: 287 microversion: 2.1 time: 0.042044 Apr 02 21:11:33.620176 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2589/4889] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:11:33 2022] GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:33.631009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4226c67a-b4d1-41d9-a79f-2d00d75cc990 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d455b040>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:33.691537 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4226c67a-b4d1-41d9-a79f-2d00d75cc990 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064761 Apr 02 21:11:33.692400 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2590/4890] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Apr 2 21:11:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:33.703122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c7552b59-2d77-4703-8604-8b552e64c51a tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54c7d93820>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:33.749740 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c7552b59-2d77-4703-8604-8b552e64c51a tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b" status: 200 len: 287 microversion: 2.1 time: 0.051008 Apr 02 21:11:33.750564 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2591/4891] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:11:33 2022] GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:34.266518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:34.276342 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3929061-3e99-4baf-a10b-995705260f8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 1.598179 Apr 02 21:11:34.276985 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2301/4892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:32 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:34.476376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b84a00a7-3153-4a14-808b-da6fe6341412 req-68f76b21-d525-4c34-b8ff-da725077c20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eae82f6-fd72-4402-ad18-75441c6d7eec", "name": "network-vif-plugged", "status": "completed", "tag": "f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:34.504319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b84a00a7-3153-4a14-808b-da6fe6341412 req-68f76b21-d525-4c34-b8ff-da725077c20e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:34.507232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b84a00a7-3153-4a14-808b-da6fe6341412 req-68f76b21-d525-4c34-b8ff-da725077c20e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:34.535152 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b84a00a7-3153-4a14-808b-da6fe6341412 req-68f76b21-d525-4c34-b8ff-da725077c20e service nova] Creating event network-vif-plugged:f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3 for instance 1eae82f6-fd72-4402-ad18-75441c6d7eec on nch1-master-1 Apr 02 21:11:34.547854 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b84a00a7-3153-4a14-808b-da6fe6341412 req-68f76b21-d525-4c34-b8ff-da725077c20e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075848 Apr 02 21:11:34.550330 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2592/4893] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:34.762652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b65e204f-f01e-4b8d-a648-255d7eacf82e tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d513d3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:34.849249 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b65e204f-f01e-4b8d-a648-255d7eacf82e tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b" status: 200 len: 288 microversion: 2.1 time: 0.091072 Apr 02 21:11:34.850027 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2302/4894] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:11:34 2022] GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b => generated 288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:34.862806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d45a4940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:35.082514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b" status: 202 len: 0 microversion: 2.1 time: 0.225437 Apr 02 21:11:35.083133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2593/4895] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 21:11:34 2022] DELETE /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:11:35.093228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9cd52ca-f40e-4b20-822a-b84149b2b749 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d4919790>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:35.153408 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9cd52ca-f40e-4b20-822a-b84149b2b749 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b" status: 200 len: 287 microversion: 2.1 time: 0.065869 Apr 02 21:11:35.154451 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2303/4896] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:11:35 2022] GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:35.297028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:35.302600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:35.328189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:35.357899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:35.362787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:35.376478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:36.127980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:36.153209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be3bd7d6-4ce4-4ccc-a417-e178bc1f2c30 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1371 microversion: 2.1 time: 0.862749 Apr 02 21:11:36.158031 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2594/4897] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:35 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1371 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:36.170747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b386569-ea84-4874-8c55-cc7c862d4f1e tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d513d3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:36.257654 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3b386569-ea84-4874-8c55-cc7c862d4f1e tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] HTTP exception thrown: Snapshot 59015f0a-1a7f-4d2a-8217-58557722fd2b could not be found. Apr 02 21:11:36.258314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b386569-ea84-4874-8c55-cc7c862d4f1e tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Returning 404 to user: Snapshot 59015f0a-1a7f-4d2a-8217-58557722fd2b could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:36.259422 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b386569-ea84-4874-8c55-cc7c862d4f1e tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b" status: 404 len: 111 microversion: 2.1 time: 0.094401 Apr 02 21:11:36.260031 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2304/4898] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Apr 2 21:11:36 2022] GET /compute/v2.1/os-snapshots/59015f0a-1a7f-4d2a-8217-58557722fd2b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:36.269394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2197fa5-400f-4346-9fc3-a1dc88642054 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54c7cc5280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:36.605983 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2197fa5-400f-4346-9fc3-a1dc88642054 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 202 len: 0 microversion: 2.1 time: 0.340965 Apr 02 21:11:36.606532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2595/4899] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:11:36 2022] DELETE /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:11:36.617043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40557fff-63cf-4d33-bf36-d4db22dbff20 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d496c310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:36.809678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40557fff-63cf-4d33-bf36-d4db22dbff20 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 200 len: 338 microversion: 2.1 time: 0.197086 Apr 02 21:11:36.810470 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2305/4900] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:36 2022] GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 338 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:37.188647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:37.193014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:37.210560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:37.211523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:37.212783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:37.214446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:37.649752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:37.662307 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8a91cd7-8477-4cbd-afd6-1b822d4a0b4c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1566 microversion: 2.1 time: 0.494096 Apr 02 21:11:37.663987 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2596/4901] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:37 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1566 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:37.683263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:37.683850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:37.697920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:37.698362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:37.699164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:37.699608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:37.823751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6dd723a3-705c-44df-89b1-d12a60199c7f tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54d453e280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:37.886235 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6dd723a3-705c-44df-89b1-d12a60199c7f tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] HTTP exception thrown: Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117 could not be found. Apr 02 21:11:37.887282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6dd723a3-705c-44df-89b1-d12a60199c7f tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Returning 404 to user: Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:37.888988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6dd723a3-705c-44df-89b1-d12a60199c7f tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 404 len: 109 microversion: 2.1 time: 0.069754 Apr 02 21:11:37.890071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2597/4902] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:37 2022] GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:37.900577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e184384-69a6-4c43-be0f-15f5cae8e5ec tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54c7db54c0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:37.956363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-5e184384-69a6-4c43-be0f-15f5cae8e5ec tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] HTTP exception thrown: Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117 could not be found. Apr 02 21:11:37.957458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5e184384-69a6-4c43-be0f-15f5cae8e5ec tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Returning 404 to user: Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:37.959079 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5e184384-69a6-4c43-be0f-15f5cae8e5ec tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 404 len: 109 microversion: 2.1 time: 0.063849 Apr 02 21:11:37.964162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2598/4903] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:11:37 2022] DELETE /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:11:37.972291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6296aaa7-3f44-4060-9a7a-1d43b91e2515 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Calling method '.version_select at 0x7f54c7db8e50>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:38.018838 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6296aaa7-3f44-4060-9a7a-1d43b91e2515 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] HTTP exception thrown: Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117 could not be found. Apr 02 21:11:38.022244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6296aaa7-3f44-4060-9a7a-1d43b91e2515 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] Returning 404 to user: Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:11:38.023757 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6296aaa7-3f44-4060-9a7a-1d43b91e2515 tempest-VolumesSnapshotsTestJSON-1887529960 tempest-VolumesSnapshotsTestJSON-1887529960-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117" status: 404 len: 109 microversion: 2.1 time: 0.057387 Apr 02 21:11:38.025284 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2599/4904] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:11:37 2022] GET /compute/v2.1/os-volumes/be5d68a8-39e5-42c9-a3b7-74e6ec72b117 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:11:38.046935 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae21b1cc-758e-4b12-a95a-b278aeee4857 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.368515 Apr 02 21:11:38.047552 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2306/4905] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:11:37 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-interface => generated 285 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:41.111555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-932fa32d-3aa7-474f-a3bc-830782ca84f3 req-4a4b2a23-ea06-4dfe-87c4-e9e29a5088a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eae82f6-fd72-4402-ad18-75441c6d7eec", "tag": "f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:41.134390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-932fa32d-3aa7-474f-a3bc-830782ca84f3 req-4a4b2a23-ea06-4dfe-87c4-e9e29a5088a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:41.135237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-932fa32d-3aa7-474f-a3bc-830782ca84f3 req-4a4b2a23-ea06-4dfe-87c4-e9e29a5088a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:41.182371 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-932fa32d-3aa7-474f-a3bc-830782ca84f3 req-4a4b2a23-ea06-4dfe-87c4-e9e29a5088a7 service nova] Creating event network-changed:f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3 for instance 1eae82f6-fd72-4402-ad18-75441c6d7eec on nch1-master-1 Apr 02 21:11:41.214148 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-932fa32d-3aa7-474f-a3bc-830782ca84f3 req-4a4b2a23-ea06-4dfe-87c4-e9e29a5088a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108143 Apr 02 21:11:41.215199 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2600/4906] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:50.958675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:50.963112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:50.972862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:50.977555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:50.978545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:50.980659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:51.789836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:51.801842 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc988c0b-730a-4c77-8320-14b4b7ce174b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.847906 Apr 02 21:11:51.804268 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2307/4907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:50 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:51.842242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1522491619"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:51.843571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:51.867835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:51.868306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:51.869134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:51.873857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:52.364553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1808773983", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b773dc5a-9d44-4002-9677-1220ae52de00"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:52.479206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] validate_networks() for [('b773dc5a-9d44-4002-9677-1220ae52de00', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:11:52.634661 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b113b7e-fc5c-4a75-b438-81bf4aace3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.815195 Apr 02 21:11:52.641153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2601/4908] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:11:51 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 02 21:11:52.661096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:52.662711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:52.679132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:52.679680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:52.681422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:52.684867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:52.983806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:52.993738 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc473d47-2b5d-42e8-97a2-4451a2130aad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.348452 Apr 02 21:11:53.005515 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2602/4909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:52 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:53.211466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:11:53.212535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:11:53.213630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:11:53.214493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:11:53.215014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:11:53.231861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:53.232758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:53.234350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:53.237202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:53.294973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Getting quotas for project b0b5cf5b9c2f4bd997071853f0724424. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:11:53.300915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Getting quotas for user 106bbc9055cf4eef9b5fecb873c9385f and project b0b5cf5b9c2f4bd997071853f0724424. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:11:53.344410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Going to run 2 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:11:53.347113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 69200e99-2dcf-40bf-bae4-681e613f161f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:11:53.430553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=69200e99-2dcf-40bf-bae4-681e613f161f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:11:53.531645 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3571d85-51c3-43f0-baed-bf36c4c8d74f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339674 Apr 02 21:11:53.539501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2308/4910] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:11:53.551206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:53.556760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:53.558283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Searching by: {'deleted': False, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424'} {{(pid=136518) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:11:53.587867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:53.588632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:53.591228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:53.592054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:53.622767 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60122017-e17e-4af0-8627-a85942b9aa25 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.076497 Apr 02 21:11:53.623553 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2603/4911] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:11:53 2022] GET /compute/v2.1/servers => generated 677 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:53.635070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79d70034-06d3-4e8a-b6fb-e8f5c9674c91 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:53.635709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-79d70034-06d3-4e8a-b6fb-e8f5c9674c91 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:53.706630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-79d70034-06d3-4e8a-b6fb-e8f5c9674c91 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:53.714092 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79d70034-06d3-4e8a-b6fb-e8f5c9674c91 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1220 microversion: 2.1 time: 0.084126 Apr 02 21:11:53.715299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2309/4912] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:53 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:54.012134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:54.013878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:54.026188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:54.027370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:54.033202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:54.034182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:54.305020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:54.326375 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2f3bfc5-5375-4a0c-9255-a0f8cd74e7c6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.318506 Apr 02 21:11:54.329198 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2604/4913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:54 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:54.468427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6d1c798e-cc46-4ef4-bf4d-0afb372ff548 req-f4f64f6e-b977-4d4f-accb-a10a2fe07572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-unplugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:54.485992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6d1c798e-cc46-4ef4-bf4d-0afb372ff548 req-f4f64f6e-b977-4d4f-accb-a10a2fe07572 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:54.486475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6d1c798e-cc46-4ef4-bf4d-0afb372ff548 req-f4f64f6e-b977-4d4f-accb-a10a2fe07572 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:54.508257 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6d1c798e-cc46-4ef4-bf4d-0afb372ff548 req-f4f64f6e-b977-4d4f-accb-a10a2fe07572 service nova] Creating event network-vif-unplugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:11:54.522407 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6d1c798e-cc46-4ef4-bf4d-0afb372ff548 req-f4f64f6e-b977-4d4f-accb-a10a2fe07572 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057908 Apr 02 21:11:54.523348 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2310/4914] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:54.731967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:54.732619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:54.739207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:54.740043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:54.741024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:54.741503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:54.851218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:54.861102 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e75d209-056a-4e00-b08d-21288a4d2d9e tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1216 microversion: 2.1 time: 0.133051 Apr 02 21:11:54.862731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2605/4915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:54 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:55.346686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:55.347661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:55.365535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:55.366464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:55.371252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:55.375469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:55.705695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:55.737643 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b4bbb741-8a9a-4e86-b77b-3e0c35606a7f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1686 microversion: 2.1 time: 0.392236 Apr 02 21:11:55.740126 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2311/4916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:55 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1686 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:55.879241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:55.879761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:55.896622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:55.897312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:55.898284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:55.898734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:56.326253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:56.334129 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-718f5c5e-c779-40a0-b74b-e8c1ae71b6a6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1278 microversion: 2.1 time: 0.458768 Apr 02 21:11:56.335044 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2606/4917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:55 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1278 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:56.757062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:56.757819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:56.765304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:56.765733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:56.766549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:56.767046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:56.935103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:56.944702 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79171de4-808c-45f4-96dd-6c29e0b2417b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.191317 Apr 02 21:11:56.945751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2312/4918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:56 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:57.351347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:57.351979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:57.361566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:57.365107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:57.369905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:57.370632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:57.784948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:57.798818 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-567a3d3e-a244-477c-85c3-dc42b217b029 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1278 microversion: 2.1 time: 0.451429 Apr 02 21:11:57.802196 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2607/4919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:57 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1278 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:57.965528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:57.965528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:57.985326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:57.985810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:57.986611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:57.987063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:58.468590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:58.497884 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3703680a-820d-4adf-b1aa-0513f78b0098 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.538807 Apr 02 21:11:58.499028 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2313/4920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:57 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:58.749340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-41571325-c838-46b8-b412-f8060cbfed54 req-c975b3af-dba5-485a-86c2-cc584a73205f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-plugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:58.761933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-41571325-c838-46b8-b412-f8060cbfed54 req-c975b3af-dba5-485a-86c2-cc584a73205f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:58.763024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-41571325-c838-46b8-b412-f8060cbfed54 req-c975b3af-dba5-485a-86c2-cc584a73205f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:58.792695 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-41571325-c838-46b8-b412-f8060cbfed54 req-c975b3af-dba5-485a-86c2-cc584a73205f service nova] Creating event network-vif-plugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:11:58.802413 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-41571325-c838-46b8-b412-f8060cbfed54 req-c975b3af-dba5-485a-86c2-cc584a73205f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056747 Apr 02 21:11:58.804796 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2608/4921] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:11:58.817552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:58.818182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:58.841184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:58.841660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:58.842468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:58.842921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:58.954230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:58.963318 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31d2a03f-9480-44ae-959f-bcefec5ccc48 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1278 microversion: 2.1 time: 0.149531 Apr 02 21:11:58.964356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2314/4922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:58 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:59.273124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-fd9de88c-5308-47a9-b673-65817b09e913 req-d965b576-ed2a-4d25-aa80-0b16e0961b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69200e99-2dcf-40bf-bae4-681e613f161f", "tag": "e5c77e0d-d454-4e06-a459-88b01c6592cf"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:11:59.288863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fd9de88c-5308-47a9-b673-65817b09e913 req-d965b576-ed2a-4d25-aa80-0b16e0961b0c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:59.292080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fd9de88c-5308-47a9-b673-65817b09e913 req-d965b576-ed2a-4d25-aa80-0b16e0961b0c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:59.319314 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-fd9de88c-5308-47a9-b673-65817b09e913 req-d965b576-ed2a-4d25-aa80-0b16e0961b0c service nova] Creating event network-changed:e5c77e0d-d454-4e06-a459-88b01c6592cf for instance 69200e99-2dcf-40bf-bae4-681e613f161f on nch1-master-1 Apr 02 21:11:59.325938 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-fd9de88c-5308-47a9-b673-65817b09e913 req-d965b576-ed2a-4d25-aa80-0b16e0961b0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057694 Apr 02 21:11:59.327291 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2609/4923] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:11:59.515239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:59.515868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:11:59.523658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:59.527634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:59.531543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:11:59.532328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:11:59.760816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:11:59.769829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8001367c-9d9e-411a-b48c-3a7736b9c071 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.258445 Apr 02 21:11:59.775694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2315/4924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:59 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:11:59.983974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:11:59.985531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:00.002145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:00.002844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:00.004326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:00.005013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:00.787260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:00.787876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:00.795902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:00.796361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:00.797330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:00.797940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:00.862755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:00.874913 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d1870b4-c2bc-4de0-8005-97c57147815b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.898350 Apr 02 21:12:00.876805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2610/4925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:11:59 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:00.984004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:00.992960 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ad462ac-1b83-455e-8fc4-ff178e3ddbf5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.209520 Apr 02 21:12:00.994188 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2316/4926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:00 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:01.894065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:01.895433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:01.915057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:01.915786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:01.919335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:01.920793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:02.014758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:02.016215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:02.043570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:02.044297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:02.045346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:02.049246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:02.365281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:02.374613 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0771cb4-fbc5-4d63-8b30-5844ef114fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.365990 Apr 02 21:12:02.376447 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2317/4927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:02 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:02.460092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:02.477591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f65d0c3c-16f8-44e1-986b-b665d23ba827 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.587806 Apr 02 21:12:02.482612 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2611/4928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:01 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:02.628407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-95d6e587-ee1c-4c36-b6c1-dd93f18e9cea req-14382bb4-5a3e-4445-a01a-f5257fb6a0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf", "tag": "dbc2ed5e-ee05-43c4-8a57-fe8f72d81ef3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:02.646190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-95d6e587-ee1c-4c36-b6c1-dd93f18e9cea req-14382bb4-5a3e-4445-a01a-f5257fb6a0b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:02.653807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-95d6e587-ee1c-4c36-b6c1-dd93f18e9cea req-14382bb4-5a3e-4445-a01a-f5257fb6a0b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:02.681485 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-95d6e587-ee1c-4c36-b6c1-dd93f18e9cea req-14382bb4-5a3e-4445-a01a-f5257fb6a0b5 service nova] Creating event network-changed:dbc2ed5e-ee05-43c4-8a57-fe8f72d81ef3 for instance cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf on nch2-master-1 Apr 02 21:12:02.690268 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-95d6e587-ee1c-4c36-b6c1-dd93f18e9cea req-14382bb4-5a3e-4445-a01a-f5257fb6a0b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068280 Apr 02 21:12:02.691603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2318/4929] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:03.393637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:03.394265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:03.405978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:03.406450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:03.407257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:03.407713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:03.530137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:03.530781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:03.560794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:03.561259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:03.570476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:03.579810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:03.981940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:03.994051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc12d36e-e343-4020-a2b8-9de6cfc2dcda tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.471575 Apr 02 21:12:04.005311 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2319/4930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:03 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:04.409444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:04.425702 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b1574b29-8a30-463b-bf13-148806e9393a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 1.035856 Apr 02 21:12:04.433387 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2612/4931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:03 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:05.016078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:05.017319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:05.042069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:05.045472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:05.047276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:05.048096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:05.343779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:05.357968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1d258ad-9ed9-4a48-9740-6babb8221cfb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.344863 Apr 02 21:12:05.358788 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2320/4932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:05 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:05.450039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:05.450706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:05.469467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:05.469933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:05.470740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:05.471194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:05.909237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:05.918843 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5360d361-9cb2-42b9-b7b4-446aca90341b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.473632 Apr 02 21:12:05.920616 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2613/4933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:05 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:06.387346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:06.390965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:06.416875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:06.421059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:06.422180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:06.425194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:06.726307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:06.735313 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6b97d59a-c0de-4df9-9eaa-cd48d6825806 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.362466 Apr 02 21:12:06.738451 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2321/4934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:06 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:06.937688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:06.939114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:06.951455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:06.955811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:06.957243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:06.957918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:07.271455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:07.281309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb3c6d77-a3df-43ce-a58c-683de58c310b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.348186 Apr 02 21:12:07.291164 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2614/4935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:06 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:07.413132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ff9f1447-e1ab-46c3-a0b3-5dc341d42c88 req-2fd1f174-92d4-41ad-829e-827387e9b526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69200e99-2dcf-40bf-bae4-681e613f161f", "name": "network-vif-plugged", "status": "completed", "tag": "e5c77e0d-d454-4e06-a459-88b01c6592cf"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:07.424482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ff9f1447-e1ab-46c3-a0b3-5dc341d42c88 req-2fd1f174-92d4-41ad-829e-827387e9b526 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:07.425195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ff9f1447-e1ab-46c3-a0b3-5dc341d42c88 req-2fd1f174-92d4-41ad-829e-827387e9b526 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:07.448036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ff9f1447-e1ab-46c3-a0b3-5dc341d42c88 req-2fd1f174-92d4-41ad-829e-827387e9b526 service nova] Creating event network-vif-plugged:e5c77e0d-d454-4e06-a459-88b01c6592cf for instance 69200e99-2dcf-40bf-bae4-681e613f161f on nch1-master-1 Apr 02 21:12:07.462227 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ff9f1447-e1ab-46c3-a0b3-5dc341d42c88 req-2fd1f174-92d4-41ad-829e-827387e9b526 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053099 Apr 02 21:12:07.463452 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2322/4936] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:07.756312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:07.757258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:07.768339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:07.769560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:07.770537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:07.773217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:08.046642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:08.059233 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f5dfe3e9-5f89-41c6-952c-b0a6720328d2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.309422 Apr 02 21:12:08.059851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2615/4937] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:07 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:08.303941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:08.304820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:08.322970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:08.323440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:08.326981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:08.327478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:08.639420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:08.652051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7f9b560-b651-4bba-8b14-fa337f13f3e9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.356525 Apr 02 21:12:08.663636 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2323/4938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:08 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:09.076336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:09.076984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:09.094846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:09.095755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:09.098941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:09.102011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:09.429863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:09.444413 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6b64d41e-922e-4320-ba10-4bf12064da57 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.371826 Apr 02 21:12:09.453880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2616/4939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:09 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:09.560099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-4b86dd11-193d-4b31-adac-0aa77632e2e9 req-faf88d99-a729-4f9d-bae2-ed46badac843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf", "name": "network-vif-plugged", "status": "completed", "tag": "dbc2ed5e-ee05-43c4-8a57-fe8f72d81ef3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:09.584859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4b86dd11-193d-4b31-adac-0aa77632e2e9 req-faf88d99-a729-4f9d-bae2-ed46badac843 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:09.586311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4b86dd11-193d-4b31-adac-0aa77632e2e9 req-faf88d99-a729-4f9d-bae2-ed46badac843 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:09.616501 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4b86dd11-193d-4b31-adac-0aa77632e2e9 req-faf88d99-a729-4f9d-bae2-ed46badac843 service nova] Creating event network-vif-plugged:dbc2ed5e-ee05-43c4-8a57-fe8f72d81ef3 for instance cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf on nch2-master-1 Apr 02 21:12:09.632562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-4b86dd11-193d-4b31-adac-0aa77632e2e9 req-faf88d99-a729-4f9d-bae2-ed46badac843 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076564 Apr 02 21:12:09.633592 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2324/4940] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:09.684168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:09.685073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:09.701394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:09.705312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:09.706430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:09.708343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:10.024620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:10.034577 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d15b1a3-6e21-4f19-b983-136a9ce095ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.367784 Apr 02 21:12:10.046312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2617/4941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:09 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:10.463100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:10.466271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:10.481174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:10.482934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:10.485585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:10.489179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:10.681123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:10.690820 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88e8e981-4952-4118-a269-fa545bb2e1c5 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1320 microversion: 2.1 time: 0.232930 Apr 02 21:12:10.701876 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2325/4942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:10 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:11.061405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:11.063111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:11.072403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:11.073289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:11.074821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:11.075465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:11.626325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:11.640880 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f9ada9f9-6fcb-4b24-98dc-47a52d298c45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.591589 Apr 02 21:12:11.656970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2618/4943] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:11 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:11.711546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:11.716422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:11.739363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:11.740223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:11.744208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:11.745402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:11.947623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:11.962089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-570a4263-4ed8-426e-8f47-89df6523affe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 200 len: 1509 microversion: 2.1 time: 0.255973 Apr 02 21:12:11.963148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2326/4944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:11 2022] GET /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:11.980906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:11.981848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 69200e99-2dcf-40bf-bae4-681e613f161f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:11.990588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:11.991464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:11.992446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:11.993169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.218839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:12.228726 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99f58225-1e01-4b37-8432-614a98ca98c6 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/69200e99-2dcf-40bf-bae4-681e613f161f" status: 200 len: 1508 microversion: 2.1 time: 0.253235 Apr 02 21:12:12.229945 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2619/4945] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:11 2022] GET /compute/v2.1/servers/69200e99-2dcf-40bf-bae4-681e613f161f => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:12.257114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:12.258817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 69200e99-2dcf-40bf-bae4-681e613f161f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:12.320554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:12.323639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.327347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:12.328514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.367414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 69200e99-2dcf-40bf-bae4-681e613f161f] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:12:12.532718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb04255c-1173-4c70-aa4f-f783f1537598 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "DELETE /compute/v2.1/servers/69200e99-2dcf-40bf-bae4-681e613f161f" status: 204 len: 0 microversion: 2.1 time: 0.285679 Apr 02 21:12:12.533500 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2327/4946] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:12:12 2022] DELETE /compute/v2.1/servers/69200e99-2dcf-40bf-bae4-681e613f161f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:12.543356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:12.544007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:12.555187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:12.556102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.560956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:12.561736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.614225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:12:12.670912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:12.671810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:12.682431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:12.683738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.685142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:12.686013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:12.763810 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd8d1f00-48c9-4d13-b0ff-d7d3d71c68bd tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf" status: 204 len: 0 microversion: 2.1 time: 0.225083 Apr 02 21:12:12.773981 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2620/4947] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:12:12 2022] DELETE /compute/v2.1/servers/cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:12.960696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-208212679", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b773dc5a-9d44-4002-9677-1220ae52de00"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:13.028904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] validate_networks() for [('b773dc5a-9d44-4002-9677-1220ae52de00', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:12:13.189794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:13.206461 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9cc28007-2532-4b9f-8605-379e3862e8f8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1681 microversion: 2.1 time: 0.545787 Apr 02 21:12:13.207837 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2328/4948] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:12 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1681 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:13.783541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:12:13.785179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:12:13.785882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:12:13.786498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:12:13.787591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:12:13.801268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:13.801785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:13.802614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:13.803061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:13.823812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Getting quotas for project b0b5cf5b9c2f4bd997071853f0724424. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:12:13.831773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Getting quotas for user 106bbc9055cf4eef9b5fecb873c9385f and project b0b5cf5b9c2f4bd997071853f0724424. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:12:13.848058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Going to run 2 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:12:13.852464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:12:13.893415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=c709c517-b9ed-4d17-b3e3-5fdb45e74990,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:12:13.964039 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c7c1dbf-f2d7-4fcb-a1ed-36b11b208440 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.009004 Apr 02 21:12:13.965254 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2621/4949] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:12:12 2022] POST /compute/v2.1/servers => generated 32 bytes in 1011 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 02 21:12:13.982864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:13.986048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:13.986821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Searching by: {'deleted': False, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:12:14.012666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:14.014018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:14.015739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:14.016391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:14.044368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:12:14.073333 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-028a75dd-fee3-469a-9e8b-f9951df52ae1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.094947 Apr 02 21:12:14.079141 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2329/4950] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:12:13 2022] GET /compute/v2.1/servers => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:14.087741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be459bf1-3182-4c8a-bb1a-c34ef42536b9 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:14.088637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be459bf1-3182-4c8a-bb1a-c34ef42536b9 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:14.169962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be459bf1-3182-4c8a-bb1a-c34ef42536b9 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:14.192837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be459bf1-3182-4c8a-bb1a-c34ef42536b9 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1217 microversion: 2.1 time: 0.111613 Apr 02 21:12:14.197298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2622/4951] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:14 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:14.225150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:14.226734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:14.238006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:14.239061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:14.240233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:14.241387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:14.568503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:14.581305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca61c851-7453-4a71-9653-d24cd7e3a54c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.361617 Apr 02 21:12:14.583552 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2330/4952] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:14 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:15.219728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:15.220544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:15.260166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:15.264702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:15.266399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:15.275278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:15.535608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:15.547034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ae0d6a9a-005a-4d15-b0d1-5807df8e9f56 req-bf4c24f0-a1cf-472e-8eca-67d9db8967f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69200e99-2dcf-40bf-bae4-681e613f161f", "name": "network-vif-deleted", "tag": "e5c77e0d-d454-4e06-a459-88b01c6592cf"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:15.549873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-63ff8f07-23fd-42fd-984e-e08933cecf40 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1221 microversion: 2.1 time: 0.338672 Apr 02 21:12:15.555774 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2623/4953] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:15 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1221 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:15.584180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ae0d6a9a-005a-4d15-b0d1-5807df8e9f56 req-bf4c24f0-a1cf-472e-8eca-67d9db8967f7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:15.584686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ae0d6a9a-005a-4d15-b0d1-5807df8e9f56 req-bf4c24f0-a1cf-472e-8eca-67d9db8967f7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:15.633112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ae0d6a9a-005a-4d15-b0d1-5807df8e9f56 req-bf4c24f0-a1cf-472e-8eca-67d9db8967f7 service nova] Creating event network-vif-deleted:e5c77e0d-d454-4e06-a459-88b01c6592cf for instance 69200e99-2dcf-40bf-bae4-681e613f161f on nch1-master-1 Apr 02 21:12:15.647968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ae0d6a9a-005a-4d15-b0d1-5807df8e9f56 req-bf4c24f0-a1cf-472e-8eca-67d9db8967f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105127 Apr 02 21:12:15.651480 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2331/4954] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:15.738568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:15.739871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:15.750417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:15.750962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:15.752360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:15.753098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:16.023374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:16.034178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d417993e-99f3-4c29-8a85-2804cf8d47c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.299795 Apr 02 21:12:16.063859 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2624/4955] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:15 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:16.572923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:16.573624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:16.582485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:16.582860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:16.583641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:16.584081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:16.692337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:16.713798 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8f22f8e-e198-4a20-ac6f-dba4abe0c955 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1275 microversion: 2.1 time: 0.144158 Apr 02 21:12:16.716800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2332/4956] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:16 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:17.690737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9feda661-61f3-409a-b94f-523c0208deb7 req-7f3ed16f-ef3c-43c6-8b75-8dff7f1e28a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf", "name": "network-vif-deleted", "tag": "dbc2ed5e-ee05-43c4-8a57-fe8f72d81ef3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:17.706965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9feda661-61f3-409a-b94f-523c0208deb7 req-7f3ed16f-ef3c-43c6-8b75-8dff7f1e28a4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:17.707430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9feda661-61f3-409a-b94f-523c0208deb7 req-7f3ed16f-ef3c-43c6-8b75-8dff7f1e28a4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:17.733565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:17.734113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:17.745216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:17.749048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:17.749920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:17.750437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:17.752952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9feda661-61f3-409a-b94f-523c0208deb7 req-7f3ed16f-ef3c-43c6-8b75-8dff7f1e28a4 service nova] Creating event network-vif-deleted:dbc2ed5e-ee05-43c4-8a57-fe8f72d81ef3 for instance cb9e7ac5-31aa-4a8b-b8d2-2da360c3bbcf on nch2-master-1 Apr 02 21:12:17.767799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9feda661-61f3-409a-b94f-523c0208deb7 req-7f3ed16f-ef3c-43c6-8b75-8dff7f1e28a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081213 Apr 02 21:12:17.768475 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2625/4957] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:17.855747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:17.872393 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bbc4a13e-5896-4dc9-b50d-314f6456762b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1275 microversion: 2.1 time: 0.143375 Apr 02 21:12:17.873973 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2333/4958] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:17 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:18.122601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:18.124106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:18.134645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.135108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:18.136036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.136539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:18.381290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-66e2dd1a-7292-43ca-bfd5-3f98d361d7e6 req-6a7cdc61-5153-4c0f-91f5-1aff0e0f2870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-unplugged", "status": "completed", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:18.397906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-66e2dd1a-7292-43ca-bfd5-3f98d361d7e6 req-6a7cdc61-5153-4c0f-91f5-1aff0e0f2870 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.398759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-66e2dd1a-7292-43ca-bfd5-3f98d361d7e6 req-6a7cdc61-5153-4c0f-91f5-1aff0e0f2870 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:18.418197 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-66e2dd1a-7292-43ca-bfd5-3f98d361d7e6 req-6a7cdc61-5153-4c0f-91f5-1aff0e0f2870 service nova] Creating event network-vif-unplugged:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:12:18.426044 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-66e2dd1a-7292-43ca-bfd5-3f98d361d7e6 req-6a7cdc61-5153-4c0f-91f5-1aff0e0f2870 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047977 Apr 02 21:12:18.427675 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2334/4959] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:12:18.732537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:18.743271 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6283d5f-b5f3-41c1-8348-efc2c24db1a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.626869 Apr 02 21:12:18.743880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2626/4960] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:18 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:18.764539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:18.765683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:18.777875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.778568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:18.779622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.780255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:18.889995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:18.890613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:18.897121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.897946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:18.899103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:18.899735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.008316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:19.021731 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45f66d9c-dab8-4f72-a94e-b287052bb5ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.262238 Apr 02 21:12:19.022479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2335/4961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:18 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:19.039011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:19.040063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:19.047862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.048702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.050006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.050897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.378840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:19.384518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:19.387587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23e4b45c-00c2-444b-8a1d-d57e5020330a tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.501938 Apr 02 21:12:19.389838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2627/4962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:18 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:19.400599 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11e4a2e7-9818-485e-8c4e-30125371503b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.358348 Apr 02 21:12:19.400599 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2336/4963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:19 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:19.416803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:19.418547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:19.426344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.428545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.429377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.429840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.544500 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7eeefc1b-fef4-4efc-8655-95e053b777f7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.132524 Apr 02 21:12:19.545642 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2337/4964] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:12:19 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:12:19.553820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:19.554442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:19.570339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.570817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.571614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.572229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.813430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a77abb4c-42cb-49dc-88da-71348fcf04d9 req-6d04ec6c-36fb-4f7d-8ece-29fb350c3bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c709c517-b9ed-4d17-b3e3-5fdb45e74990", "tag": "f9a211c1-1d7d-45d9-a514-cba375c7a324"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:19.850008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a77abb4c-42cb-49dc-88da-71348fcf04d9 req-6d04ec6c-36fb-4f7d-8ece-29fb350c3bd2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:19.855797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a77abb4c-42cb-49dc-88da-71348fcf04d9 req-6d04ec6c-36fb-4f7d-8ece-29fb350c3bd2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:19.872004 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a77abb4c-42cb-49dc-88da-71348fcf04d9 req-6d04ec6c-36fb-4f7d-8ece-29fb350c3bd2 service nova] Creating event network-changed:f9a211c1-1d7d-45d9-a514-cba375c7a324 for instance c709c517-b9ed-4d17-b3e3-5fdb45e74990 on nch1-master-1 Apr 02 21:12:19.889958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a77abb4c-42cb-49dc-88da-71348fcf04d9 req-6d04ec6c-36fb-4f7d-8ece-29fb350c3bd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080591 Apr 02 21:12:19.893547 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2338/4965] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:12:19.986313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:19.993858 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea2ed72e-7c0c-44da-a0e0-5a62349ce759 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1670 microversion: 2.1 time: 0.443880 Apr 02 21:12:20.004795 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2628/4966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:19 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1670 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:20.407004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:20.408000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:20.417285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:20.420095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:20.421991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:20.423475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:20.647980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:20.664847 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49569332-92ef-4362-816c-97b2d895a499 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.260919 Apr 02 21:12:20.675510 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2339/4967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:20 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:21.013228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:21.014479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:21.032178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.036366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.037263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.041130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.358605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:21.367915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30ecbffd-d5b1-432c-a4c2-7cae3a178c6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.360282 Apr 02 21:12:21.368914 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2629/4968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:21 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:21.385733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:21.387297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:21.398578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.399229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.400064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.400532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.452763 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-50d414d1-9565-4644-9d8e-92d0db99c26d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 200 len: 143 microversion: 2.1 time: 0.070642 Apr 02 21:12:21.454018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2340/4969] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:12:21 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 143 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:21.463033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:21.463877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:21.469895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.470360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.471147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.472266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.627962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:21.635671 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61595883-7007-4d3e-b62e-02eb693caa38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.176394 Apr 02 21:12:21.637050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2630/4970] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:21 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:21.654308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:21.655370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:21.663832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.664775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.665705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.666556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.682578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:21.683865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:21.701562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.702028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.702840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.703259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.878864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:21.886238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:21.888782 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-512680e1-d898-4120-8def-c08c665e4970 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.210336 Apr 02 21:12:21.899884 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2631/4971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:21 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:21.906328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-098e1072-dda9-4922-9561-6568ea05e431 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.256245 Apr 02 21:12:21.918228 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2341/4972] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:21 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:21.925100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:21.925729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:21.929759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f378e3cf-f1c3-4483-b926-b7b574ad1457 req-de1cae88-8ad1-4eae-9e56-7ff472fcfabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a206b1c-027e-49db-ad47-b08ddcdd18a6", "tag": "14aacda4-5430-466d-98af-773d671332fe"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:21.932437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.933785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.934809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.935458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.950136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f378e3cf-f1c3-4483-b926-b7b574ad1457 req-de1cae88-8ad1-4eae-9e56-7ff472fcfabb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:21.950599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f378e3cf-f1c3-4483-b926-b7b574ad1457 req-de1cae88-8ad1-4eae-9e56-7ff472fcfabb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:21.964828 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f378e3cf-f1c3-4483-b926-b7b574ad1457 req-de1cae88-8ad1-4eae-9e56-7ff472fcfabb service nova] Creating event network-changed:14aacda4-5430-466d-98af-773d671332fe for instance 9a206b1c-027e-49db-ad47-b08ddcdd18a6 on nch2-master-1 Apr 02 21:12:21.971540 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f378e3cf-f1c3-4483-b926-b7b574ad1457 req-de1cae88-8ad1-4eae-9e56-7ff472fcfabb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051648 Apr 02 21:12:21.973563 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2632/4973] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:22.123854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:22.131673 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a747073-402b-483e-9e98-dfc2a358184f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.212307 Apr 02 21:12:22.132271 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2342/4974] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:21 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:22.150050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:22.150767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:22.157881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:22.158340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:22.159131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:22.159579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:22.422730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:22.430655 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dcf6befb-e609-42ce-a711-3aac646caf64 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.285563 Apr 02 21:12:22.431228 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2633/4975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:22 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:22.541783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-305422146", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "31fced4c-1a00-48a4-a6cd-17c45563c707"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:22.596192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] validate_networks() for [('31fced4c-1a00-48a4-a6cd-17c45563c707', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:12:22.907798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:22.908430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:22.914649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:22.915112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:22.915903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:22.916527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:22.994229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:12:22.994922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:12:22.995608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:12:22.996033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:12:22.996479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:12:23.022372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:23.023750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:23.025813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:23.029338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:23.069590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:12:23.087837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:12:23.104090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:12:23.113377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:12:23.120680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:23.128516 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2300a023-fda9-4e94-ba92-738453ef2747 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.224580 Apr 02 21:12:23.138611 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2634/4976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:22 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:23.187145 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f211dc74-94bb-4bdc-90a9-536f34376ae4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648386 Apr 02 21:12:23.188176 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2343/4977] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:12:23.199337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a6c53426-1bad-47ef-8061-2e16c1263bcf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:23.200099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a6c53426-1bad-47ef-8061-2e16c1263bcf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:23.303924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a6c53426-1bad-47ef-8061-2e16c1263bcf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:23.312036 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a6c53426-1bad-47ef-8061-2e16c1263bcf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1214 microversion: 2.1 time: 0.117767 Apr 02 21:12:23.313447 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2635/4978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:23 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:24.146428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:24.147121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:24.155025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:24.155560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:24.156697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:24.157153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:24.329837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:24.330496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:24.357565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:24.358027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:24.364626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:24.367801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:24.438145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:24.451356 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-438b950d-373e-4a2b-a7ca-e29bf7898ddb tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.309556 Apr 02 21:12:24.463603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2344/4979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:24 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:24.538905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:24.549415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f676250-d1fa-49c2-b873-460556cec4ad tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1284 microversion: 2.1 time: 0.223522 Apr 02 21:12:24.552188 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2636/4980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:24 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:25.472042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:25.472851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:25.493037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:25.493706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:25.498311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:25.500030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:25.569631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:25.570628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:25.583811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:25.584276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:25.585369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:25.586022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:25.734193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:25.742209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d3f3713-d817-4462-833e-4fdf8faac5e7 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.275390 Apr 02 21:12:25.742786 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2345/4981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:25 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:26.179014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:26.192842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-94f15990-f38d-43c2-b23d-8064c1677f89 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.629038 Apr 02 21:12:26.193670 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2637/4982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:25 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:26.760601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:26.761577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:26.774750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:26.775220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:26.776020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:26.777027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:26.851326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4ac268bd-fd2e-4996-b833-79ee3ff18fcf req-ac02aa02-7e26-44bb-96aa-ca414de96c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cafb483-0676-4e62-8476-0173f608446a", "tag": "d4c6aff0-bf35-4f5b-baaa-ec39dcbe3a9a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:26.899008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4ac268bd-fd2e-4996-b833-79ee3ff18fcf req-ac02aa02-7e26-44bb-96aa-ca414de96c32 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:26.900781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4ac268bd-fd2e-4996-b833-79ee3ff18fcf req-ac02aa02-7e26-44bb-96aa-ca414de96c32 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:26.932338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4ac268bd-fd2e-4996-b833-79ee3ff18fcf req-ac02aa02-7e26-44bb-96aa-ca414de96c32 service nova] Creating event network-changed:d4c6aff0-bf35-4f5b-baaa-ec39dcbe3a9a for instance 9cafb483-0676-4e62-8476-0173f608446a on nch1-master-1 Apr 02 21:12:26.948089 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4ac268bd-fd2e-4996-b833-79ee3ff18fcf req-ac02aa02-7e26-44bb-96aa-ca414de96c32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102015 Apr 02 21:12:26.959501 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2638/4983] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:27.095413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:27.105780 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed3450f6-7bb2-44fe-8e03-64c0dc5c177c tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.347898 Apr 02 21:12:27.117558 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2346/4984] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:26 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:27.139815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a704aa90-09c6-4f1d-8748-3b08f40083e8 req-2afc6d17-3eef-430d-ba54-b8cec1e6fca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a206b1c-027e-49db-ad47-b08ddcdd18a6", "name": "network-vif-plugged", "status": "completed", "tag": "14aacda4-5430-466d-98af-773d671332fe"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:27.167729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a704aa90-09c6-4f1d-8748-3b08f40083e8 req-2afc6d17-3eef-430d-ba54-b8cec1e6fca5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:27.169371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a704aa90-09c6-4f1d-8748-3b08f40083e8 req-2afc6d17-3eef-430d-ba54-b8cec1e6fca5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:27.210617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a704aa90-09c6-4f1d-8748-3b08f40083e8 req-2afc6d17-3eef-430d-ba54-b8cec1e6fca5 service nova] Creating event network-vif-plugged:14aacda4-5430-466d-98af-773d671332fe for instance 9a206b1c-027e-49db-ad47-b08ddcdd18a6 on nch2-master-1 Apr 02 21:12:27.215116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:27.215920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:27.226289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:27.227298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:27.228627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:27.228746 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a704aa90-09c6-4f1d-8748-3b08f40083e8 req-2afc6d17-3eef-430d-ba54-b8cec1e6fca5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090671 Apr 02 21:12:27.229748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:27.234212 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2639/4985] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:27.489815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:27.502733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f4681dc5-beb0-48f3-b582-d01d142e880f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.295287 Apr 02 21:12:27.519061 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2347/4986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:27 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:28.124992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:28.125761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:28.138877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:28.139354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:28.140164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:28.145431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:28.463277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:28.473275 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cff26c86-8076-42e2-a23f-f01b6da712b1 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1317 microversion: 2.1 time: 0.352364 Apr 02 21:12:28.474664 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2640/4987] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:28 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:28.523340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:28.526158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:28.541668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:28.542949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:28.543911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:28.544387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:28.702457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:28.713600 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-15584ea6-6de0-49e4-9d98-e9159a2ccac2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.195118 Apr 02 21:12:28.714777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2348/4988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:28 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:29.251239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-255b5e0e-b971-4db8-9ff5-7327bf0c0774 req-d6dab927-8817-4e0c-836b-6fac95609ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709c517-b9ed-4d17-b3e3-5fdb45e74990", "name": "network-vif-plugged", "status": "completed", "tag": "f9a211c1-1d7d-45d9-a514-cba375c7a324"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:29.263737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-255b5e0e-b971-4db8-9ff5-7327bf0c0774 req-d6dab927-8817-4e0c-836b-6fac95609ebc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.264688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-255b5e0e-b971-4db8-9ff5-7327bf0c0774 req-d6dab927-8817-4e0c-836b-6fac95609ebc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.281170 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-255b5e0e-b971-4db8-9ff5-7327bf0c0774 req-d6dab927-8817-4e0c-836b-6fac95609ebc service nova] Creating event network-vif-plugged:f9a211c1-1d7d-45d9-a514-cba375c7a324 for instance c709c517-b9ed-4d17-b3e3-5fdb45e74990 on nch1-master-1 Apr 02 21:12:29.287473 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-255b5e0e-b971-4db8-9ff5-7327bf0c0774 req-d6dab927-8817-4e0c-836b-6fac95609ebc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041929 Apr 02 21:12:29.302183 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2641/4989] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:12:29.494270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:29.494903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:29.501495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.502039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.502827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.503483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.691799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:29.701817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52b87873-2748-407e-aa49-1b94f2fd2832 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1506 microversion: 2.1 time: 0.211964 Apr 02 21:12:29.702619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2349/4990] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:29 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:29.722288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:29.723209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:29.731540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:29.731685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.731984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.732539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:29.733620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.734162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.740197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.740902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.742210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:29.742891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:29.926142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:29.938937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ba2e078-40a9-4959-843b-3fb61f36d1fe tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990" status: 200 len: 1317 microversion: 2.1 time: 0.221168 Apr 02 21:12:29.939080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:29.939537 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2642/4991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:29 2022] GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:29.947905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de6b1cc7-5944-4568-a963-1183fb56f04c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.220909 Apr 02 21:12:29.949554 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2350/4992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:29 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:30.957839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:30.958458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:30.965550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:30.966039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:30.966479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:30.966991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:30.967268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:30.967891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:30.973766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:30.974228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:30.975188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:30.975788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.146117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:31.150102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:31.157121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-faa5c065-2439-4c8f-97a7-f58efccb411d tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990" status: 200 len: 1506 microversion: 2.1 time: 0.202965 Apr 02 21:12:31.157893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2643/4993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:30 2022] GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:31.170671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-adf438c5-2c43-4dcb-b83a-ef998254dddd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.196662 Apr 02 21:12:31.171591 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2351/4994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:30 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:31.184156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:31.184705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:31.190941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:31.191403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.192183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:31.192663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.222162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:12:31.327100 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c162248-4e46-41a5-a372-9ec436bddfa2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990" status: 204 len: 0 microversion: 2.1 time: 0.154812 Apr 02 21:12:31.328127 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2644/4995] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:12:31 2022] DELETE /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:12:31.339382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:31.340005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:31.347845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:31.348425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.349531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:31.350012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.378646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:12:31.479693 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9165987-3e33-4f03-921e-252c95a794b2 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 204 len: 0 microversion: 2.1 time: 0.146197 Apr 02 21:12:31.480896 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2352/4996] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:12:31 2022] DELETE /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:31.491723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:31.493233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:31.501954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:31.502564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.503934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:31.504633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:31.824331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:31.832216 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-27c95566-7514-4ca8-92a5-54be4d6655a0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990" status: 200 len: 1512 microversion: 2.1 time: 0.346428 Apr 02 21:12:31.833379 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2645/4997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:31 2022] GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:32.191769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:32.194908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:32.205045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:32.205780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:32.206866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:32.207529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:32.573553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:32.587597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6870c31e-1e9e-4df9-8ff6-0a980896b9ea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.401617 Apr 02 21:12:32.590017 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2353/4998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:32 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:32.850890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:32.851505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:32.860301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:32.864978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:32.866044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:32.871063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:33.260954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:33.271957 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-556a08db-4325-4d6d-a7ad-95ed941db68b tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990" status: 200 len: 1512 microversion: 2.1 time: 0.422263 Apr 02 21:12:33.273923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2646/4999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:32 2022] GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990 => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:33.615960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:33.617978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:33.626195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:33.627500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:33.629425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:33.630152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:33.735838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7b48fc16-b431-414a-a538-b12a5c4b5e1a req-87ee7001-1236-47ed-b5f7-2b73095ffab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c709c517-b9ed-4d17-b3e3-5fdb45e74990", "name": "network-vif-deleted", "tag": "f9a211c1-1d7d-45d9-a514-cba375c7a324"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:33.746914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7b48fc16-b431-414a-a538-b12a5c4b5e1a req-87ee7001-1236-47ed-b5f7-2b73095ffab7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:33.747357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7b48fc16-b431-414a-a538-b12a5c4b5e1a req-87ee7001-1236-47ed-b5f7-2b73095ffab7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:33.773947 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7b48fc16-b431-414a-a538-b12a5c4b5e1a req-87ee7001-1236-47ed-b5f7-2b73095ffab7 service nova] Creating event network-vif-deleted:f9a211c1-1d7d-45d9-a514-cba375c7a324 for instance c709c517-b9ed-4d17-b3e3-5fdb45e74990 on nch1-master-1 Apr 02 21:12:33.791131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7b48fc16-b431-414a-a538-b12a5c4b5e1a req-87ee7001-1236-47ed-b5f7-2b73095ffab7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059166 Apr 02 21:12:33.796444 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2647/5000] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:12:33.931934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:33.941609 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9e8c996c-20aa-4fdd-9d05-920023ce1252 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.332374 Apr 02 21:12:33.950158 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2354/5001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:33 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:34.293878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:34.294967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: c709c517-b9ed-4d17-b3e3-5fdb45e74990] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:34.305893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.306399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:34.311230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.311700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:34.356350 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] HTTP exception thrown: Instance c709c517-b9ed-4d17-b3e3-5fdb45e74990 could not be found. Apr 02 21:12:34.357239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Returning 404 to user: Instance c709c517-b9ed-4d17-b3e3-5fdb45e74990 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:12:34.358575 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-999b9a7c-0fd2-41a9-a16f-f5d7b102d8e0 tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990" status: 404 len: 111 microversion: 2.1 time: 0.071953 Apr 02 21:12:34.359781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2648/5002] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:34 2022] GET /compute/v2.1/servers/c709c517-b9ed-4d17-b3e3-5fdb45e74990 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:34.369212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:34.370746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:34.380197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.380781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:34.385371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.385371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:34.442729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.443217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:34.443683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lazy-loading 'fault' on Instance uuid 9a206b1c-027e-49db-ad47-b08ddcdd18a6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:12:34.495597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '106bbc9055cf4eef9b5fecb873c9385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b5cf5b9c2f4bd997071853f0724424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:34.505378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a66ad146-4235-4210-b650-9bb7af52887f tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 200 len: 1307 microversion: 2.1 time: 0.141418 Apr 02 21:12:34.507135 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2355/5003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:34 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:34.959279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:34.960190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:34.967040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.967562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:34.968410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:34.969189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:35.160787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:35.173937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0e7e1a1-9132-4273-ad36-fe27779f7608 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.215580 Apr 02 21:12:35.174590 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2649/5004] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:34 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:35.379040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-1249f7f1-1455-4a98-bc58-0b3ef9e4815b req-9f4b11ac-7d8e-4938-a150-6c928eb1fdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cafb483-0676-4e62-8476-0173f608446a", "name": "network-vif-plugged", "status": "completed", "tag": "d4c6aff0-bf35-4f5b-baaa-ec39dcbe3a9a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:35.388059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1249f7f1-1455-4a98-bc58-0b3ef9e4815b req-9f4b11ac-7d8e-4938-a150-6c928eb1fdd5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:35.388565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1249f7f1-1455-4a98-bc58-0b3ef9e4815b req-9f4b11ac-7d8e-4938-a150-6c928eb1fdd5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:35.403312 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-1249f7f1-1455-4a98-bc58-0b3ef9e4815b req-9f4b11ac-7d8e-4938-a150-6c928eb1fdd5 service nova] Creating event network-vif-plugged:d4c6aff0-bf35-4f5b-baaa-ec39dcbe3a9a for instance 9cafb483-0676-4e62-8476-0173f608446a on nch1-master-1 Apr 02 21:12:35.408771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-1249f7f1-1455-4a98-bc58-0b3ef9e4815b req-9f4b11ac-7d8e-4938-a150-6c928eb1fdd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 Apr 02 21:12:35.409942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2356/5005] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:35.523631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:35.524436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] [instance: 9a206b1c-027e-49db-ad47-b08ddcdd18a6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:35.535170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:35.535778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:35.536708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:35.537386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:35.559201 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] HTTP exception thrown: Instance 9a206b1c-027e-49db-ad47-b08ddcdd18a6 could not be found. Apr 02 21:12:35.560151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] Returning 404 to user: Instance 9a206b1c-027e-49db-ad47-b08ddcdd18a6 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:12:35.561515 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61e2cca1-9e03-4913-b44c-dd5f3eda72fc tempest-MultipleCreateTestJSON-400541279 tempest-MultipleCreateTestJSON-400541279-project] 10.222.0.18 "GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6" status: 404 len: 111 microversion: 2.1 time: 0.042679 Apr 02 21:12:35.565478 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2650/5006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:35 2022] GET /compute/v2.1/servers/9a206b1c-027e-49db-ad47-b08ddcdd18a6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:12:35.848871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f01b75fa-4de3-4c5d-a073-1bba63e5065f req-bee4ad5e-c0d7-40d4-abeb-ad8261695074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a206b1c-027e-49db-ad47-b08ddcdd18a6", "name": "network-vif-deleted", "tag": "14aacda4-5430-466d-98af-773d671332fe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:35.877176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f01b75fa-4de3-4c5d-a073-1bba63e5065f req-bee4ad5e-c0d7-40d4-abeb-ad8261695074 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:35.884940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f01b75fa-4de3-4c5d-a073-1bba63e5065f req-bee4ad5e-c0d7-40d4-abeb-ad8261695074 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:35.925109 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f01b75fa-4de3-4c5d-a073-1bba63e5065f req-bee4ad5e-c0d7-40d4-abeb-ad8261695074 service nova] Creating event network-vif-deleted:14aacda4-5430-466d-98af-773d671332fe for instance 9a206b1c-027e-49db-ad47-b08ddcdd18a6 on nch2-master-1 Apr 02 21:12:35.935197 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f01b75fa-4de3-4c5d-a073-1bba63e5065f req-bee4ad5e-c0d7-40d4-abeb-ad8261695074 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093419 Apr 02 21:12:35.941955 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2357/5007] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:36.195508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:36.196158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:36.212837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:36.217092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:36.218276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:36.218925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:36.467181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:36.477377 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b1d176d-cd36-495a-a8c2-0b7c7f80ec7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1314 microversion: 2.1 time: 0.290045 Apr 02 21:12:36.478676 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2651/5008] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:36 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:37.498036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:37.499451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:37.516756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:37.523747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:37.524822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:37.533687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:37.981675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:37.991853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-da92d7c7-cbf4-476d-9788-4d3fe34f817b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1501 microversion: 2.1 time: 0.499828 Apr 02 21:12:37.993323 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2358/5009] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:37 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1501 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:38.011583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2d97cca-c4f5-4452-8e8a-8b0677136895 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:38.027474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2d97cca-c4f5-4452-8e8a-8b0677136895 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:38.028052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2d97cca-c4f5-4452-8e8a-8b0677136895 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:38.057543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2d97cca-c4f5-4452-8e8a-8b0677136895 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Going to try to stop instance {{(pid=136518) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:12:38.133819 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2d97cca-c4f5-4452-8e8a-8b0677136895 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a/action" status: 202 len: 0 microversion: 2.1 time: 0.126134 Apr 02 21:12:38.134860 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2652/5010] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:12:38 2022] POST /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:12:38.143166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:38.143796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:38.172222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:38.173032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:38.174226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:38.174859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:38.436315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:38.450334 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-45798b04-efa6-4cb9-bcb9-1343b3bc49a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.310457 Apr 02 21:12:38.451753 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2359/5011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:38 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:39.468891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:39.470152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:39.481227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:39.481718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:39.482548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:39.482999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:39.913977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:39.932118 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f7d7128b-8d48-4320-b7dc-ec15fc94d282 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.468449 Apr 02 21:12:39.944229 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2653/5012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:39 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:40.873403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2113574859", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "8afb841d-6490-4b70-881f-7807d1e25486"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:40.951918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:40.953394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:40.970737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:40.971498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:40.972570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:40.973178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:40.991702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] validate_networks() for [('8afb841d-6490-4b70-881f-7807d1e25486', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:12:41.497079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:41.507094 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-39b3d346-53e3-4767-8fae-7d0df3075000 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.557770 Apr 02 21:12:41.511512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2654/5013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:40 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:41.783331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:12:41.783525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:12:41.784594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:12:41.785110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:12:41.785823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:12:41.797627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:41.798531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:41.800007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:41.801437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:41.826552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Getting quotas for project 33cdd8617965489c859587b4034347ec. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:12:41.835228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Getting quotas for user a1e4a58cbc274f5ab842d28c45d185c8 and project 33cdd8617965489c859587b4034347ec. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:12:41.853526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:12:41.858186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:12:41.933265 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f982f1c7-c10e-4168-a12f-cfde3b783fb2 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338861 Apr 02 21:12:41.934632 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2360/5014] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:12:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:12:41.945473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-63269ae2-5c57-4b14-993f-52911133179e tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:41.946553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-63269ae2-5c57-4b14-993f-52911133179e tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:42.093734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-63269ae2-5c57-4b14-993f-52911133179e tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:42.110132 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-63269ae2-5c57-4b14-993f-52911133179e tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1225 microversion: 2.1 time: 0.161976 Apr 02 21:12:42.121024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2655/5015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:41 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1225 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:42.527639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:42.528297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:42.548149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:42.548954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:42.550716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:42.551354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:42.875186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:42.890564 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19642efa-5f81-40a1-b1f1-f85162649bc6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.367016 Apr 02 21:12:42.891779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2361/5016] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:42 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:43.137584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:43.138406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:43.146140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:43.157064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:43.158081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:43.158640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:43.306889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:43.315765 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4e69192-1dee-42ff-9100-d2e18fbcf2a6 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1221 microversion: 2.1 time: 0.182497 Apr 02 21:12:43.320776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2656/5017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:43 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:43.908581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:43.909929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:43.917601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:43.918595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:43.919464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:43.920124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:44.336590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:44.337935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:44.345551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:44.346367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:44.347396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:44.348102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:44.459804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:44.467361 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cfac1dea-d4a6-4e48-8f9b-199e7174c4fa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1283 microversion: 2.1 time: 0.135992 Apr 02 21:12:44.477783 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2657/5018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:44 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1283 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:44.578123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:44.589150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-82c008e8-70c6-4852-8875-5c0cb1594c7e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.685109 Apr 02 21:12:44.590767 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2362/5019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:43 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:45.484813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:45.485500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:45.493252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:45.493979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:45.496542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:45.497169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:45.608354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:45.609762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:45.619986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:45.621927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:45.623312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:45.623993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:45.860394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:45.875776 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0deec62f-ef0b-4216-9009-b652d27204be tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.271591 Apr 02 21:12:45.876665 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2363/5020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:45 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:45.940286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:45.957063 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54c3564f-eed9-444d-9b62-fc8b80b7525d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.476000 Apr 02 21:12:45.968962 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2658/5021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:45 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:46.451076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-346ee036-e6de-4cba-b64a-5f92d9c73671 req-fb2d0543-3242-4cb9-a928-0f3400b7c222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8034285b-8818-455d-9bfa-4fcdce732e33", "tag": "d721a3c3-0fae-4b0f-a281-eda5305fbea9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:46.460279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-346ee036-e6de-4cba-b64a-5f92d9c73671 req-fb2d0543-3242-4cb9-a928-0f3400b7c222 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:46.461006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-346ee036-e6de-4cba-b64a-5f92d9c73671 req-fb2d0543-3242-4cb9-a928-0f3400b7c222 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:46.472995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-346ee036-e6de-4cba-b64a-5f92d9c73671 req-fb2d0543-3242-4cb9-a928-0f3400b7c222 service nova] Creating event network-changed:d721a3c3-0fae-4b0f-a281-eda5305fbea9 for instance 8034285b-8818-455d-9bfa-4fcdce732e33 on nch1-master-1 Apr 02 21:12:46.478209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-346ee036-e6de-4cba-b64a-5f92d9c73671 req-fb2d0543-3242-4cb9-a928-0f3400b7c222 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043483 Apr 02 21:12:46.479651 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2364/5022] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:46.896283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:46.898632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:46.909579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:46.910361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:46.911709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:46.912420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:46.982048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:46.985328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:46.992813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:46.993519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:46.994485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:46.995080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:47.163975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:47.175504 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2a7648a-d7e2-4ebb-9174-dc34fbc40e35 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.285094 Apr 02 21:12:47.179655 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2659/5023] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:46 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:47.354929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:47.363512 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-50767d7c-0183-4a6b-8e84-3098392071a0 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.388290 Apr 02 21:12:47.364416 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2365/5024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:46 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:48.193217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:48.195182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:48.202680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:48.203388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:48.204918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:48.205837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:48.381298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:48.381920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:48.388910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:48.389462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:48.390328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:48.390849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:48.448332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:48.457937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2b02c09-c360-4142-85b5-02da209e9975 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.268521 Apr 02 21:12:48.459127 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2660/5025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:48 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:48.579440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:48.590010 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51829a99-c7a9-455a-be02-61984c5aeb51 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.212546 Apr 02 21:12:48.590822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2366/5026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:48 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:49.475114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:49.476754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:49.484875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:49.485701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:49.486921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:49.487740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:49.610688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:49.611301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:49.620815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:49.622342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:49.623781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:49.624561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:49.862900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:49.874275 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a8404caa-dd88-4b45-9f53-c618c57c45dd tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.267583 Apr 02 21:12:49.876316 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2367/5027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:49 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:49.926802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:49.935146 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2accfad2-7568-4f32-9dd9-178d8d0cf28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.463889 Apr 02 21:12:49.935817 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2661/5028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:49 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:50.892213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:50.892867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:50.906516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:50.907181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:50.908208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:50.908870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:50.952857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:50.953488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:50.972772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:50.973251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:50.974056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:50.974506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:51.243871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:51.255152 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e217c4d-9e46-47d1-b1db-7e71244add10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.306137 Apr 02 21:12:51.255858 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2662/5029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:50 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:51.271530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:51.283236 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ab1fcc53-7770-4aec-af24-fb72e5a29d70 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.394750 Apr 02 21:12:51.294596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2368/5030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:50 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:52.273107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:52.274721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:52.284886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:52.285562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:52.286536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:52.287192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:52.300062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:52.301270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:52.315812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:52.317952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:52.319480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:52.320278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:52.614078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:52.626146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9901a982-ac80-42c4-887f-ea555ae600aa tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.329759 Apr 02 21:12:52.626681 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2369/5031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:52 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:12:52.797299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:52.824771 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87c94fac-a63d-49ee-95aa-cbbce38d75b5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.552382 Apr 02 21:12:52.825415 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2663/5032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:52 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:53.645462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:53.646304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:53.659157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:53.662501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:53.663381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:53.666831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:53.830159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3d47aca0-9d59-4fb2-82a4-17fea0c2e1cd req-754b6eea-c97a-4ac8-a521-17a204a22753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8034285b-8818-455d-9bfa-4fcdce732e33", "name": "network-vif-plugged", "status": "completed", "tag": "d721a3c3-0fae-4b0f-a281-eda5305fbea9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:53.853596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3d47aca0-9d59-4fb2-82a4-17fea0c2e1cd req-754b6eea-c97a-4ac8-a521-17a204a22753 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:53.856056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3d47aca0-9d59-4fb2-82a4-17fea0c2e1cd req-754b6eea-c97a-4ac8-a521-17a204a22753 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:53.878151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3d47aca0-9d59-4fb2-82a4-17fea0c2e1cd req-754b6eea-c97a-4ac8-a521-17a204a22753 service nova] Creating event network-vif-plugged:d721a3c3-0fae-4b0f-a281-eda5305fbea9 for instance 8034285b-8818-455d-9bfa-4fcdce732e33 on nch1-master-1 Apr 02 21:12:53.887554 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3d47aca0-9d59-4fb2-82a4-17fea0c2e1cd req-754b6eea-c97a-4ac8-a521-17a204a22753 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275838 Apr 02 21:12:53.891370 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2370/5033] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:12:53.898529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:53.901053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:53.911011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:53.932820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:53.933707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:53.935264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:54.093500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:54.108916 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-133314ac-868c-4244-a588-b500bb31c341 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.465503 Apr 02 21:12:54.124039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2664/5034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:53 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:54.225981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:54.254372 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c4bdb6c-e4bf-429f-8082-20516d270f45 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.356662 Apr 02 21:12:54.279040 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2371/5035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:53 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:55.130953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:55.131694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:55.139712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:55.140666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:55.147151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:55.155164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:55.250072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b42e54e9-c580-4f38-98f7-8ec72ff034bb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:55.251960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:55.259810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:55.260813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:55.261783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:55.262400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:55.567757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-61316f85-aefd-44b5-94c0-c38be6476501 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313036 Apr 02 21:12:55.571722 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2372/5036] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:12:55 2022] POST /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:12:55.580505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:55.581421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:55.594322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:55.594322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:55.594322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:55.594322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:55.594977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:55.618204 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9457a479-1ae8-4bc9-b885-aa51af17785a tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1325 microversion: 2.1 time: 0.492531 Apr 02 21:12:55.619173 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2665/5037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:55 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:56.329090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:56.363723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47d49964-063f-4659-a57f-304d18f19853 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.788035 Apr 02 21:12:56.364768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2373/5038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:55 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:56.649952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:56.653841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:56.668968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:56.669819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:56.670850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:56.671552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:56.978451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:56.988879 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff561355-7fcc-4342-9a1c-aceed1f6d3b5 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1522 microversion: 2.1 time: 0.350507 Apr 02 21:12:56.990092 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2666/5039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:56 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:57.012117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:57.013174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:57.021553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.022533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.023527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.024363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.096317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] HTTP exception thrown: Instance is not a member of specified network Apr 02 21:12:57.099684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Returning 404 to user: Instance is not a member of specified network {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:12:57.100667 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-621210ed-d4b2-4c20-904e-89e84dc27583 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.093486 Apr 02 21:12:57.101560 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2374/5040] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Apr 2 21:12:57 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33/ips/invalid => generated 91 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:12:57.111589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ded4fd52-d4fa-4367-8a05-3471740a381d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:57.112156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ded4fd52-d4fa-4367-8a05-3471740a381d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Failed to fetch instance by id 999 {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 02 21:12:57.113066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ded4fd52-d4fa-4367-8a05-3471740a381d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] HTTP exception thrown: Instance 999 could not be found. Apr 02 21:12:57.113623 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ded4fd52-d4fa-4367-8a05-3471740a381d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Returning 404 to user: Instance 999 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:12:57.114505 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ded4fd52-d4fa-4367-8a05-3471740a381d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007637 Apr 02 21:12:57.115131 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2667/5041] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 21:12:57 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:12:57.125283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:57.125813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:57.137370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.138268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.139519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.140179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.178261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:12:57.293206 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-761adb8e-7805-47ac-ba06-6d38fee9c78d tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 204 len: 0 microversion: 2.1 time: 0.171565 Apr 02 21:12:57.295921 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2375/5042] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:12:57 2022] DELETE /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:12:57.306070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:57.306895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:57.315009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.315801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.316966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.317770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.382988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:57.383634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:57.390481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.390938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.391740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:57.392187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:57.550220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:57.559288 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0c50e727-16b0-48b0-9216-d5d3f20d8d6d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.181442 Apr 02 21:12:57.559993 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2376/5043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:57 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:57.915018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:57.927238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-14fce4d8-418a-41a2-aae9-c5c7112ae427 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1528 microversion: 2.1 time: 0.626648 Apr 02 21:12:57.928447 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2668/5044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:57 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1528 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:58.577120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:58.577730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:58.584969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:58.585619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:58.586407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:58.586844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:58.914982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:58.927036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4e815dc-8bee-4791-a93d-845e704b4be5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.354108 Apr 02 21:12:58.927716 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2377/5045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:58 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:58.946773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:58.947978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:58.967112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:58.967782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:58.968727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:58.969146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:58.971886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:12:58.973196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:58.981216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:58.982128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:58.983293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:58.983876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:59.019585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'flavor' on Instance uuid 1eae82f6-fd72-4402-ad18-75441c6d7eec {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:12:59.176985 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fecfc2e-8dcb-4374-9445-59c0c6778fe0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/action" status: 200 len: 32 microversion: 2.1 time: 0.208995 Apr 02 21:12:59.180616 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2378/5046] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:12:58 2022] POST /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:12:59.189868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:59.190719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:59.199532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:59.200095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:59.201182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:59.201785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:59.358574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:59.381714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46c5644e-1451-4ea4-9df3-93c55dd26c58 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1528 microversion: 2.1 time: 0.433021 Apr 02 21:12:59.382394 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2669/5047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:58 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:59.548947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:12:59.560126 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ff731b61-3c69-4e82-9a06-7b9c5b464d9c tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.375154 Apr 02 21:12:59.560949 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2379/5048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:59 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:12:59.946667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:12:59.949824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:12:59.960029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:59.960852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:12:59.962217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:12:59.963855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.280000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:00.289105 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b3607a0-1a1c-48e8-8f8a-840058ce775d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.346817 Apr 02 21:13:00.303097 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2670/5049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:12:59 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:00.399973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:00.401288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:00.407526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:00.408713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.409515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:00.410138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.439716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ca6f1ea4-1884-4fe7-aa1d-2c973d9c5978 req-20c33b87-a239-4dbc-ac46-2d37eb2f539c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8034285b-8818-455d-9bfa-4fcdce732e33", "name": "network-vif-deleted", "tag": "d721a3c3-0fae-4b0f-a281-eda5305fbea9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:00.451322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:00.451794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.452260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lazy-loading 'fault' on Instance uuid 8034285b-8818-455d-9bfa-4fcdce732e33 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:13:00.459632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ca6f1ea4-1884-4fe7-aa1d-2c973d9c5978 req-20c33b87-a239-4dbc-ac46-2d37eb2f539c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:00.460092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ca6f1ea4-1884-4fe7-aa1d-2c973d9c5978 req-20c33b87-a239-4dbc-ac46-2d37eb2f539c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.473182 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ca6f1ea4-1884-4fe7-aa1d-2c973d9c5978 req-20c33b87-a239-4dbc-ac46-2d37eb2f539c service nova] Creating event network-vif-deleted:d721a3c3-0fae-4b0f-a281-eda5305fbea9 for instance 8034285b-8818-455d-9bfa-4fcdce732e33 on nch1-master-1 Apr 02 21:13:00.479880 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ca6f1ea4-1884-4fe7-aa1d-2c973d9c5978 req-20c33b87-a239-4dbc-ac46-2d37eb2f539c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255900 Apr 02 21:13:00.480537 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2380/5050] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:00.499307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1e4a58cbc274f5ab842d28c45d185c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33cdd8617965489c859587b4034347ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:00.506658 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df2bcbeb-6dfa-475b-86d1-f22560ec4959 tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 200 len: 1315 microversion: 2.1 time: 0.111174 Apr 02 21:13:00.510917 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2671/5051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:00 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 1315 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:00.579028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:00.579764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:00.592800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:00.593380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.595006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:00.595563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:00.858780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:00.872865 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ca7cf5ab-7e86-4c7b-8e04-f43d84ca2190 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.298004 Apr 02 21:13:00.882192 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2381/5052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:00 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:01.311142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:01.311652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:01.325693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:01.326224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:01.327131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:01.327586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:01.524997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:01.526239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] [instance: 8034285b-8818-455d-9bfa-4fcdce732e33] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:01.536622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:01.537319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:01.538271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:01.538883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:01.554990 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] HTTP exception thrown: Instance 8034285b-8818-455d-9bfa-4fcdce732e33 could not be found. Apr 02 21:13:01.557841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] Returning 404 to user: Instance 8034285b-8818-455d-9bfa-4fcdce732e33 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:01.559072 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a96e7a76-ebb7-49f9-bb1e-5dfe7162853b tempest-ServerAddressesNegativeTestJSON-1848170103 tempest-ServerAddressesNegativeTestJSON-1848170103-project] 10.222.0.18 "GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33" status: 404 len: 111 microversion: 2.1 time: 0.038075 Apr 02 21:13:01.560177 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2382/5053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:01 2022] GET /compute/v2.1/servers/8034285b-8818-455d-9bfa-4fcdce732e33 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:13:01.598195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:01.610613 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2307119-ea15-4f73-8908-7913e08d7b14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.306028 Apr 02 21:13:01.611880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2672/5054] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:01 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:01.903496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:01.904343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:01.918602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:01.919099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:01.925662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:01.926135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:02.099108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:02.108010 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78fd92fe-e424-434d-8eb3-902804fcf0b8 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.208708 Apr 02 21:13:02.117979 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2383/5055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:01 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:02.639310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:02.641963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:02.655511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:02.656391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:02.658283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:02.658930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:02.855806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:02.864592 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2798911-e94d-4960-87fe-ce259164113f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.235870 Apr 02 21:13:02.865521 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2673/5056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:02 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:03.125322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:03.125938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:03.133059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:03.133518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:03.134298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:03.136052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:03.368323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:03.382100 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-adbc9715-9859-4ff2-87c9-e852f44dd7ac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.258986 Apr 02 21:13:03.384307 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2384/5057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:03 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:03.884918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:03.886295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:03.894524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:03.894883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:03.896031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:03.896498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:04.062200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:04.071557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b242574-8fd9-43dc-9e91-6a57090deb86 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.191420 Apr 02 21:13:04.076493 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2674/5058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:03 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:04.402903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:04.403621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:04.417292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:04.417676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:04.418725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:04.420209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:04.756922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:04.765878 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5042a7b-003d-4473-8b2d-21d1bb201695 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.367212 Apr 02 21:13:04.766465 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2385/5059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:04 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:05.093631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:05.095200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:05.111834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:05.113738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:05.117962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:05.118464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:05.446911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-20708076", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b3677f49-5196-46ea-bd88-ff0550ed137f"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:05.470474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:05.496426 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-649deaa5-27ce-4cbc-ba8e-ca49889a19a8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.409472 Apr 02 21:13:05.500298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2675/5060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:05 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:05.529603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] validate_networks() for [('b3677f49-5196-46ea-bd88-ff0550ed137f', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:13:05.783600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:05.784213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:05.791780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:05.792587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:05.794078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:05.794797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:06.044138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:06.053789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b64d3920-3d19-4822-a1d4-ca9737aed094 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.274492 Apr 02 21:13:06.058567 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2676/5061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:05 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:06.075332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:13:06.076402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:13:06.077317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:13:06.077892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:13:06.079403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:13:06.091967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:06.092814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:06.093689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:06.094453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:06.116169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Getting quotas for project dfe4735870c44412b279a096ae5dd79c. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:13:06.122702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Getting quotas for user b630191a1dd14563a904c81c462bb800 and project dfe4735870c44412b279a096ae5dd79c. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:13:06.137265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:13:06.140649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:13:06.209135 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0448648-7a41-4484-8469-75215393a2fa tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956724 Apr 02 21:13:06.209977 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2386/5062] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:13:06.220835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d2767ae-d5c6-4377-9c25-5bba5b9f3168 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:06.221443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d2767ae-d5c6-4377-9c25-5bba5b9f3168 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:06.359036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d2767ae-d5c6-4377-9c25-5bba5b9f3168 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:06.369507 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d2767ae-d5c6-4377-9c25-5bba5b9f3168 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1222 microversion: 2.1 time: 0.151940 Apr 02 21:13:06.375995 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2677/5063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:06 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:06.518785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:06.519565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:06.555806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:06.557545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:06.564285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:06.566277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:06.893011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:06.907891 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-196af48d-90a2-4f72-a2cd-c40809fdbfee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.393423 Apr 02 21:13:06.911361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2387/5064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:06 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:07.075548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:07.076173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:07.084159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:07.087056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:07.097070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:07.100337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:07.392620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:07.393774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:07.400593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:07.401694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:07.402720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:07.403870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:07.540380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:07.549562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44bb530b-0161-4889-b710-e92fd8dec7ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1274 microversion: 2.1 time: 0.160820 Apr 02 21:13:07.550767 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2388/5065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:07 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:07.696310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:07.711514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9e47b2c7-e1d9-4ebc-bc09-4665e186e3a5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.640514 Apr 02 21:13:07.713546 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2678/5066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:07 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:07.925454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:07.926790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:07.934117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:07.934845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:07.935804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:07.936787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:08.398253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:08.434052 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd96a20d-43f2-4686-82ff-01a48f2dcac7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1511 microversion: 2.1 time: 0.512381 Apr 02 21:13:08.434751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2389/5067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:07 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:08.568545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:08.569355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:08.592156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:08.597086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:08.598084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:08.599745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:08.731743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:08.733730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:08.761716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:08.764503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:08.769105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:08.771237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:08.775309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:08.789121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d94a85c-1244-469b-a5b1-3ec72e267c42 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1280 microversion: 2.1 time: 0.223257 Apr 02 21:13:08.790362 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2679/5068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:08 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1280 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:09.335272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:09.344620 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86a92643-d02d-4d92-81a1-1e27c04c616f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.619381 Apr 02 21:13:09.345797 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2390/5069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:08 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:09.451846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:09.452512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:09.459788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.460506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.461544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.461991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.705726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:09.723318 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7c10e3f-3620-486f-9877-b98efae88438 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1488 microversion: 2.1 time: 0.275593 Apr 02 21:13:09.724039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2680/5070] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:09 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:09.742819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:09.745249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:09.755538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.756517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.757896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.758868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.808822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:09.810337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:09.817606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.818486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.819531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.820202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.835757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ba102d1-6259-4bfb-b319-6933ed86f3d4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 200 len: 143 microversion: 2.1 time: 0.096364 Apr 02 21:13:09.836873 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2391/5071] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:09 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 143 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:09.860845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:09.861785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:09.870085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.870548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:09.871607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:09.872211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.099958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:10.109982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1db8dd8c-ea56-4ce2-b26c-766f83abf682 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.306612 Apr 02 21:13:10.111781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2681/5072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:09 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:10.365953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:10.366748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:10.375079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.375696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.376785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.377407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.412714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:10.425517 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-786e561e-9d36-45d2-b6a9-622d10d31bf2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.582718 Apr 02 21:13:10.426233 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2392/5073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:09 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:10.452790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:10.453487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:10.464344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.464909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.466002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.467059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.627340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:10.636594 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-422d375c-5977-462f-9a58-f7c7fd2c5ced tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.277127 Apr 02 21:13:10.637187 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2682/5074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:10 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:10.747805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:10.758161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ccf12b69-f067-4981-8e61-db2345229b66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.311718 Apr 02 21:13:10.758839 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2393/5075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:10 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:10.777784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:10.778510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:10.785552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.785552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.786424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.786990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.967835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f7435545-1924-4bcd-a7ed-60dbdfe8e4fd req-47e233ba-e088-464f-9bff-8faacb9e8801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b181dd-e0a0-4b71-ab71-ea0297997c1a", "tag": "2689ee12-a017-4d74-b99a-2fea30a76fa5"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:10.977111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7435545-1924-4bcd-a7ed-60dbdfe8e4fd req-47e233ba-e088-464f-9bff-8faacb9e8801 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:10.977955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7435545-1924-4bcd-a7ed-60dbdfe8e4fd req-47e233ba-e088-464f-9bff-8faacb9e8801 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:10.989725 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f7435545-1924-4bcd-a7ed-60dbdfe8e4fd req-47e233ba-e088-464f-9bff-8faacb9e8801 service nova] Creating event network-changed:2689ee12-a017-4d74-b99a-2fea30a76fa5 for instance b0b181dd-e0a0-4b71-ab71-ea0297997c1a on nch1-master-1 Apr 02 21:13:10.995350 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f7435545-1924-4bcd-a7ed-60dbdfe8e4fd req-47e233ba-e088-464f-9bff-8faacb9e8801 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127359 Apr 02 21:13:10.996129 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2394/5076] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:11.128869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:11.129890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:11.139523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:11.141322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:11.143721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:11.144381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:11.191281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:11.201913 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2f2d116-78cd-42ce-984d-bd0c3c5eb4f9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.428619 Apr 02 21:13:11.203556 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2683/5077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:10 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:11.229606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:11.230602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:11.243291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:11.244690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:11.245592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:11.246389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:11.517179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:11.524937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-26ee7ca9-0933-4cc1-92c3-ee76c92378c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.305769 Apr 02 21:13:11.525521 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2684/5078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:11 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:11.670764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:11.671403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:11.679859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:11.680322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:11.686131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:11.689102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:11.689973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:11.705497 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be50f14c-3cd5-45ef-ae97-1c9a693955c9 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.581979 Apr 02 21:13:11.706817 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2395/5079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:11 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:11.714915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-645116197", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "31fced4c-1a00-48a4-a6cd-17c45563c707"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:11.923327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] validate_networks() for [('31fced4c-1a00-48a4-a6cd-17c45563c707', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:13:12.035311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:12.046989 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-175da78a-9ed4-4ab9-bb1f-d0bb50086549 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.394844 Apr 02 21:13:12.048102 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2685/5080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:11 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:12.725205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:12.725949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:12.742956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:12.744307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:12.745210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:12.745836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:12.794645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:13:12.795073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:13:12.795679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:13:12.795949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:13:12.796381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:13:12.813658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:12.814058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:12.814864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:12.816380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:12.837615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:13:12.844871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:13:12.871875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:13:12.875094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:13:12.942178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:12.949807 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ebd3bc5-1ae7-443b-8469-794fcabc478f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.228466 Apr 02 21:13:12.951252 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2686/5081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:12 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:12.963068 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ccb41bb1-a970-47bc-915e-e8493faf6536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254948 Apr 02 21:13:12.964285 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2396/5082] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:13:12.974337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abfcf19c-d523-42c0-8e54-aee68b5fdf23 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:12.975196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abfcf19c-d523-42c0-8e54-aee68b5fdf23 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:13.067910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:13.069363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:13.070437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abfcf19c-d523-42c0-8e54-aee68b5fdf23 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:13.078767 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abfcf19c-d523-42c0-8e54-aee68b5fdf23 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1214 microversion: 2.1 time: 0.108205 Apr 02 21:13:13.079633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:13.080397 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2687/5083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:12 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:13.091685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:13.093020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:13.093963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:13.386691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:13.398242 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5aafd47c-6d0a-4ad9-a5a9-138004ac74dd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.336169 Apr 02 21:13:13.398844 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2397/5084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:13 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:13.967457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:13.968067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:13.980659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:13.981136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:13.982116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:13.982560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:14.100291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:14.102816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:14.111962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:14.113342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:14.114165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:14.114626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:14.160964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:14.175643 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c194ea79-c800-40e8-ae43-fa648030c416 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.212028 Apr 02 21:13:14.185728 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2688/5085] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:13 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:14.193218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:14.201472 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd3947ea-0504-4854-9277-933c7b99a28d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1266 microversion: 2.1 time: 0.106289 Apr 02 21:13:14.202135 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2398/5086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:14 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:14.417077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:14.417809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:14.428398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:14.429692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:14.435084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:14.435739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:14.764846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:14.787848 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-579dda75-f9af-4226-9132-0ca17a4e81cb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.375289 Apr 02 21:13:14.801414 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2689/5087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:14 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:15.194521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:15.195714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:15.221266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:15.221902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:15.223380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:15.225038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:15.227332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:15.229983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:15.247056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:15.248706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:15.250283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:15.252380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:15.376752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:15.404498 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6134f559-6a5a-486f-83ae-dedcafa9473f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1272 microversion: 2.1 time: 0.185103 Apr 02 21:13:15.417277 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2690/5088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:15 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:15.624341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:15.634668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d8bc4478-326e-451c-aa4e-e1e733ff37ba tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.444308 Apr 02 21:13:15.635349 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2399/5089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:15 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:15.810481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:15.811148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:15.822338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:15.822805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:15.827503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:15.828754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:16.353413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:16.363448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fee922b0-4b61-4615-9b00-d3bc3af27dfb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.561589 Apr 02 21:13:16.373943 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2691/5090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:15 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:16.423378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:16.424043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:16.434043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:16.434505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:16.441139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:16.441871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:16.665475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:16.670637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:16.695167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:16.697019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:16.700722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:16.701199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:16.873753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:16.887132 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b61a8aa6-19b3-4d7a-9ac9-85debfa88e73 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.466972 Apr 02 21:13:16.905675 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2400/5091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:16 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:16.982804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-24a088f8-d9b6-4e00-82ca-32d34e3aa807 req-07f020ca-9d58-412b-86bc-4fab74973309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adbbd4b-aefc-49b8-a3c2-2351473c3d84", "tag": "2843b7a2-9385-4edc-aafb-6c4f41566ea0"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:17.008639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-24a088f8-d9b6-4e00-82ca-32d34e3aa807 req-07f020ca-9d58-412b-86bc-4fab74973309 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:17.023864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:17.037765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-24a088f8-d9b6-4e00-82ca-32d34e3aa807 req-07f020ca-9d58-412b-86bc-4fab74973309 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:17.043120 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18de2d81-3213-4ef6-9b50-42131af7af1e tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.389560 Apr 02 21:13:17.045022 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2692/5092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:16 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:17.064349 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-24a088f8-d9b6-4e00-82ca-32d34e3aa807 req-07f020ca-9d58-412b-86bc-4fab74973309 service nova] Creating event network-changed:2843b7a2-9385-4edc-aafb-6c4f41566ea0 for instance 1adbbd4b-aefc-49b8-a3c2-2351473c3d84 on nch2-master-1 Apr 02 21:13:17.071463 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-24a088f8-d9b6-4e00-82ca-32d34e3aa807 req-07f020ca-9d58-412b-86bc-4fab74973309 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102175 Apr 02 21:13:17.073021 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2401/5093] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:13:17.381408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:17.381994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:17.389013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:17.389480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:17.390276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:17.390841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:17.603740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:17.621957 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13d0781a-2f40-4e7a-8016-6b4c2f6a0548 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.243773 Apr 02 21:13:17.632384 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2693/5094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:17 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:17.907003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:17.907885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:17.917318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:17.917318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:17.917318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:17.917318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:18.065635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:18.069471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:18.076833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:18.084919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:18.085475 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-794ff374-1967-4c03-9a37-fcc060217d41 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.183617 Apr 02 21:13:18.085763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:18.087682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:18.088284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:18.096010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2402/5095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:17 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:18.378465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:18.388893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0f35b32-8287-4eea-96ff-51b0a20f36bd tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.331126 Apr 02 21:13:18.390409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2694/5096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:18 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:18.640639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:18.641272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:18.647339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:18.647801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:18.648814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:18.649269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:19.104270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:19.105040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:19.112275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:19.112831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:19.113641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:19.114084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:19.248921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:19.262945 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-531618b2-03ec-433a-b6d1-a61a1df70ca0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.625580 Apr 02 21:13:19.275228 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2403/5097] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:18 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:19.277264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:19.284651 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a137e512-13ac-4d1a-ab4f-27cf6a278f05 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.185479 Apr 02 21:13:19.285275 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2695/5098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:19 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:19.407226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:19.408055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:19.416906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:19.417115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:19.417937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:19.418445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:19.567425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:19.577205 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0d2c539-9cb0-478f-8b39-8c184a0ea842 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.174263 Apr 02 21:13:19.578247 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2404/5099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:19 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:19.769027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d395855c-d09d-4099-a829-483d702a705e req-c801c3c9-131d-401f-89d1-74e98507e6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b181dd-e0a0-4b71-ab71-ea0297997c1a", "name": "network-vif-plugged", "status": "completed", "tag": "2689ee12-a017-4d74-b99a-2fea30a76fa5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:19.789879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d395855c-d09d-4099-a829-483d702a705e req-c801c3c9-131d-401f-89d1-74e98507e6b6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:19.790397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d395855c-d09d-4099-a829-483d702a705e req-c801c3c9-131d-401f-89d1-74e98507e6b6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:19.811028 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d395855c-d09d-4099-a829-483d702a705e req-c801c3c9-131d-401f-89d1-74e98507e6b6 service nova] Creating event network-vif-plugged:2689ee12-a017-4d74-b99a-2fea30a76fa5 for instance b0b181dd-e0a0-4b71-ab71-ea0297997c1a on nch1-master-1 Apr 02 21:13:19.817609 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d395855c-d09d-4099-a829-483d702a705e req-c801c3c9-131d-401f-89d1-74e98507e6b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052040 Apr 02 21:13:19.819269 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2696/5100] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:20.281127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:20.281744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:20.288515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:20.288972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:20.290569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:20.290760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:20.302792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:20.303555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:20.314323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:20.314784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:20.315564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:20.316006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:20.509478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:20.520354 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ddb79a9-43ad-423c-ba23-5290d8c2530e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.243855 Apr 02 21:13:20.521766 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2405/5101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:20 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:20.598252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:20.599171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:20.606997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:20.620899 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4f63affe-8033-4045-a57e-a764756f804c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.320949 Apr 02 21:13:20.622518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2697/5102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:20 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:20.623533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:20.624252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:20.625558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:20.626250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:20.929809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:20.941528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93d5070c-1b2f-4523-9757-db35eedc211b tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1322 microversion: 2.1 time: 0.348376 Apr 02 21:13:20.948096 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2406/5103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:20 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:21.538452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:21.539730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:21.551762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:21.553364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:21.554393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:21.560116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:21.639200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:21.640066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:21.674823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:21.675205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:21.676007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:21.676464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:21.766928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:21.790322 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0d1a7d9-6972-4893-98b3-b94eb0fa6199 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.246266 Apr 02 21:13:21.790322 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2698/5104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:21 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:21.902028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:21.909832 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37062785-fc1f-44cb-a618-a4ced074ae3c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.274882 Apr 02 21:13:21.911347 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2407/5105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:21 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:21.965064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:21.965874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:21.972929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:21.974103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:21.975197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:21.975841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:22.165571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:22.175372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa5fb0e1-4ae5-4d7d-99e6-8a50475144ad tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1518 microversion: 2.1 time: 0.214751 Apr 02 21:13:22.176191 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2699/5106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:21 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:22.426997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f00af50-e39c-4cbb-8bb0-5699ed7a86e8 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1937183204", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b3677f49-5196-46ea-bd88-ff0550ed137f"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:22.428586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f00af50-e39c-4cbb-8bb0-5699ed7a86e8 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:22.429428 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f00af50-e39c-4cbb-8bb0-5699ed7a86e8 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.006418 Apr 02 21:13:22.429989 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2408/5107] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:22 2022] POST /compute/v2.1/servers => generated 175 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:13:22.442239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b15e2a44-0f5d-4a02-8118-a4c8cd867251 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:22.443577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b15e2a44-0f5d-4a02-8118-a4c8cd867251 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: 86d34744-7558-47e3-b9b4-f921fffaabe1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:22.452060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b15e2a44-0f5d-4a02-8118-a4c8cd867251 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] HTTP exception thrown: Instance 86d34744-7558-47e3-b9b4-f921fffaabe1 could not be found. Apr 02 21:13:22.453010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b15e2a44-0f5d-4a02-8118-a4c8cd867251 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 404 to user: Instance 86d34744-7558-47e3-b9b4-f921fffaabe1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:22.454085 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b15e2a44-0f5d-4a02-8118-a4c8cd867251 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/86d34744-7558-47e3-b9b4-f921fffaabe1/metadata" status: 404 len: 111 microversion: 2.1 time: 0.016372 Apr 02 21:13:22.455176 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2700/5108] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:13:22 2022] GET /compute/v2.1/servers/86d34744-7558-47e3-b9b4-f921fffaabe1/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:13:22.637304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-394558de-9b48-4186-b36c-7c5c96462b54 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1657732761", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3677f49-5196-46ea-bd88-ff0550ed137f"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:22.638885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-394558de-9b48-4186-b36c-7c5c96462b54 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:22.639973 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-394558de-9b48-4186-b36c-7c5c96462b54 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010165 Apr 02 21:13:22.641638 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2409/5109] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:22 2022] POST /compute/v2.1/servers => generated 687 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:13:22.701105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d02d9ed5-6cf4-43a4-a176-46a9318d9778 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-748536326", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3677f49-5196-46ea-bd88-ff0550ed137f"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:22.703061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d02d9ed5-6cf4-43a4-a176-46a9318d9778 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:22.703933 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d02d9ed5-6cf4-43a4-a176-46a9318d9778 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.007238 Apr 02 21:13:22.704875 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2701/5110] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:22 2022] POST /compute/v2.1/servers => generated 689 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:13:22.772771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4cd6c286-8168-4f94-a9ad-965fa8e665eb tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1215510969", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3677f49-5196-46ea-bd88-ff0550ed137f"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:22.774329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4cd6c286-8168-4f94-a9ad-965fa8e665eb tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:22.775332 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4cd6c286-8168-4f94-a9ad-965fa8e665eb tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.008997 Apr 02 21:13:22.784792 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2410/5111] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:22 2022] POST /compute/v2.1/servers => generated 1197 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Apr 02 21:13:22.815694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:22.816666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:22.831352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:22.831736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:22.835627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:22.836105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:22.930008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:22.934872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:22.952773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:22.953789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:22.956189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:22.957950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:23.151717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:23.160613 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dfee5ff8-14b8-414b-bcd2-3acca7f8edfd tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1737 microversion: 2.1 time: 0.366351 Apr 02 21:13:23.162229 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2702/5112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:22 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:23.179999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-193b8b16-49ad-41fe-b5ed-ed004fcb3dc0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1918367954", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b3677f49-5196-46ea-bd88-ff0550ed137f"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:23.182061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-193b8b16-49ad-41fe-b5ed-ed004fcb3dc0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:23.194405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-193b8b16-49ad-41fe-b5ed-ed004fcb3dc0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.009325 Apr 02 21:13:23.195321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2703/5113] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Apr 2 21:13:23 2022] POST /compute/v2.1/servers => generated 2221 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Apr 02 21:13:23.203681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:23.209986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a0fa3a18-a2a0-4aa5-af87-794e446faadf req-81ddba5e-9890-43f0-b6f6-7138cd5d20ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adbbd4b-aefc-49b8-a3c2-2351473c3d84", "name": "network-vif-plugged", "status": "completed", "tag": "2843b7a2-9385-4edc-aafb-6c4f41566ea0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:23.213141 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5da8ae3b-84d1-4834-9dea-1fcecd941046 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.289512 Apr 02 21:13:23.213765 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2411/5114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:22 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:23.218831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4cc134e-e092-46c7-8813-1671827b476f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:23.219541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4cc134e-e092-46c7-8813-1671827b476f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: e6d6163e-7794-4513-84f7-99e4d660b0c3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:23.225810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c4cc134e-e092-46c7-8813-1671827b476f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] HTTP exception thrown: Instance e6d6163e-7794-4513-84f7-99e4d660b0c3 could not be found. Apr 02 21:13:23.226622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4cc134e-e092-46c7-8813-1671827b476f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 404 to user: Instance e6d6163e-7794-4513-84f7-99e4d660b0c3 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:23.227506 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4cc134e-e092-46c7-8813-1671827b476f tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/e6d6163e-7794-4513-84f7-99e4d660b0c3/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.012457 Apr 02 21:13:23.228220 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2412/5115] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 21:13:23 2022] GET /compute/v2.1/servers/e6d6163e-7794-4513-84f7-99e4d660b0c3/metadata/test2 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:13:23.241469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a0fa3a18-a2a0-4aa5-af87-794e446faadf req-81ddba5e-9890-43f0-b6f6-7138cd5d20ff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:23.241927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a0fa3a18-a2a0-4aa5-af87-794e446faadf req-81ddba5e-9890-43f0-b6f6-7138cd5d20ff service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:23.252921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:23.254183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:23.256028 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a0fa3a18-a2a0-4aa5-af87-794e446faadf req-81ddba5e-9890-43f0-b6f6-7138cd5d20ff service nova] Creating event network-vif-plugged:2843b7a2-9385-4edc-aafb-6c4f41566ea0 for instance 1adbbd4b-aefc-49b8-a3c2-2351473c3d84 on nch2-master-1 Apr 02 21:13:23.261885 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a0fa3a18-a2a0-4aa5-af87-794e446faadf req-81ddba5e-9890-43f0-b6f6-7138cd5d20ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064417 Apr 02 21:13:23.262499 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2704/5116] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:23.263537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:23.264232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:23.265223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:23.265859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:23.324638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:13:23.468292 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a681cbbc-0ad9-4122-a1cf-26040ca787d0 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 204 len: 0 microversion: 2.1 time: 0.219415 Apr 02 21:13:23.469148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2413/5117] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:13:23 2022] DELETE /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:13:23.478638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:23.479542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:23.498801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:23.499272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:23.500063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:23.500529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.150090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:24.158590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e506b066-b9ba-45f3-8684-044b9fb9aa66 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1524 microversion: 2.1 time: 0.684880 Apr 02 21:13:24.159332 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2705/5118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:23 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1524 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:24.181971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:24.182877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:24.189793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.190692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.191481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.191924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.229880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:24.230483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:24.238982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.239548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.240582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.241040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.425047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:24.434029 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5a5823c-315c-4e6b-821f-3b5744e16b28 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1717 microversion: 2.1 time: 0.258538 Apr 02 21:13:24.434621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2414/5119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:24 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1717 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:24.559976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:24.560757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:24.567279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.568037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.569010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.569651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.588897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:24.597345 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e01dbda-4e33-4807-bc23-a64bdd51f6b1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1314 microversion: 2.1 time: 0.371688 Apr 02 21:13:24.598611 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2706/5120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:24 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:24.668028 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Cannot 'detach_volume' instance 1eae82f6-fd72-4402-ad18-75441c6d7eec while it is in vm_state rescued Apr 02 21:13:24.668679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 409 to user: Cannot 'detach_volume' instance 1eae82f6-fd72-4402-ad18-75441c6d7eec while it is in vm_state rescued {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:24.669538 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-359aa04e-6ff0-49a6-b704-49287401eaac tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments/b42e54e9-c580-4f38-98f7-8ec72ff034bb" status: 409 len: 152 microversion: 2.1 time: 0.114821 Apr 02 21:13:24.670615 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2415/5121] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:13:24 2022] DELETE /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments/b42e54e9-c580-4f38-98f7-8ec72ff034bb => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 02 21:13:24.678893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:24.679511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:24.686168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.686629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.687409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.687849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.774026 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77d8be38-04cc-498d-9f75-dd278c921aaa tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/action" status: 202 len: 0 microversion: 2.1 time: 0.098923 Apr 02 21:13:24.775264 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2707/5122] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:24 2022] POST /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:13:24.783495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:24.784115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:24.790706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.791414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:24.792395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:24.793018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.069804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:25.089949 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c1c0fac-6c4b-4d3c-ad96-c080cdf88377 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1725 microversion: 2.1 time: 0.310319 Apr 02 21:13:25.090810 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2416/5123] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:24 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:25.178339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:25.179385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:25.196868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:25.197670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.198570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:25.200976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.573188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:25.590611 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-617db172-b36b-427d-9cb3-01fd4fd26846 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1524 microversion: 2.1 time: 0.415102 Apr 02 21:13:25.591826 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2708/5124] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:25 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1524 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:25.617096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:25.617800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:25.635626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:25.636101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.636941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:25.642801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.894892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:25.904628 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67ad32bd-aa41-4ca4-ab89-3617ae570f96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1500 microversion: 2.1 time: 0.292401 Apr 02 21:13:25.912682 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2417/5125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:25 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1500 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:25.928003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:25.929280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:25.939571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:25.940740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.941617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:25.942044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:25.997060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e2caac7-cd3a-4676-bfb9-9e30bf96725c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.070112 Apr 02 21:13:25.998240 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2709/5126] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:25 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:26.119966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e38dd0ee-e043-44c7-bcf4-60d216dc3918 req-9b2abe13-6b90-4537-a4b8-212197215752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b181dd-e0a0-4b71-ab71-ea0297997c1a", "name": "network-vif-deleted", "tag": "2689ee12-a017-4d74-b99a-2fea30a76fa5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:26.125369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:26.127054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:26.135745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e38dd0ee-e043-44c7-bcf4-60d216dc3918 req-9b2abe13-6b90-4537-a4b8-212197215752 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:26.136577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e38dd0ee-e043-44c7-bcf4-60d216dc3918 req-9b2abe13-6b90-4537-a4b8-212197215752 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:26.155762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e38dd0ee-e043-44c7-bcf4-60d216dc3918 req-9b2abe13-6b90-4537-a4b8-212197215752 service nova] Creating event network-vif-deleted:2689ee12-a017-4d74-b99a-2fea30a76fa5 for instance b0b181dd-e0a0-4b71-ab71-ea0297997c1a on nch1-master-1 Apr 02 21:13:26.161687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:26.164930 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e38dd0ee-e043-44c7-bcf4-60d216dc3918 req-9b2abe13-6b90-4537-a4b8-212197215752 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052257 Apr 02 21:13:26.166024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2710/5127] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:13:26.166830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:26.167854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:26.173729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:26.522536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:26.551065 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c8ffbc91-e6d5-41a1-9602-dca85b8bf4eb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1725 microversion: 2.1 time: 0.447021 Apr 02 21:13:26.558027 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2418/5128] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:26 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1725 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:26.610530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:26.615438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:26.641278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:26.649751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:26.652742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:26.663344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:26.755355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:26.755814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:26.756272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lazy-loading 'fault' on Instance uuid b0b181dd-e0a0-4b71-ab71-ea0297997c1a {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:13:26.875599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b630191a1dd14563a904c81c462bb800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfe4735870c44412b279a096ae5dd79c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:26.886462 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a890c2d-c99b-40d9-a331-7d38482f35f2 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 200 len: 1312 microversion: 2.1 time: 0.280867 Apr 02 21:13:26.886979 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2711/5129] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:26 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:27.009167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:27.010328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:27.018238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:27.018841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:27.019752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:27.020306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:27.064180 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-10097d46-8239-48b8-8bbc-49f2ac9d3eb1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.059558 Apr 02 21:13:27.067509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2419/5130] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:27 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:27.570251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:27.570843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:27.579836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:27.580607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:27.581641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:27.582257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:27.872649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:27.885706 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d1aabc05-34d1-4b99-9b27-0260b6f426e0 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1725 microversion: 2.1 time: 0.319020 Apr 02 21:13:27.887958 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2712/5131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:27 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:27.907520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:27.908998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] [instance: b0b181dd-e0a0-4b71-ab71-ea0297997c1a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:27.927669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:27.928206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:27.931087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:27.933630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:27.954186 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] HTTP exception thrown: Instance b0b181dd-e0a0-4b71-ab71-ea0297997c1a could not be found. Apr 02 21:13:27.954799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] Returning 404 to user: Instance b0b181dd-e0a0-4b71-ab71-ea0297997c1a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:27.955857 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8969dd1-18fb-4bac-b101-bdf1f276ee86 tempest-ServerMetadataNegativeTestJSON-1508888645 tempest-ServerMetadataNegativeTestJSON-1508888645-project] 10.222.0.18 "GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a" status: 404 len: 111 microversion: 2.1 time: 0.053771 Apr 02 21:13:27.956425 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2420/5132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:27 2022] GET /compute/v2.1/servers/b0b181dd-e0a0-4b71-ab71-ea0297997c1a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:13:28.089937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:28.089937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:28.100761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:28.104165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:28.108537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:28.109016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:28.166416 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff825acb-b992-4d00-b1af-e672c7b80cef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.089666 Apr 02 21:13:28.167600 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2713/5133] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:28 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:28.904771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:28.906284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:28.913886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:28.915681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:28.916617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:28.918213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:29.119148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:29.128305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36cf7945-794d-4320-849d-e2c2e6d54a3e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1731 microversion: 2.1 time: 0.228105 Apr 02 21:13:29.128846 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2421/5134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:28 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:29.146862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:29.147681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:29.156804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:29.157272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:29.158064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:29.158514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:29.179186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:29.180989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:29.191823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:29.192294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:29.193116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:29.193597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:29.239949 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-112d453c-5486-4eb6-b576-8138e34b56ee tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.065729 Apr 02 21:13:29.240841 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2422/5135] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:29 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:29.261204 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-929af81b-f8ac-450d-9777-1f4e482775fc tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119563 Apr 02 21:13:29.262099 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2714/5136] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:13:29 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:30.252502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:30.256391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:30.273361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:30.275890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:30.280098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:30.283480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:30.337480 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d4ad503-639e-4e6f-bd38-5adb00dfe00f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.088988 Apr 02 21:13:30.342191 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2423/5137] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:30 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:30.599936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8e4ddf2-5f9d-4bb5-8493-8be40df85293 tempest-ExtensionsTest-12638271 tempest-ExtensionsTest-12638271-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:30.601972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a8e4ddf2-5f9d-4bb5-8493-8be40df85293 tempest-ExtensionsTest-12638271 tempest-ExtensionsTest-12638271-project] 10.222.0.18 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.190169 Apr 02 21:13:30.602872 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2715/5138] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 21:13:30 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:30.618197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e7c1d080-ab82-4108-8ac0-f6f39d0d329b tempest-ExtensionsTest-12638271 tempest-ExtensionsTest-12638271-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:30.624706 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e7c1d080-ab82-4108-8ac0-f6f39d0d329b tempest-ExtensionsTest-12638271 tempest-ExtensionsTest-12638271-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012587 Apr 02 21:13:30.626095 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2424/5139] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 21:13:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:13:31.272742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-782057fe-dffa-4b78-ba58-d9906e884c07 req-fb237322-ddeb-4606-9235-f8ebf2e60b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eae82f6-fd72-4402-ad18-75441c6d7eec", "tag": "f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:31.300920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-782057fe-dffa-4b78-ba58-d9906e884c07 req-fb237322-ddeb-4606-9235-f8ebf2e60b66 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:31.305012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-782057fe-dffa-4b78-ba58-d9906e884c07 req-fb237322-ddeb-4606-9235-f8ebf2e60b66 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:31.333968 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-782057fe-dffa-4b78-ba58-d9906e884c07 req-fb237322-ddeb-4606-9235-f8ebf2e60b66 service nova] Creating event network-changed:f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3 for instance 1eae82f6-fd72-4402-ad18-75441c6d7eec on nch1-master-1 Apr 02 21:13:31.349619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:31.351813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:31.359867 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-782057fe-dffa-4b78-ba58-d9906e884c07 req-fb237322-ddeb-4606-9235-f8ebf2e60b66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092655 Apr 02 21:13:31.368680 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2716/5140] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:31.378938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:31.382162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:31.384222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:31.386006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:31.443344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b663c92a-e1d8-4a45-8eea-e7777b17cf51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.098989 Apr 02 21:13:31.447010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2425/5141] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:31 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:13:32.465351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:32.467205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:32.476032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:32.476768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:32.478632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:32.479344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:32.539276 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4170ce0c-878d-4cec-9c76-a91c9a6a6145 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.080666 Apr 02 21:13:32.540864 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2717/5142] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:32 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:33.383651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-cfdafd82-9487-4961-a001-679ce87fc80b req-ce8ad464-99a9-4031-85e3-0c86e235f36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eae82f6-fd72-4402-ad18-75441c6d7eec", "tag": "f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:33.396365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cfdafd82-9487-4961-a001-679ce87fc80b req-ce8ad464-99a9-4031-85e3-0c86e235f36f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:33.397099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cfdafd82-9487-4961-a001-679ce87fc80b req-ce8ad464-99a9-4031-85e3-0c86e235f36f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:33.416290 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-cfdafd82-9487-4961-a001-679ce87fc80b req-ce8ad464-99a9-4031-85e3-0c86e235f36f service nova] Creating event network-changed:f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3 for instance 1eae82f6-fd72-4402-ad18-75441c6d7eec on nch1-master-1 Apr 02 21:13:33.422091 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-cfdafd82-9487-4961-a001-679ce87fc80b req-ce8ad464-99a9-4031-85e3-0c86e235f36f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044104 Apr 02 21:13:33.423780 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2718/5143] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:13:33.434957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11c81ce3-cc76-4403-b614-2658acbf21ac tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Action: 'create', calling method: .version_select at 0x7f54c7f0f430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1080756692", "metadata": {"Type": "work"}}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:33.552789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:33.555271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:33.570564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:33.573476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:33.576111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:33.576950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:33.650848 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b23d546-2165-40a7-83ad-f5b65902b91c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.102858 Apr 02 21:13:33.654054 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2719/5144] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:33 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 02 21:13:33.963013 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11c81ce3-cc76-4403-b614-2658acbf21ac tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.689639 Apr 02 21:13:33.971829 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2426/5145] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Apr 2 21:13:33 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 02 21:13:33.977217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08410322-745e-4a54-bf2c-a8345f8d0a18 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Calling method '.version_select at 0x7f54c7d4a550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:34.063130 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08410322-745e-4a54-bf2c-a8345f8d0a18 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00" status: 200 len: 346 microversion: 2.1 time: 0.090539 Apr 02 21:13:34.063874 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2720/5146] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:13:33 2022] GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00 => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:13:34.665469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:34.668266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:34.705069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:34.705535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:34.706335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:34.706796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:34.791889 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb9de6d6-897c-48a7-a7bc-25aa80824c14 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.131466 Apr 02 21:13:34.792826 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2427/5147] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:34 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:35.076733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08d5c93b-bd36-4304-973d-3d029e36a4c0 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Calling method '.version_select at 0x7f54d4d18d30>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:35.140894 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08d5c93b-bd36-4304-973d-3d029e36a4c0 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00" status: 200 len: 347 microversion: 2.1 time: 0.068581 Apr 02 21:13:35.141956 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2721/5148] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:13:35 2022] GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00 => generated 347 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:35.153937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6547be96-fa12-47ca-b0a0-18947695088c tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Calling method '.version_select at 0x7f54d4d7c310>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:35.208815 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6547be96-fa12-47ca-b0a0-18947695088c tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00" status: 200 len: 347 microversion: 2.1 time: 0.059492 Apr 02 21:13:35.209571 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2428/5149] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:13:35 2022] GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00 => generated 347 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:35.225889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e540b28f-bfcb-494c-ab59-afbeebd89617 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Calling method '.version_select at 0x7f54d496caf0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:35.311652 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e540b28f-bfcb-494c-ab59-afbeebd89617 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00" status: 202 len: 0 microversion: 2.1 time: 0.091512 Apr 02 21:13:35.312952 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2722/5150] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Apr 2 21:13:35 2022] DELETE /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:13:35.323223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-05e0107b-e90d-43b2-a372-3ea70d8a8009 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Calling method '.version_select at 0x7f54c7e79b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:35.441903 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-05e0107b-e90d-43b2-a372-3ea70d8a8009 tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00" status: 200 len: 346 microversion: 2.1 time: 0.108836 Apr 02 21:13:35.442824 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2429/5151] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:13:35 2022] GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00 => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:35.804783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:35.806021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:35.833448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:35.833882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:35.834791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:35.835246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:35.897510 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e279c4f4-f6c8-44ea-aa1a-6c6973bb56a6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.098030 Apr 02 21:13:35.900720 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2723/5152] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:35 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:36.462270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5937ab-ac29-456f-8f17-478ad5e869bf tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Calling method '.version_select at 0x7f54d4d7c8b0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:36.505371 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8b5937ab-ac29-456f-8f17-478ad5e869bf tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] HTTP exception thrown: Volume 6c8a309c-75cb-46df-bf99-a3214cd86e00 could not be found. Apr 02 21:13:36.506003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5937ab-ac29-456f-8f17-478ad5e869bf tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] Returning 404 to user: Volume 6c8a309c-75cb-46df-bf99-a3214cd86e00 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:36.506981 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b5937ab-ac29-456f-8f17-478ad5e869bf tempest-VolumesGetTestJSON-2091516914 tempest-VolumesGetTestJSON-2091516914-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00" status: 404 len: 109 microversion: 2.1 time: 0.055822 Apr 02 21:13:36.511336 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2430/5153] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:13:36 2022] GET /compute/v2.1/os-volumes/6c8a309c-75cb-46df-bf99-a3214cd86e00 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:13:36.912847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:36.915094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:36.923381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:36.924064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:36.925216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:36.926042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:36.996367 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d6c9232-2995-4478-8771-f17c1a4f611e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 14 microversion: 2.1 time: 0.088847 Apr 02 21:13:36.998300 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2724/5154] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:36 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:13:37.600029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1347394830", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:37.692197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] validate_networks() for None {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:13:38.010003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:38.011044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:38.036306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.036764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.037583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.040056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.125127 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca44356f-c393-4761-a171-1afea1f50683 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action" status: 200 len: 8207 microversion: 2.1 time: 0.120525 Apr 02 21:13:38.126180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2725/5155] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:38 2022] POST /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84/action => generated 8207 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:38.137865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:38.138585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:38.155350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.155942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.158422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.158883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.255149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:13:38.255589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:13:38.256225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:13:38.256681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:13:38.257103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:13:38.270902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.271785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.272855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.273458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.300148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Getting quotas for project 3265dbc2dbab442dbb562ef4a3652650. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:13:38.314997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Getting quotas for user b80790d4e9484dfd92f9ad7e840637c3 and project 3265dbc2dbab442dbb562ef4a3652650. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:13:38.332062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:13:38.335147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:13:38.391971 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-168c79bc-cf58-4099-9216-ddb412c466ca tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799399 Apr 02 21:13:38.399653 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2431/5156] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:13:38.406033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb73d521-b4d6-41b8-98d5-66ba3d7d1cd5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:38.406877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb73d521-b4d6-41b8-98d5-66ba3d7d1cd5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:38.539731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb73d521-b4d6-41b8-98d5-66ba3d7d1cd5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:38.549146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb73d521-b4d6-41b8-98d5-66ba3d7d1cd5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1214 microversion: 2.1 time: 0.147369 Apr 02 21:13:38.561022 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2432/5157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:38 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:38.768989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:38.799391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9086c449-3d6e-4f87-95e8-a09bfc7ff1ef tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.667297 Apr 02 21:13:38.803665 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2726/5158] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:38.829056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:38.829831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:38.844431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.847962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:38.849310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:38.851015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:39.194195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:39.207274 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1fe2ecbd-1f9b-45b1-8a2c-65b0de79cb61 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.382322 Apr 02 21:13:39.221191 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2433/5159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:39.231799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:39.232439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:39.247239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:39.248226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:39.252628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:39.253474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:39.567241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:39.567866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:39.586991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:39.591472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:39.592566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:39.593207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:39.692325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:39.701478 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2a482f83-3157-49c0-9e6b-7db5409f4db1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.474380 Apr 02 21:13:39.704348 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2727/5160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:39 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:39.720290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:39.721080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:39.721258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:39.730177 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-162796e0-e2ac-4c72-ac18-9fe4c649f31b tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1210 microversion: 2.1 time: 0.166822 Apr 02 21:13:39.731307 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2434/5161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:39 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:39.743773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:39.744359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:39.745645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:39.746291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.152190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:40.180199 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19c27a5a-80e0-4f22-9b03-d1cf4069498a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.445014 Apr 02 21:13:40.182781 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2728/5162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:39 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:40.201371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:40.204192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:40.216822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:40.217711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.220094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:40.220883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.281925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Locking {{(pid=136517) lock /opt/stack/nova/nova/compute/api.py:4698}} Apr 02 21:13:40.386124 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52d98920-7f5e-4af3-8ad5-ff87c767e9b3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.189797 Apr 02 21:13:40.387673 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2435/5163] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:40 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:13:40.395154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:40.396116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:40.405562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:40.405833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.407802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:40.408855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.747477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:40.748089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:40.755332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:40.756037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.757067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:40.757700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:40.831789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:40.840760 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41c77f04-b57c-42f1-aede-d7db30974f27 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1272 microversion: 2.1 time: 0.097032 Apr 02 21:13:40.843177 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2436/5164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:40 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:41.364988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:41.376879 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e455a3cb-71d2-4d06-b7cf-4839494fba96 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.983696 Apr 02 21:13:41.388518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2729/5165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:40 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:41.393701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a6c34d8-45f5-4c7b-a994-87b087cec498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:41.401152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a6c34d8-45f5-4c7b-a994-87b087cec498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.401957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a6c34d8-45f5-4c7b-a994-87b087cec498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.430952 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3a6c34d8-45f5-4c7b-a994-87b087cec498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] HTTP exception thrown: Instance 0a31e29c-ab4b-4383-a315-70c35db9708c is locked Apr 02 21:13:41.431870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a6c34d8-45f5-4c7b-a994-87b087cec498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Returning 409 to user: Instance 0a31e29c-ab4b-4383-a315-70c35db9708c is locked {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:13:41.433007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a6c34d8-45f5-4c7b-a994-87b087cec498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 409 len: 107 microversion: 2.1 time: 0.043249 Apr 02 21:13:41.433643 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2437/5166] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:41 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 107 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:13:41.444428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:41.445625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:41.459440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.459784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.460658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.461155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.518697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Unlocking {{(pid=136518) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 02 21:13:41.590025 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f113253d-5083-458c-a39c-a1d328c9a135 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.151100 Apr 02 21:13:41.591625 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2730/5167] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:41 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:13:41.603266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-969e5116-2fb0-4721-b922-c2281088f75b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:41.611864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-969e5116-2fb0-4721-b922-c2281088f75b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.612589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-969e5116-2fb0-4721-b922-c2281088f75b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.662569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-969e5116-2fb0-4721-b922-c2281088f75b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Going to try to stop instance {{(pid=136517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:13:41.760751 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-969e5116-2fb0-4721-b922-c2281088f75b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.164159 Apr 02 21:13:41.765223 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2438/5168] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:41 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:13:41.784783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:41.786115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:41.800385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.801486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.802972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.803916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.859734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:41.861154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:41.890356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.893212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:41.895686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:41.896295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:42.003322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:42.017345 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04707c69-b152-495a-89a0-811b82ef71f4 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1272 microversion: 2.1 time: 0.161746 Apr 02 21:13:42.020879 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2439/5169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:41 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:42.335532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:42.352535 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87a551ac-dfd4-44c4-b8e8-bcf1bcf215d9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.585430 Apr 02 21:13:42.357103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2731/5170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:41 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:43.036819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:43.037677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:43.056969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:43.058265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:43.059238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:43.063816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:43.374678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:43.375449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:43.385453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:43.386212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:43.387932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:43.388804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:43.392810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:43.406481 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-29c87199-f334-4c82-bb97-3d0ee998430c tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.373307 Apr 02 21:13:43.407270 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2440/5171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:43 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:43.855702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:43.864518 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f83f258-5cc5-4bfa-bb86-8752be85cc15 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.494450 Apr 02 21:13:43.865718 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2732/5172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:43 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:44.425751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:44.428993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:44.440226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8a5b99af-52b6-4ad9-88d4-f4554e0f8fd0 req-7004a27e-b9f2-4440-a33d-2776b819ddba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1770310-bb84-4579-93de-8db177867c72", "tag": "6587fb80-2925-40bd-9aef-8ccf7c17008c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:44.475557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:44.483015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:44.486130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:44.491669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:44.495580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8a5b99af-52b6-4ad9-88d4-f4554e0f8fd0 req-7004a27e-b9f2-4440-a33d-2776b819ddba service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:44.497630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8a5b99af-52b6-4ad9-88d4-f4554e0f8fd0 req-7004a27e-b9f2-4440-a33d-2776b819ddba service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:44.532197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8a5b99af-52b6-4ad9-88d4-f4554e0f8fd0 req-7004a27e-b9f2-4440-a33d-2776b819ddba service nova] Creating event network-changed:6587fb80-2925-40bd-9aef-8ccf7c17008c for instance e1770310-bb84-4579-93de-8db177867c72 on nch1-master-1 Apr 02 21:13:44.546001 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8a5b99af-52b6-4ad9-88d4-f4554e0f8fd0 req-7004a27e-b9f2-4440-a33d-2776b819ddba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108314 Apr 02 21:13:44.548224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2733/5173] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:44.884364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:44.885350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:44.895178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:44.901661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:44.902022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:44.902479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:45.058315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:45.067373 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b0f4207-a4d1-48a9-98b1-b21d10c5b2b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.646673 Apr 02 21:13:45.071556 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2441/5174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:44 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:45.199478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:45.210709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c58eae9-366f-4460-bda9-3c88589b2b51 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.331616 Apr 02 21:13:45.213250 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2734/5175] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:44 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:46.088604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:46.089222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:46.099175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:46.102506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:46.104100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:46.106458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:46.232325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:46.233520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:46.245558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:46.248130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:46.250848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:46.260340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:46.433027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:46.448321 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44489880-4c4c-4ee2-90a4-cb341a810236 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.364719 Apr 02 21:13:46.449648 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2442/5176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:46 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:46.684684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:46.694105 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-545508a1-84a4-4c6f-9f6d-916ae022e469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.467845 Apr 02 21:13:46.700168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2735/5177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:46 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:47.469895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:47.470516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:47.478916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:47.479370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:47.480569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:47.481364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:47.720921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:47.722237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:47.732339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:47.733069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:47.734881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:47.735546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:47.755232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:47.765498 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5b980eb-b809-449c-a717-4705120ca51f tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.302564 Apr 02 21:13:47.766042 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2443/5178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:47 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:47.911165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:47.920581 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ecdce28-6c97-4f95-b614-77f58fd6c7cd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.206488 Apr 02 21:13:47.921741 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2736/5179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:47 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:48.785314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:48.786400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:48.800972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:48.801527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:48.802390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:48.802901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:48.938729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:48.940132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:48.953838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:48.954566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:48.955523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:48.957190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:49.052237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:49.065660 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ff4e96b5-35b8-4b7b-99da-86ae48be3793 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.285380 Apr 02 21:13:49.078248 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2444/5180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:48 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:49.587773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:49.595317 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f21d6ad-92b1-41bf-83df-e208427f9963 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.660448 Apr 02 21:13:49.596023 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2737/5181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:48 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:50.085448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:50.087334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:50.103368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:50.104397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:50.107228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:50.107708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:50.537657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:50.546892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df11bee4-eb77-4919-b6ae-e910375f3396 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.466049 Apr 02 21:13:50.547691 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2445/5182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:50 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:50.613951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:50.614718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:50.622583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:50.623163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:50.624162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:50.624711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:50.795676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:50.805444 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7375af30-cfb9-4159-b190-34ebcf707c91 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.194908 Apr 02 21:13:50.806731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2738/5183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:50 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:51.566499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:51.567991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:51.584842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:51.585304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:51.586742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:51.590201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:51.809446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:51.825589 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb5ba71a-4002-439e-97ab-64d671716967 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.263852 Apr 02 21:13:51.826112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:51.827334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:51.836840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:51.838935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2446/5184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:51 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:51.839523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:51.840416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:51.841116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:52.033997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:52.046561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd9b66c0-fad5-4878-92fe-a138f0bf0321 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.226796 Apr 02 21:13:52.049446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8eb66375-09cc-47bb-aa10-c300553e2a78 req-6dbabddb-f2d5-4137-91c0-101fdf965621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1770310-bb84-4579-93de-8db177867c72", "name": "network-vif-plugged", "status": "completed", "tag": "6587fb80-2925-40bd-9aef-8ccf7c17008c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:52.057890 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2739/5185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:51 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:52.062225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8eb66375-09cc-47bb-aa10-c300553e2a78 req-6dbabddb-f2d5-4137-91c0-101fdf965621 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:52.062898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8eb66375-09cc-47bb-aa10-c300553e2a78 req-6dbabddb-f2d5-4137-91c0-101fdf965621 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:52.077492 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8eb66375-09cc-47bb-aa10-c300553e2a78 req-6dbabddb-f2d5-4137-91c0-101fdf965621 service nova] Creating event network-vif-plugged:6587fb80-2925-40bd-9aef-8ccf7c17008c for instance e1770310-bb84-4579-93de-8db177867c72 on nch1-master-1 Apr 02 21:13:52.084055 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8eb66375-09cc-47bb-aa10-c300553e2a78 req-6dbabddb-f2d5-4137-91c0-101fdf965621 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038659 Apr 02 21:13:52.085401 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2447/5186] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:13:52.844723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:52.846074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:52.856382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:52.861346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:52.862484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:52.863097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:53.068696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:53.069595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:53.077666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:53.078123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:53.079226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:53.079845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:53.127818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:53.137623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f9d39ee0-914e-4e2c-b9de-b097f37c8aec tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1314 microversion: 2.1 time: 0.296814 Apr 02 21:13:53.147701 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2740/5187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:52 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:53.350072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:53.358973 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7082edc-8db5-4ae8-b42e-94c8f46daffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1655 microversion: 2.1 time: 0.297774 Apr 02 21:13:53.359684 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2448/5188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:53 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1655 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:53.376933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6cf050ef-e1db-4877-9b24-7413dfe9e797 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:53.386797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cf050ef-e1db-4877-9b24-7413dfe9e797 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:53.387651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cf050ef-e1db-4877-9b24-7413dfe9e797 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:53.425073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6cf050ef-e1db-4877-9b24-7413dfe9e797 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Going to try to start instance {{(pid=136518) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:13:53.537246 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6cf050ef-e1db-4877-9b24-7413dfe9e797 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.164298 Apr 02 21:13:53.549044 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2741/5189] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:53 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:13:53.558638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:53.559789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:53.572026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:53.573317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:53.574332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:53.575172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:53.941549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:53.962464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ccf814e-ddbf-4994-8b6e-0a913f3f7606 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1664 microversion: 2.1 time: 0.408904 Apr 02 21:13:53.966498 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2449/5190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:53 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1664 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:54.158277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:54.159805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:54.172557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:54.173868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:54.175769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:54.178709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:54.764145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:54.773616 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1eabf447-e225-48f9-b4b7-f0130976ce08 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1462 microversion: 2.1 time: 0.620610 Apr 02 21:13:54.776182 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2742/5191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:54 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1462 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:54.794294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9269a2b6-cc9d-40b2-b86f-09d04ce54736", "device": "/dev/sdb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:54.795426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:54.807834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:54.821196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:54.822347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:54.823014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:54.982190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:54.983214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:54.996532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:55.000296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:55.001882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:55.009926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:55.281631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8751b502-b51b-44c8-9d61-30704dedcc78 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "POST /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491337 Apr 02 21:13:55.285775 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2450/5192] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:13:54 2022] POST /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:13:55.385494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:55.401240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68578d98-3a07-4f1e-8de4-28715c569236 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1664 microversion: 2.1 time: 0.425328 Apr 02 21:13:55.402204 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2743/5193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:54 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1664 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:56.420098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:56.421176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:56.457923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:56.464584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:56.466333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:56.468239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:56.794198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:56.801714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad596b66-6275-4a5d-bb91-72e0294b9c55 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.386218 Apr 02 21:13:56.809397 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2451/5194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:56 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:56.822095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:56.822862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:56.830173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:56.830715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:56.831567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:56.832079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.056598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:57.065304 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba5796b9-a1d2-4212-aeb7-3d835b4b4386 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.250044 Apr 02 21:13:57.076872 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2744/5195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:56 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:57.090899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:57.091834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:57.098391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.099138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.100412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.101145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.151355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Unlocking {{(pid=136517) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 02 21:13:57.214793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9a53e92f-933e-4004-9461-5e2c41324e3a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.127702 Apr 02 21:13:57.215922 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2452/5196] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:57 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:13:57.228885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:57.229748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:57.236664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.237209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.238069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.238743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.520610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:57.534416 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a77fc83-296d-404d-8541-7b0a720ff491 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.312596 Apr 02 21:13:57.535023 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2745/5197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:57 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:57.567219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:57.570503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:57.589387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.593391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.595384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.596765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.895572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:57.904036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09516e8c-e590-4224-b47c-ee6e2f4f8e0b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.356771 Apr 02 21:13:57.904654 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2453/5198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:57 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:57.920526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:57.921178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:57.928161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.929095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:57.929870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:57.930321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:58.163118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:58.170912 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4338ef0-52d8-4999-bf41-b0b700c47399 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.254474 Apr 02 21:13:58.171522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2746/5199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:57 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:13:58.188048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:58.188748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:58.196635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:58.197242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:58.198148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:58.198752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:58.281278 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b5545454-40cf-4d52-ada3-88dfd12e3e10 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.096984 Apr 02 21:13:58.282650 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2454/5200] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:58 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:13:58.290355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:58.290972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:58.300934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:58.303744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:58.305268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:58.310219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:58.562315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:58.570457 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b99f487-c81d-475d-9c1d-5eb83a6a7c37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1673 microversion: 2.1 time: 0.284021 Apr 02 21:13:58.571986 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2747/5201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:58 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1673 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:59.590774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:13:59.592158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:59.601935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:59.602600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:59.603718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:59.604329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:59.847846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:13:59.858538 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f02b09eb-f133-432f-910e-194a8e66979b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1653 microversion: 2.1 time: 0.274851 Apr 02 21:13:59.864614 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2455/5202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:59 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1653 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:13:59.881991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:13:59.883902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:13:59.891768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:59.892436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:59.893409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:13:59.894003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:13:59.991166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f35aa81a-d431-4777-940c-b9460809471b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.113305 Apr 02 21:13:59.996922 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2748/5203] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:13:59 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:14:00.002528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:00.002948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:00.019075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:00.026086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:00.027036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:00.027908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:00.316899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:00.350305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe390124-7122-4c53-9bfd-e181f327f226 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1660 microversion: 2.1 time: 0.343344 Apr 02 21:14:00.352381 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2456/5204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:13:59 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1660 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:01.370698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:01.371325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:01.377714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:01.378382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:01.379337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:01.379962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:02.287234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:02.299401 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29e4fee8-3394-4b3b-ab48-1505a3d2edbd tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.933664 Apr 02 21:14:02.300001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2749/5205] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:01 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:02.320261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:02.321920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:02.340203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:02.341402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:02.342651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:02.344750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:02.598682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:02.607062 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-335cabc9-1883-4606-82ba-3d303591efaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.291474 Apr 02 21:14:02.607643 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2457/5206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:02 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:02.628875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:02.630091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:02.638149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:02.638615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:02.639403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:02.640128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:02.917565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:02.928121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-119f1657-ebef-4eff-8f5f-7dd736abd320 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.305209 Apr 02 21:14:02.931452 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2750/5207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:02 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:02.951746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:02.952448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:02.960128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:02.960669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:02.961458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:02.961887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:03.216197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:03.224236 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74514d48-bce9-465b-a4b3-ece1997cec40 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.278073 Apr 02 21:14:03.228764 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2458/5208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:02 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:03.246240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:03.248428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:03.274761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:03.276228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:03.277306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:03.280331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:03.681204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:03.695568 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48b648e9-2a1d-44e1-a8da-c00f4f8e8533 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.454221 Apr 02 21:14:03.697071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2751/5209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:03 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:03.714341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:03.714970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:03.722019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:03.722488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:03.723498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:03.723920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:03.876996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:03.889256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9dcf1981-36d5-4444-8d7b-23985a6dafd1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.180070 Apr 02 21:14:03.890050 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2459/5210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:03 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:05.493873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:05.494504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:05.505335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:05.505867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:05.507459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:05.507907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:05.625912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lazy-loading 'services' on Instance uuid e1770310-bb84-4579-93de-8db177867c72 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:14:05.731128 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72/os-volume_attachments/9269a2b6-cc9d-40b2-b86f-09d04ce54736" status: 202 len: 0 microversion: 2.1 time: 0.241513 Apr 02 21:14:05.736997 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2752/5211] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:14:05 2022] DELETE /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72/os-volume_attachments/9269a2b6-cc9d-40b2-b86f-09d04ce54736 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:14:08.000253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:08.002851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:08.010701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:08.014485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:08.015302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:08.015911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:08.077250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:14:08.195097 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c6426e4-e8d2-4c88-91a7-1fea458a08cf tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 204 len: 0 microversion: 2.1 time: 0.197690 Apr 02 21:14:08.199543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2460/5212] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:14:07 2022] DELETE /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:14:08.207492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:08.208498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:08.218407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:08.219103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:08.220160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:08.221191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:08.491705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:08.508794 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4f332ae-2a07-4b30-bc99-6de61ce6058e tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1468 microversion: 2.1 time: 0.306521 Apr 02 21:14:08.510601 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2753/5213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:08 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:09.530922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:09.532134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:09.542884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:09.543344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:09.544129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:09.544767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:09.776891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:09.793221 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-473bfa94-d44e-4c5e-ae72-866b65572ec5 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1468 microversion: 2.1 time: 0.269104 Apr 02 21:14:09.794058 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2461/5214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:09 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1468 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:10.811035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:10.811647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:10.818889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:10.820314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:10.821284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:10.821880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:10.961283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80790d4e9484dfd92f9ad7e840637c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3265dbc2dbab442dbb562ef4a3652650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:10.977588 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36fc422d-4bca-4147-a704-654344c136c6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 200 len: 1426 microversion: 2.1 time: 0.170230 Apr 02 21:14:10.979101 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2754/5215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:10 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 1426 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:10.997280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8b456238-e9ad-451f-91c5-79a679082a19 req-4275537f-efc3-4611-a517-7da0abf9a697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1770310-bb84-4579-93de-8db177867c72", "name": "network-vif-deleted", "tag": "6587fb80-2925-40bd-9aef-8ccf7c17008c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:11.026208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8b456238-e9ad-451f-91c5-79a679082a19 req-4275537f-efc3-4611-a517-7da0abf9a697 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:11.028468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8b456238-e9ad-451f-91c5-79a679082a19 req-4275537f-efc3-4611-a517-7da0abf9a697 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:11.046872 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8b456238-e9ad-451f-91c5-79a679082a19 req-4275537f-efc3-4611-a517-7da0abf9a697 service nova] Creating event network-vif-deleted:6587fb80-2925-40bd-9aef-8ccf7c17008c for instance e1770310-bb84-4579-93de-8db177867c72 on nch1-master-1 Apr 02 21:14:11.054957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8b456238-e9ad-451f-91c5-79a679082a19 req-4275537f-efc3-4611-a517-7da0abf9a697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076627 Apr 02 21:14:11.061071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2462/5216] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:14:11.995921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:11.996605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] [instance: e1770310-bb84-4579-93de-8db177867c72] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:12.003643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:12.004096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:12.004913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:12.005352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:12.019550 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] HTTP exception thrown: Instance e1770310-bb84-4579-93de-8db177867c72 could not be found. Apr 02 21:14:12.020166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] Returning 404 to user: Instance e1770310-bb84-4579-93de-8db177867c72 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:12.021075 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4284a28-7bcf-4d20-a7a0-52e4c20ff5b6 tempest-VolumesBackupsTest-990025423 tempest-VolumesBackupsTest-990025423-project] 10.222.0.18 "GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72" status: 404 len: 111 microversion: 2.1 time: 0.029909 Apr 02 21:14:12.021664 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2755/5217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:11 2022] GET /compute/v2.1/servers/e1770310-bb84-4579-93de-8db177867c72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:14:25.505462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:25.507612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:25.516682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:25.517477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:25.518543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:25.524901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:25.560265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:14:25.739881 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d1b129a-21bf-421c-bddc-dc496ab68fdc tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 204 len: 0 microversion: 2.1 time: 0.687029 Apr 02 21:14:25.741066 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2463/5218] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:14:25 2022] DELETE /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:14:25.751407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:25.752145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:25.770624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:25.773546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:25.777703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:25.777703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:26.289969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:26.290477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:26.300174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:26.307875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:26.309241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:26.310373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:26.315857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:26.327254 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7650af6-9f7d-497c-b981-257f180b78ef tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1731 microversion: 2.1 time: 0.581680 Apr 02 21:14:26.346024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2756/5219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:25 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1731 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:26.561327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'services' on Instance uuid 1eae82f6-fd72-4402-ad18-75441c6d7eec {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:14:26.683794 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d98a5ad-74b8-428c-8004-63f7ff03c292 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments/b42e54e9-c580-4f38-98f7-8ec72ff034bb" status: 202 len: 0 microversion: 2.1 time: 0.398325 Apr 02 21:14:26.687839 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2464/5220] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:14:26 2022] DELETE /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments/b42e54e9-c580-4f38-98f7-8ec72ff034bb => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:14:26.696650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:26.699864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:26.719995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:26.720688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:26.721715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:26.722382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:26.774363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7ec3b4f-faa2-442d-a75d-f58195d2d93a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084535 Apr 02 21:14:26.783584 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2757/5221] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:14:26 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:14:27.353502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:27.354416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:27.364116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:27.364984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:27.366047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:27.366633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:27.676117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:27.705398 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2983d585-f910-4f82-9bc5-107cc8c88f98 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1731 microversion: 2.1 time: 0.357813 Apr 02 21:14:27.706852 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2465/5222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:27 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1731 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:27.790313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:27.791302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:27.806236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:27.806759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:27.807594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:27.808153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:27.895478 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ece0b424-e584-4237-8bb8-08f5c914755e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109153 Apr 02 21:14:27.896714 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2758/5223] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:14:27 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:14:28.056161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:28.057972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:28.078368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.081119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.082617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.085390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.132603 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Cannot 'reboot' instance 8b7840fc-ecb4-4758-b217-7e306ad61475 while it is in vm_state rescued Apr 02 21:14:28.133415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 409 to user: Cannot 'reboot' instance 8b7840fc-ecb4-4758-b217-7e306ad61475 while it is in vm_state rescued {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:28.134404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e1b8c8c-ff4e-4013-8ae0-39302ba6e0c3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475/action" status: 409 len: 145 microversion: 2.1 time: 0.083838 Apr 02 21:14:28.141289 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2466/5224] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:14:28 2022] POST /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475/action => generated 145 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:14:28.148564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:28.150873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:28.157247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.157994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.159072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.159766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.196255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Cannot 'rebuild' instance 8b7840fc-ecb4-4758-b217-7e306ad61475 while it is in vm_state rescued Apr 02 21:14:28.198563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 409 to user: Cannot 'rebuild' instance 8b7840fc-ecb4-4758-b217-7e306ad61475 while it is in vm_state rescued {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:28.200428 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-50d5ea19-da27-4d55-a8b1-31dba84dd903 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "POST /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475/action" status: 409 len: 146 microversion: 2.1 time: 0.056590 Apr 02 21:14:28.209215 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2759/5225] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:14:28 2022] POST /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475/action => generated 146 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 02 21:14:28.212679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:28.213472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:28.222192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.223033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.225823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.226497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.306715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:14:28.544965 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4141f42-2a42-4ab9-92c5-92a93d68cdf5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 204 len: 0 microversion: 2.1 time: 0.326188 Apr 02 21:14:28.545640 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2467/5226] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:14:28 2022] DELETE /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:14:28.554589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:28.555979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:28.578822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.581867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.582925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.586020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.726316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:28.727108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:28.737547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.741828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:28.742678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:28.743136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:29.244182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:29.262616 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3a2f5ac-3837-4e10-a9bd-83786805fc82 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1731 microversion: 2.1 time: 0.539352 Apr 02 21:14:29.282460 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2468/5227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:28 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1731 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:29.404106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:29.419705 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d39403a-050a-410f-8012-d1e5a776f057 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1691 microversion: 2.1 time: 0.868447 Apr 02 21:14:29.431819 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2760/5228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:28 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1691 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:30.289490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:30.291017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:30.313489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:30.317318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:30.318510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:30.320481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:30.447002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:30.448197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:30.467024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:30.467742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:30.469553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:30.470240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:30.575215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:30.588086 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-280ace66-b731-42ac-8f59-defb22b21771 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1665 microversion: 2.1 time: 0.303968 Apr 02 21:14:30.602878 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2469/5229] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:30 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1665 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:31.608982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:31.609614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:31.647970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:31.648437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:31.649288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:31.649743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:31.902694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:31.912562 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67a6622c-8ad5-42b6-b1f0-2affd69f1606 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1691 microversion: 2.1 time: 1.477129 Apr 02 21:14:31.928525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2761/5230] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:30 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1691 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:32.011654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:32.034650 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39e1d458-de24-45fe-b97c-86ac5756ad52 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1665 microversion: 2.1 time: 0.428997 Apr 02 21:14:32.044414 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2470/5231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:31 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1665 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:32.467267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3b350f14-35c2-4730-b793-ddb0228b92f3 req-21c759b5-49e8-4477-aef6-af74668e89dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c962256b-4bd5-4520-863d-008d7e17cc57", "name": "network-vif-deleted", "tag": "8276a875-ff1a-4096-8a72-2a3dd85f50d2"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:32.535458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3b350f14-35c2-4730-b793-ddb0228b92f3 req-21c759b5-49e8-4477-aef6-af74668e89dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:32.536236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3b350f14-35c2-4730-b793-ddb0228b92f3 req-21c759b5-49e8-4477-aef6-af74668e89dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:32.583818 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3b350f14-35c2-4730-b793-ddb0228b92f3 req-21c759b5-49e8-4477-aef6-af74668e89dc service nova] Creating event network-vif-deleted:8276a875-ff1a-4096-8a72-2a3dd85f50d2 for instance c962256b-4bd5-4520-863d-008d7e17cc57 on nch2-master-1 Apr 02 21:14:32.622781 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3b350f14-35c2-4730-b793-ddb0228b92f3 req-21c759b5-49e8-4477-aef6-af74668e89dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155890 Apr 02 21:14:32.624163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2762/5232] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:14:32.946091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:32.946819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:32.962767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:32.965016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:32.966006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:32.967931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:33.059993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:33.061484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:33.077257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:33.077972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:33.078934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:33.079534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:33.202941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:33.206484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:33.209823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lazy-loading 'fault' on Instance uuid c962256b-4bd5-4520-863d-008d7e17cc57 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:14:33.358157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912051f37cf84f30942319efc614fc12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e69485d6b5e4cd6ba0ffbb3b210952b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:33.368382 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d8c3fdc-e5f7-4f67-8c46-ad25fdb07669 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 200 len: 1389 microversion: 2.1 time: 0.320095 Apr 02 21:14:33.370923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2763/5233] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:33 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 1389 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:33.436017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:33.465950 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a746be4d-8ef5-45ed-a489-cc948e8d4f1f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1691 microversion: 2.1 time: 0.524646 Apr 02 21:14:33.485798 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2471/5234] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:32 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1691 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:34.423917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:34.425352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:34.466201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:34.473843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:34.474740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:34.475196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:34.549586 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] HTTP exception thrown: Instance c962256b-4bd5-4520-863d-008d7e17cc57 could not be found. Apr 02 21:14:34.551823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Returning 404 to user: Instance c962256b-4bd5-4520-863d-008d7e17cc57 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:34.554384 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dafff1f-4191-47bc-9ecb-a5d3ebd68be2 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 404 len: 111 microversion: 2.1 time: 0.168941 Apr 02 21:14:34.556495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2764/5235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:34 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:14:34.714516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:34.715790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:34.743323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:34.744695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:34.745776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:34.746448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:35.426367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:35.436447 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-87c268f9-5a85-4861-9dc0-7acf724c622e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1623 microversion: 2.1 time: 0.951436 Apr 02 21:14:35.442337 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2472/5236] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:34 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1623 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:35.674477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-eeaaa1e6-b121-4dda-bd6a-dcab0796f9e9 req-bce83b32-18ec-47c8-b22e-8c066315b841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eae82f6-fd72-4402-ad18-75441c6d7eec", "name": "network-vif-deleted", "tag": "f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:35.759805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-eeaaa1e6-b121-4dda-bd6a-dcab0796f9e9 req-bce83b32-18ec-47c8-b22e-8c066315b841 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:35.764515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-eeaaa1e6-b121-4dda-bd6a-dcab0796f9e9 req-bce83b32-18ec-47c8-b22e-8c066315b841 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:35.830583 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-eeaaa1e6-b121-4dda-bd6a-dcab0796f9e9 req-bce83b32-18ec-47c8-b22e-8c066315b841 service nova] Creating event network-vif-deleted:f84c5301-a7c9-4f7c-98b1-4cc81bde1ec3 for instance 1eae82f6-fd72-4402-ad18-75441c6d7eec on nch1-master-1 Apr 02 21:14:35.869789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-eeaaa1e6-b121-4dda-bd6a-dcab0796f9e9 req-bce83b32-18ec-47c8-b22e-8c066315b841 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197706 Apr 02 21:14:35.876134 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2765/5237] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:14:36.474250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:36.475318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:36.560793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.561743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.567921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.570724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.651259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.651731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.652481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'fault' on Instance uuid 1eae82f6-fd72-4402-ad18-75441c6d7eec {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:14:36.666075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:36.667602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:36.681864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.684817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.686323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.687039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.731278 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] HTTP exception thrown: Instance c962256b-4bd5-4520-863d-008d7e17cc57 could not be found. Apr 02 21:14:36.733190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Returning 404 to user: Instance c962256b-4bd5-4520-863d-008d7e17cc57 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:36.735412 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51f50341-c722-49d6-801f-bd8d652c7cf7 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 404 len: 111 microversion: 2.1 time: 0.075755 Apr 02 21:14:36.736562 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2766/5238] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:14:36 2022] DELETE /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:14:36.747734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:36.748869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] [instance: c962256b-4bd5-4520-863d-008d7e17cc57] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:36.757726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.759009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.760483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:36.761162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:36.782334 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] HTTP exception thrown: Instance c962256b-4bd5-4520-863d-008d7e17cc57 could not be found. Apr 02 21:14:36.784753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Returning 404 to user: Instance c962256b-4bd5-4520-863d-008d7e17cc57 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:36.786372 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d5a3b2ba-31e4-46af-b1a0-6c72afeb3427 tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57" status: 404 len: 111 microversion: 2.1 time: 0.044218 Apr 02 21:14:36.788071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2767/5239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:36 2022] GET /compute/v2.1/servers/c962256b-4bd5-4520-863d-008d7e17cc57 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:14:36.801523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:36.820931 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e7bf483-f8ad-4724-8910-0a312269943d tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 200 len: 1335 microversion: 2.1 time: 0.363097 Apr 02 21:14:36.833589 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2473/5240] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:36 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 1335 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:37.046031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:37.063471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:37.069246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:37.070002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:37.071056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:37.071706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:37.184129 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-321684d3-546a-4189-95dd-e5e13f44147e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.141767 Apr 02 21:14:37.186506 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2768/5241] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:14:37 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:14:37.198714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:37.200777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:37.205717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:37.206180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:37.206972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:37.207422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:37.491542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34e64dd1-c6b8-432d-a8d2-6c5963e1d7ac tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] Calling method '.version_select at 0x7f54c7e49b80>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:37.540892 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34e64dd1-c6b8-432d-a8d2-6c5963e1d7ac tempest-TestServerBasicOps-357366567 tempest-TestServerBasicOps-357366567-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1778237776" status: 202 len: 0 microversion: 2.1 time: 0.053817 Apr 02 21:14:37.541503 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2769/5242] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 21:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1778237776 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:14:37.841008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:37.845206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:37.845740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 1eae82f6-fd72-4402-ad18-75441c6d7eec] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:37.862223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:37.863057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:37.864193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:37.871273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:37.884620 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c866f3d9-c784-4745-97a5-170a6e42f162 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1670 microversion: 2.1 time: 0.690114 Apr 02 21:14:37.887851 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2474/5243] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:37 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1670 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:37.897253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Instance 1eae82f6-fd72-4402-ad18-75441c6d7eec could not be found. Apr 02 21:14:37.898466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 404 to user: Instance 1eae82f6-fd72-4402-ad18-75441c6d7eec could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:37.899904 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09772977-33eb-4e74-bafc-7b72383cd4a1 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec" status: 404 len: 111 microversion: 2.1 time: 0.064032 Apr 02 21:14:37.904606 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2770/5244] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:37 2022] GET /compute/v2.1/servers/1eae82f6-fd72-4402-ad18-75441c6d7eec => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:14:37.910927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a70e0fdd-36de-4bce-b50f-9071c145bdb3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '.version_select at 0x7f54d4c249d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:37.958455 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a70e0fdd-36de-4bce-b50f-9071c145bdb3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676697335" status: 202 len: 0 microversion: 2.1 time: 0.051628 Apr 02 21:14:37.965514 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2475/5245] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676697335 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:14:38.906202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:38.907721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:38.924188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:38.925409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:38.935203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:38.936845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:39.635789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:39.649691 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-41a1b6ae-b774-4962-9052-9dc998ad0adf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1670 microversion: 2.1 time: 0.749889 Apr 02 21:14:39.662967 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2771/5246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1670 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:40.671841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:40.673398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:40.695891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:40.698085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:40.701530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:40.702154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:41.311707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:41.334534 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-204e7893-5390-499b-aed7-077eac97752d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1675 microversion: 2.1 time: 0.664861 Apr 02 21:14:41.336243 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2476/5247] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:40 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1675 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:42.359455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:42.360835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:42.382362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:42.382821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:42.384371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:42.385226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:42.871453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:42.885466 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96b980dd-37a9-49a8-a484-5d328eed80f4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.534323 Apr 02 21:14:42.890685 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2772/5248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:42 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:44.657881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:44.659855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:44.673012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:44.677936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:44.679107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:44.681156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:44.746418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:14:44.915053 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bc84403-6e64-409d-b5c9-fcb47e01cd8f tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 204 len: 0 microversion: 2.1 time: 0.261530 Apr 02 21:14:44.917343 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2477/5249] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:14:44 2022] DELETE /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:14:44.924981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:44.925619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:44.937865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:44.939072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:44.941508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:44.942233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:45.542132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:45.550655 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-81ecc1ed-aaf6-4c6c-8561-8bcaca67f054 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1507 microversion: 2.1 time: 0.629860 Apr 02 21:14:45.553209 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2773/5250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:44 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1507 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:46.572371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:46.576591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:46.598511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:46.599623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:46.600624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:46.601288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:47.058064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:47.068006 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fcba2399-6ceb-41ac-9f2f-2fcb6b09e7b5 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1507 microversion: 2.1 time: 0.501037 Apr 02 21:14:47.073148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2478/5251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:46 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:48.090803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:48.092230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:48.104833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:48.108440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:48.109313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:48.109805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:48.869714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:48.906187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f312ab48-c7bb-4f4b-b0ec-ad7b2178aa6e tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1507 microversion: 2.1 time: 0.818240 Apr 02 21:14:48.908154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2774/5252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:48 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1507 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:49.417599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ead410ce-dee3-43d6-a23e-e62c0dc7887a req-53aef31c-010f-428b-a0fe-bd73c49b610b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7840fc-ecb4-4758-b217-7e306ad61475", "name": "network-vif-deleted", "tag": "d871d984-4afc-4adb-8fe8-d37565f55a01"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:49.443833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ead410ce-dee3-43d6-a23e-e62c0dc7887a req-53aef31c-010f-428b-a0fe-bd73c49b610b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:49.444594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ead410ce-dee3-43d6-a23e-e62c0dc7887a req-53aef31c-010f-428b-a0fe-bd73c49b610b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:49.465327 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ead410ce-dee3-43d6-a23e-e62c0dc7887a req-53aef31c-010f-428b-a0fe-bd73c49b610b service nova] Creating event network-vif-deleted:d871d984-4afc-4adb-8fe8-d37565f55a01 for instance 8b7840fc-ecb4-4758-b217-7e306ad61475 on nch1-master-1 Apr 02 21:14:49.471827 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ead410ce-dee3-43d6-a23e-e62c0dc7887a req-53aef31c-010f-428b-a0fe-bd73c49b610b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059783 Apr 02 21:14:49.474638 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2479/5253] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:14:49.928051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:49.928873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:49.938653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:49.939424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:49.940537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:49.941379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:50.007793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:50.012103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:50.018927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lazy-loading 'fault' on Instance uuid 8b7840fc-ecb4-4758-b217-7e306ad61475 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:14:50.157111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:50.174325 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c567af2-36a9-4e2d-96b9-2573e1af5bcb tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 200 len: 1311 microversion: 2.1 time: 0.250841 Apr 02 21:14:50.185094 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2775/5254] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:49 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:51.193131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:51.193968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: 8b7840fc-ecb4-4758-b217-7e306ad61475] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:51.204990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:51.209859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:51.210960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:51.212168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:51.301537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Instance 8b7840fc-ecb4-4758-b217-7e306ad61475 could not be found. Apr 02 21:14:51.302947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 404 to user: Instance 8b7840fc-ecb4-4758-b217-7e306ad61475 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:51.304417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-92020b1b-3aa4-4587-a817-add53a14d388 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475" status: 404 len: 111 microversion: 2.1 time: 0.116872 Apr 02 21:14:51.305490 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2480/5255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:51 2022] GET /compute/v2.1/servers/8b7840fc-ecb4-4758-b217-7e306ad61475 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:14:51.326579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:51.327200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:51.341040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:51.341611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:51.342555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:51.345349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:51.400007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:14:51.555333 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f6a40e24-1234-43fa-b9ff-954bd85c2e6a tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 204 len: 0 microversion: 2.1 time: 0.232556 Apr 02 21:14:51.556726 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2776/5256] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:14:51 2022] DELETE /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:14:51.565202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:51.566136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:51.577294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:51.578085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:51.579129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:51.579819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:52.046527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:52.056089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46f08eb1-9f94-4b89-9973-b0a0176c9fda tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.495252 Apr 02 21:14:52.062706 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2481/5257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:51 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:53.080756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:53.082450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:53.099709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:53.101606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:53.103812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:53.106541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:53.470499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1940828170", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "146ce8d9-8798-4b34-95b9-d9b14df14138"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:53.520180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:53.544178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aeea887e-cb6c-4759-b5ce-9fd8371420b3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.468578 Apr 02 21:14:53.546468 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2777/5258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:53 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:53.576977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] validate_networks() for [('146ce8d9-8798-4b34-95b9-d9b14df14138', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:14:53.631126 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:14:53.640650 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:14:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:14:54.562102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:54.563951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:54.572978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:54.573787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:54.574714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:54.575278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:55.072033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:14:55.072505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:14:55.073081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:14:55.073897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:14:55.074332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:14:55.094802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:55.095049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7ebf8694d674ee38bb5f58a3687a415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e9483710f0424b9c347c74a9da708a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:55.095639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:55.098748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:55.099293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:55.110398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7974f290-a7b2-47ea-8e96-9b0f269bb6a4 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 200 len: 1522 microversion: 2.1 time: 0.552382 Apr 02 21:14:55.113935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2778/5259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:54 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:14:55.171420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Getting quotas for project b5fe471f4a924fd98ef24aa24abb736c. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:14:55.187218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Getting quotas for user 08aca3700d594a349789d5f3847894dc and project b5fe471f4a924fd98ef24aa24abb736c. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:14:55.209234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:14:55.214848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:14:55.293082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-624af03e-a03e-4553-811e-a6ca9e77e2df req-2fe2c5b9-34cc-47ec-91ea-ff4936bdbfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b178f6-4dca-4aeb-84ae-389b11f090d3", "name": "network-vif-deleted", "tag": "d4a0a867-2de9-4d5e-8133-dcadf215b3ae"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:14:55.309138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-624af03e-a03e-4553-811e-a6ca9e77e2df req-2fe2c5b9-34cc-47ec-91ea-ff4936bdbfdc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:55.309975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-624af03e-a03e-4553-811e-a6ca9e77e2df req-2fe2c5b9-34cc-47ec-91ea-ff4936bdbfdc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:55.312223 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0a07b60-6631-438d-b646-f1f252678d10 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845546 Apr 02 21:14:55.316577 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2482/5260] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:14:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:14:55.330111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38628fde-c1e3-4b3f-a292-3d07e7c1d35a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:55.330745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38628fde-c1e3-4b3f-a292-3d07e7c1d35a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:55.340684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-624af03e-a03e-4553-811e-a6ca9e77e2df req-2fe2c5b9-34cc-47ec-91ea-ff4936bdbfdc service nova] Creating event network-vif-deleted:d4a0a867-2de9-4d5e-8133-dcadf215b3ae for instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 on nch2-master-1 Apr 02 21:14:55.354642 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-624af03e-a03e-4553-811e-a6ca9e77e2df req-2fe2c5b9-34cc-47ec-91ea-ff4936bdbfdc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066724 Apr 02 21:14:55.355360 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2779/5261] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:14:55.655674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38628fde-c1e3-4b3f-a292-3d07e7c1d35a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:55.664663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38628fde-c1e3-4b3f-a292-3d07e7c1d35a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1219 microversion: 2.1 time: 0.337680 Apr 02 21:14:55.666609 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2483/5262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:55 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1219 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:56.138880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:56.139608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] [instance: f1b178f6-4dca-4aeb-84ae-389b11f090d3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:56.165167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:56.165656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:56.168234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:56.169333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:56.195756 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] HTTP exception thrown: Instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 could not be found. Apr 02 21:14:56.197959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] Returning 404 to user: Instance f1b178f6-4dca-4aeb-84ae-389b11f090d3 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:14:56.199172 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e567905c-628c-4c5f-a88c-ea9bef9733e3 tempest-ServerRescueNegativeTestJSON-1832764052 tempest-ServerRescueNegativeTestJSON-1832764052-project] 10.222.0.18 "GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3" status: 404 len: 111 microversion: 2.1 time: 0.071824 Apr 02 21:14:56.200495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2780/5263] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:56 2022] GET /compute/v2.1/servers/f1b178f6-4dca-4aeb-84ae-389b11f090d3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:14:56.683838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:56.684518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:56.702205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:56.702758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:56.707296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:56.717704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:56.933332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:56.942268 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5897b55f-d28e-4753-b41b-0ff8d349c2ab tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1271 microversion: 2.1 time: 0.264212 Apr 02 21:14:56.943415 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2484/5264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:56 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:57.960947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:57.962224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:57.975686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:57.976492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:57.977840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:57.978490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:58.155369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:14:58.172840 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3a1e80c9-d412-4484-a842-9f21ad5bfc1b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1277 microversion: 2.1 time: 0.217078 Apr 02 21:14:58.173802 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2781/5265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:57 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:14:59.199882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:14:59.201061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:14:59.213930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:59.215192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:59.218851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:14:59.220081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:14:59.999988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:00.018817 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39f41b12-b404-49bd-8505-8a02001f2540 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.829713 Apr 02 21:15:00.030954 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2485/5266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:14:59 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:00.359443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-6e40b305-938d-45de-9e45-c835e9161a1a req-5dd380ff-a984-4286-9756-2c37c6b58a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8a56c3-afa0-4089-be5b-a45a7dbea62b", "tag": "6bd2b363-0b40-48fc-a62c-c4ba112f7195"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:00.377714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6e40b305-938d-45de-9e45-c835e9161a1a req-5dd380ff-a984-4286-9756-2c37c6b58a53 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:00.378721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6e40b305-938d-45de-9e45-c835e9161a1a req-5dd380ff-a984-4286-9756-2c37c6b58a53 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:00.399031 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-6e40b305-938d-45de-9e45-c835e9161a1a req-5dd380ff-a984-4286-9756-2c37c6b58a53 service nova] Creating event network-changed:6bd2b363-0b40-48fc-a62c-c4ba112f7195 for instance 3e8a56c3-afa0-4089-be5b-a45a7dbea62b on nch1-master-1 Apr 02 21:15:00.405570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-6e40b305-938d-45de-9e45-c835e9161a1a req-5dd380ff-a984-4286-9756-2c37c6b58a53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051226 Apr 02 21:15:00.406500 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2782/5267] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:01.044306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:01.047788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:01.063588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:01.064968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:01.066781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:01.067640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:01.647017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:01.662590 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0681d923-80c4-45fa-ba03-2b1eadceb76d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.627044 Apr 02 21:15:01.666381 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2486/5268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:01 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:02.685605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:02.686312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:02.701131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:02.702730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:02.703748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:02.704987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:03.099199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:03.107224 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0bc0e747-685b-427c-9d64-231d04722f0a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.428708 Apr 02 21:15:03.110894 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2783/5269] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:02 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:04.129125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:04.129970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:04.144119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:04.144678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:04.146041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:04.147830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:04.629209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:04.638241 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7963e7b7-0cdb-44b0-bab2-487f39d36483 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.514255 Apr 02 21:15:04.640229 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2487/5270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:04 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:05.657204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:05.657836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:05.674476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:05.674962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:05.675756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:05.676198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:06.076920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:06.089482 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-578bfd9e-d791-465c-ad9c-2472ac39170e tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.436138 Apr 02 21:15:06.099816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2784/5271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:05 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:07.106981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:07.107603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:07.114882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:07.115341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:07.116127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:07.116598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:07.390115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:07.399125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-90e811dc-6be2-4e66-97e5-69676ad8bdca tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.295935 Apr 02 21:15:07.400381 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2488/5272] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:07 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:08.425451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:08.427958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:08.440856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:08.443475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:08.444532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:08.445148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:08.850446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:08.863363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3fb8dd8f-f17f-4646-8f8b-8baf3a43b958 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.449238 Apr 02 21:15:08.866193 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2785/5273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:08 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:08.962960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1731218208", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:08.993977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2a8592b1-88c8-4990-84d4-19590bda2319 req-e89322d0-dfe8-41b9-b1ab-baf7dd478177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8a56c3-afa0-4089-be5b-a45a7dbea62b", "name": "network-vif-plugged", "status": "completed", "tag": "6bd2b363-0b40-48fc-a62c-c4ba112f7195"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:09.010337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2a8592b1-88c8-4990-84d4-19590bda2319 req-e89322d0-dfe8-41b9-b1ab-baf7dd478177 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:09.010777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2a8592b1-88c8-4990-84d4-19590bda2319 req-e89322d0-dfe8-41b9-b1ab-baf7dd478177 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:09.050183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:15:09.053498 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2a8592b1-88c8-4990-84d4-19590bda2319 req-e89322d0-dfe8-41b9-b1ab-baf7dd478177 service nova] Creating event network-vif-plugged:6bd2b363-0b40-48fc-a62c-c4ba112f7195 for instance 3e8a56c3-afa0-4089-be5b-a45a7dbea62b on nch1-master-1 Apr 02 21:15:09.071687 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2a8592b1-88c8-4990-84d4-19590bda2319 req-e89322d0-dfe8-41b9-b1ab-baf7dd478177 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081286 Apr 02 21:15:09.073547 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2786/5274] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:09.776975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:15:09.777501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:15:09.778559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:15:09.779082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:15:09.779384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:15:09.794294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:09.795149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:09.800761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:09.802285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:09.828545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:09.835854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:09.851626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:15:09.853850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:15:09.882689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:09.883971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:09.900244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:09.917600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:09.924055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:09.924830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:09.942905 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46f69727-1c91-4100-aee7-3a444ff98c05 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334715 Apr 02 21:15:09.944144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2489/5275] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:15:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:15:09.958525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1939ecff-c098-4fae-ad29-72e795a57e76 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:09.959730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1939ecff-c098-4fae-ad29-72e795a57e76 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:10.056072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1939ecff-c098-4fae-ad29-72e795a57e76 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:10.064636 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1939ecff-c098-4fae-ad29-72e795a57e76 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1193 microversion: 2.1 time: 0.114341 Apr 02 21:15:10.066819 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2490/5276] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:09 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:10.173759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:10.188405 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd3875d7-c32d-46b7-b93d-c3af95dc22e1 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1319 microversion: 2.1 time: 0.310379 Apr 02 21:15:10.189344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2787/5277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:09 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:11.083526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:11.084135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:11.094366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:11.094906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:11.095799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:11.096551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:11.206772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:11.208501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:11.220084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:11.220572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:11.224323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:11.224824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:11.426119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:11.437739 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9052d11d-263b-4aa7-a106-09bb3667100d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1245 microversion: 2.1 time: 0.359471 Apr 02 21:15:11.441143 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2491/5278] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:11 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1245 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:11.608653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:11.618521 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96eadec4-4efe-4461-a861-778930ed0d5a tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1509 microversion: 2.1 time: 0.415585 Apr 02 21:15:11.633564 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2788/5279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:11 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1509 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:12.458076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:12.459281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:12.468594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:12.475725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:12.476904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:12.482590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:12.970760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:12.986824 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12aa21a0-7614-4de7-8ec8-42cdf2d564b1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1293 microversion: 2.1 time: 0.533309 Apr 02 21:15:12.987686 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2492/5280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:12 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1293 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:13.393630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d3eb9746-ba33-4815-9d2f-eb39988c8ff2 req-b8f05aa6-23b7-4abf-ae96-55817357a2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "508fbb35-494f-4d1c-9e93-4796909dbdfd", "tag": "8f191590-0383-4d7c-87db-54e9c472575b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:13.414547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d3eb9746-ba33-4815-9d2f-eb39988c8ff2 req-b8f05aa6-23b7-4abf-ae96-55817357a2aa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:13.417596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d3eb9746-ba33-4815-9d2f-eb39988c8ff2 req-b8f05aa6-23b7-4abf-ae96-55817357a2aa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:13.439432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d3eb9746-ba33-4815-9d2f-eb39988c8ff2 req-b8f05aa6-23b7-4abf-ae96-55817357a2aa service nova] Creating event network-changed:8f191590-0383-4d7c-87db-54e9c472575b for instance 508fbb35-494f-4d1c-9e93-4796909dbdfd on nch2-master-1 Apr 02 21:15:13.446718 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d3eb9746-ba33-4815-9d2f-eb39988c8ff2 req-b8f05aa6-23b7-4abf-ae96-55817357a2aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057714 Apr 02 21:15:13.448115 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2789/5281] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:14.004945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:14.005562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:14.012714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:14.013222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:14.014100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:14.014667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:14.396301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:14.413240 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47703188-11ae-4e7e-a0f5-2f98b4e5e3ac tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1293 microversion: 2.1 time: 0.404051 Apr 02 21:15:14.413240 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2493/5282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:13 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1293 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:14.421650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fe875f0-142e-4db8-8a87-f78692047798", "device": "/dev/sdb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:14.423451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:14.433759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:14.434426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:14.435699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:14.436402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:14.871197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "POST /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452341 Apr 02 21:15:14.878136 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2790/5283] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:15:14 2022] POST /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:15.434520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:15.435574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:15.455801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:15.459101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:15.460043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:15.463617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:15.727786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:15.729122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:15.743571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:15.748176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:15.749985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:15.750235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:16.172482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:16.182081 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e20392f7-6687-4030-802e-794fa60b969f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1293 microversion: 2.1 time: 0.755987 Apr 02 21:15:16.192578 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2494/5284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:15 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1293 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:16.233054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:16.243429 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08ddabc9-4deb-4196-80fc-fb833e0ceaa0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.519895 Apr 02 21:15:16.244640 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2791/5285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:15 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:16.267584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:16.268351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:16.278543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:16.279142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:16.280164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:16.280875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:16.589683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:16.619421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58a41e6e-35b5-4903-95e1-0de77e56e927 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.352376 Apr 02 21:15:16.620114 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2495/5286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:16 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:16.640172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:16.640836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:16.656089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:16.656665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:16.657601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:16.658271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:16.959271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:16.969253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a5700e5-c8ff-46ca-857c-ad5ff9251e74 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.333708 Apr 02 21:15:16.970159 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2792/5287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:16 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:16.985734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:16.986494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:16.998704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:16.999246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:17.000142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:17.005232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:17.186140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:17.199165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:17.199789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:17.205049 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6df2124-7429-4735-b6b6-7c15bd276617 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.223115 Apr 02 21:15:17.208705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:17.209165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:17.209954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:17.211162 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2496/5288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:16 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:17.211988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:17.394316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1172891152", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "31fced4c-1a00-48a4-a6cd-17c45563c707"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:17.461620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] validate_networks() for [('31fced4c-1a00-48a4-a6cd-17c45563c707', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:15:17.615898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:17.626565 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-af6709e0-9995-4329-add0-430be67fad6b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1293 microversion: 2.1 time: 0.431469 Apr 02 21:15:17.630039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2793/5289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:17 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1293 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:18.039889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:15:18.040778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:15:18.041279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:15:18.041703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:15:18.042131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:15:18.061262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:18.061958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:18.062962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:18.063683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:18.115480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:18.128552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:18.157313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:15:18.162211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:15:18.237335 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-820e6831-7b32-4247-8fce-0c79c0d13fdb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848774 Apr 02 21:15:18.247088 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2497/5290] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:15:18.254751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7aee46d0-0335-4a50-a660-863dd4663763 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:18.255637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7aee46d0-0335-4a50-a660-863dd4663763 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:18.390728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7aee46d0-0335-4a50-a660-863dd4663763 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:18.398139 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7aee46d0-0335-4a50-a660-863dd4663763 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1215 microversion: 2.1 time: 0.150248 Apr 02 21:15:18.399459 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2794/5291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:18 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:18.651819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:18.652869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:18.661657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:18.662273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:18.663254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:18.663890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:19.016736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:19.029109 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7d93f82-f63b-48a1-a14d-d928314473d8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1293 microversion: 2.1 time: 0.385210 Apr 02 21:15:19.030390 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2498/5292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:18 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1293 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:19.246416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0ccd7e6c-146e-4b60-9171-9246d8271324 req-0645d518-5f12-40ef-9730-ce82cf5e74a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508fbb35-494f-4d1c-9e93-4796909dbdfd", "name": "network-vif-plugged", "status": "completed", "tag": "8f191590-0383-4d7c-87db-54e9c472575b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:19.267765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0ccd7e6c-146e-4b60-9171-9246d8271324 req-0645d518-5f12-40ef-9730-ce82cf5e74a8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:19.268669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0ccd7e6c-146e-4b60-9171-9246d8271324 req-0645d518-5f12-40ef-9730-ce82cf5e74a8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:19.297488 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0ccd7e6c-146e-4b60-9171-9246d8271324 req-0645d518-5f12-40ef-9730-ce82cf5e74a8 service nova] Creating event network-vif-plugged:8f191590-0383-4d7c-87db-54e9c472575b for instance 508fbb35-494f-4d1c-9e93-4796909dbdfd on nch2-master-1 Apr 02 21:15:19.311167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0ccd7e6c-146e-4b60-9171-9246d8271324 req-0645d518-5f12-40ef-9730-ce82cf5e74a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067079 Apr 02 21:15:19.314502 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2795/5293] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:19.415856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:19.416704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:19.425601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:19.426870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:19.431359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:19.432046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:19.579164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:19.591170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb73fe87-186d-4443-b240-64cf1bbb4d21 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1267 microversion: 2.1 time: 0.176951 Apr 02 21:15:19.593299 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2499/5294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:19 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:20.048387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:20.049803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:20.064625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:20.069088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:20.070938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:20.071601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:20.481227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:20.494020 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fd87986e-f473-4d32-9e85-107e9f0a59dc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1293 microversion: 2.1 time: 0.450326 Apr 02 21:15:20.495668 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2796/5295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:20 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1293 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:20.610907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:20.611793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:20.621846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:20.622432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:20.624766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:20.625985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:20.783872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:20.795626 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-580c1d24-5c78-436b-b800-5ad88f020142 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1273 microversion: 2.1 time: 0.189790 Apr 02 21:15:20.797365 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2500/5296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:20 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:21.514835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:21.515702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:21.524230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:21.525196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:21.526083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:21.526727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:21.814584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:21.815817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:21.831322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:21.832678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:21.834608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:21.836770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:21.911066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:21.936708 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86640057-14a5-4dfb-a98b-6c339da1f557 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1474 microversion: 2.1 time: 0.429312 Apr 02 21:15:21.956700 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2797/5297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:21 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1474 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:22.212446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-197523836", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:22.291146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:22.306881 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3fc53328-4906-4d4f-be89-792706ab50e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 0.496236 Apr 02 21:15:22.309314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2501/5298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:21 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:22.370780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:15:23.330668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:23.331933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:23.361559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:23.362037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:23.363618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:23.364243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:24.037096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:15:24.037096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:15:24.037713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:15:24.037809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:15:24.038296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:15:24.049166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:24.049994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:24.051733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:24.052626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:24.094077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:24.116040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:24.142200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:15:24.144724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:15:24.308137 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5de81beb-30dd-45cc-9dfe-ad3722d3c86e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.099607 Apr 02 21:15:24.318186 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2798/5299] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:15:24.326204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a84c3cc5-4576-4588-9700-e58a292a85d9 req-2897340e-2aa9-48e6-b17c-a7f366b856e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d9530c-b3bf-45b7-9ccd-97479fa1cb08", "tag": "97ef2fec-e36f-410f-8236-562ad8528080"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:24.377943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a84c3cc5-4576-4588-9700-e58a292a85d9 req-2897340e-2aa9-48e6-b17c-a7f366b856e2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:24.379001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a84c3cc5-4576-4588-9700-e58a292a85d9 req-2897340e-2aa9-48e6-b17c-a7f366b856e2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:24.437303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a84c3cc5-4576-4588-9700-e58a292a85d9 req-2897340e-2aa9-48e6-b17c-a7f366b856e2 service nova] Creating event network-changed:97ef2fec-e36f-410f-8236-562ad8528080 for instance f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 on nch1-master-1 Apr 02 21:15:24.448939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a84c3cc5-4576-4588-9700-e58a292a85d9 req-2897340e-2aa9-48e6-b17c-a7f366b856e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127959 Apr 02 21:15:24.450971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2799/5300] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:24.471997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d983c37-1feb-44cb-87b6-f905ffba5a71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:24.476828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d983c37-1feb-44cb-87b6-f905ffba5a71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:24.520770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d983c37-1feb-44cb-87b6-f905ffba5a71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:15:24.702054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:24.724772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d4cdbb6-f26b-4944-a8a8-bb96bc9744f5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 1.391374 Apr 02 21:15:24.725498 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2502/5301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:23 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:24.982322 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.scheduler.client.report [None req-1d983c37-1feb-44cb-87b6-f905ffba5a71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Deleted allocations for instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 Apr 02 21:15:24.993050 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-1d983c37-1feb-44cb-87b6-f905ffba5a71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] Instance Mapping does not exist while attempting local delete cleanup. Apr 02 21:15:24.996281 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d983c37-1feb-44cb-87b6-f905ffba5a71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1" status: 204 len: 0 microversion: 2.1 time: 0.538488 Apr 02 21:15:25.004837 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2800/5302] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:15:24 2022] DELETE /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:15:25.017491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9f38be4-d346-43ab-b4a0-fc773c8d298f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:25.040298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9f38be4-d346-43ab-b4a0-fc773c8d298f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:25.058509 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c9f38be4-d346-43ab-b4a0-fc773c8d298f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 could not be found. Apr 02 21:15:25.061531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9f38be4-d346-43ab-b4a0-fc773c8d298f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:15:25.065583 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9f38be4-d346-43ab-b4a0-fc773c8d298f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1" status: 404 len: 111 microversion: 2.1 time: 0.052970 Apr 02 21:15:25.071287 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2503/5303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:25 2022] GET /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:15:25.189532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1906427962", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:25.315621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:15:26.017628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:26.019028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:26.027450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:26.028681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:26.030755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:26.031454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:26.367264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:26.386821 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efc85cc6-e36a-42cb-96ae-72fb740d4731 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 0.643207 Apr 02 21:15:26.388814 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2504/5304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:25 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:26.660870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:15:26.662167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:15:26.664961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:15:26.665524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:15:26.668034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:15:26.687116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:26.691920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:26.697001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:26.697723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:26.744282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:26.751973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:26.791789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:15:26.795972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:15:26.930856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d6457362-5079-45ad-8e7a-e57ec13a2ffc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746086 Apr 02 21:15:26.931647 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2801/5305] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:15:26.944034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-52270fdb-cba7-4743-ab82-7a237234e9de tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:26.944696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-52270fdb-cba7-4743-ab82-7a237234e9de tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:27.027277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-52270fdb-cba7-4743-ab82-7a237234e9de tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:27.037083 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-52270fdb-cba7-4743-ab82-7a237234e9de tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1221 microversion: 2.1 time: 0.097533 Apr 02 21:15:27.052552 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2505/5306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:26 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:27.406729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:27.407522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:27.416676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:27.417495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:27.418626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:27.419296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:27.737631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:27.757138 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-de3dad2d-03fb-42a3-af23-fd353798b14d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 0.351121 Apr 02 21:15:27.770265 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2802/5307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:27 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:28.058495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:28.060123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:28.078636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:28.081047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:28.082700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:28.085290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:28.246118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:28.261269 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb51a52c-6b75-4840-87ae-90e4e7b7f74d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1273 microversion: 2.1 time: 0.208091 Apr 02 21:15:28.271604 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2506/5308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:28 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:28.775516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:28.776155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:28.798653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:28.799140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:28.799983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:28.801239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:29.281685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:29.282360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:29.300136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:29.301929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:29.305413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:29.307485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:29.399062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:29.414261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:29.415073 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b49b2b19-fe3a-4b6d-bda5-bb6372d89463 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 0.643212 Apr 02 21:15:29.416256 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2803/5309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:28 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:29.421879 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa2f2d8e-27d1-4572-9165-c9f4699976f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1279 microversion: 2.1 time: 0.145799 Apr 02 21:15:29.422457 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2507/5310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:29 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:30.446639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:30.451643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:30.452828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:30.454096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:30.496893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:30.497666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:30.498819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:30.500715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:30.503190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:30.504508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:30.504628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:30.505142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:30.923263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:30.936588 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a17ced2-ee3c-4209-aa82-0f9c68f19eb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 0.499668 Apr 02 21:15:30.937771 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2804/5311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:30 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:30.952016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-86404189-6ea8-402c-b2a0-d354f73f8c04 req-82b81b9f-4360-4433-9890-770b2d2cc3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d9530c-b3bf-45b7-9ccd-97479fa1cb08", "name": "network-vif-plugged", "status": "completed", "tag": "97ef2fec-e36f-410f-8236-562ad8528080"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:30.970884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:30.974926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-86404189-6ea8-402c-b2a0-d354f73f8c04 req-82b81b9f-4360-4433-9890-770b2d2cc3ba service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:30.975482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-86404189-6ea8-402c-b2a0-d354f73f8c04 req-82b81b9f-4360-4433-9890-770b2d2cc3ba service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:30.984938 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db21b5e0-9585-4a2a-a597-847ded173308 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.543362 Apr 02 21:15:30.985971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2508/5312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:30 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:31.006014 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-86404189-6ea8-402c-b2a0-d354f73f8c04 req-82b81b9f-4360-4433-9890-770b2d2cc3ba service nova] Creating event network-vif-plugged:97ef2fec-e36f-410f-8236-562ad8528080 for instance f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 on nch1-master-1 Apr 02 21:15:31.019038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-86404189-6ea8-402c-b2a0-d354f73f8c04 req-82b81b9f-4360-4433-9890-770b2d2cc3ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078603 Apr 02 21:15:31.019652 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2805/5313] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:31.955636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:31.956266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:31.964696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:31.965519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:31.966463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:31.967195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:32.004557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:32.005306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:32.024225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:32.024841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:32.025643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:32.026277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:32.174855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:32.183277 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-788d99fb-a581-4c27-8963-07581773ff6a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1315 microversion: 2.1 time: 0.231756 Apr 02 21:15:32.196697 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2509/5314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:31 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:32.321839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ddad7bc1-4f2e-47c1-a376-6bbc0f6ff0bc req-06227aee-5558-458d-a881-383668b58a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eec316-b113-4eb9-9745-5ce00e697e7e", "tag": "49d2525c-825c-4b83-8f7e-fac6ff834641"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:32.340554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ddad7bc1-4f2e-47c1-a376-6bbc0f6ff0bc req-06227aee-5558-458d-a881-383668b58a7a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:32.341159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ddad7bc1-4f2e-47c1-a376-6bbc0f6ff0bc req-06227aee-5558-458d-a881-383668b58a7a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:32.361134 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ddad7bc1-4f2e-47c1-a376-6bbc0f6ff0bc req-06227aee-5558-458d-a881-383668b58a7a service nova] Creating event network-changed:49d2525c-825c-4b83-8f7e-fac6ff834641 for instance 23eec316-b113-4eb9-9745-5ce00e697e7e on nch2-master-1 Apr 02 21:15:32.374069 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ddad7bc1-4f2e-47c1-a376-6bbc0f6ff0bc req-06227aee-5558-458d-a881-383668b58a7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055781 Apr 02 21:15:32.374813 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2510/5315] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:15:32.488672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:32.500099 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff9d5146-e5a5-43fe-92cb-3a19a6d7c75b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.501223 Apr 02 21:15:32.510835 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2806/5316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:31 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:33.202266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:33.202976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:33.214013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:33.214481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:33.215275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:33.215723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:33.519912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:33.520731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:33.535914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:33.536374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:33.537220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:33.540316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:33.766745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:33.794872 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-876600d7-d3f3-4c09-a845-fa90279b2791 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1501 microversion: 2.1 time: 0.597405 Apr 02 21:15:33.796988 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2511/5317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:33 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1501 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:33.822093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:33.824030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:33.838707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:33.841163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:33.842124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:33.843174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:34.289587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.network.security_group_api [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Removing security group 59a753c3-542e-462f-b43b-a5537dac1acb from port 97ef2fec-e36f-410f-8236-562ad8528080 Apr 02 21:15:34.318041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:34.337800 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59421f9a-e6ff-4168-af24-d75e0bf4a3b9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.823590 Apr 02 21:15:34.339809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2807/5318] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:33 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:35.029162 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf534378-930d-4524-9f93-9a7cb30f492e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08/action" status: 202 len: 0 microversion: 2.1 time: 1.217965 Apr 02 21:15:35.030146 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2512/5319] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:15:33 2022] POST /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08/action => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:15:35.040932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:35.042194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:35.055201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a6c3ca96-186b-4352-bfe4-2bac4bc11edc req-68f0d595-a2d0-4259-9371-d4ef3dc8d725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d9530c-b3bf-45b7-9ccd-97479fa1cb08", "tag": "97ef2fec-e36f-410f-8236-562ad8528080"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:35.056874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.057408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.061704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.062248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.068228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a6c3ca96-186b-4352-bfe4-2bac4bc11edc req-68f0d595-a2d0-4259-9371-d4ef3dc8d725 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.072184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a6c3ca96-186b-4352-bfe4-2bac4bc11edc req-68f0d595-a2d0-4259-9371-d4ef3dc8d725 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.105985 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a6c3ca96-186b-4352-bfe4-2bac4bc11edc req-68f0d595-a2d0-4259-9371-d4ef3dc8d725 service nova] Creating event network-changed:97ef2fec-e36f-410f-8236-562ad8528080 for instance f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 on nch1-master-1 Apr 02 21:15:35.117426 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a6c3ca96-186b-4352-bfe4-2bac4bc11edc req-68f0d595-a2d0-4259-9371-d4ef3dc8d725 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066388 Apr 02 21:15:35.118058 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2513/5320] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:15:35.329916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:35.345952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c40e3fb1-6238-4a3f-a956-55c0d0757181 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1459 microversion: 2.1 time: 0.311416 Apr 02 21:15:35.347712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2808/5321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:35 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1459 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:35.371369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:35.372935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:35.374573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:35.375497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:35.396680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.397757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.399630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.401083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.403075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.403075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.405666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.406653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.826169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:35.844944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4320aaeb-59f5-44c1-8576-e3375465a869 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.489303 Apr 02 21:15:35.849130 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2514/5322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:35 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:35.954118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:35.965600 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a4bc70d-7246-4857-8c71-eb747a022508 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.603229 Apr 02 21:15:35.968154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2809/5323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:35 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:35.988728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:35.989772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:35.997881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:35.998580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:35.999649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.000335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:36.308895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:36.322178 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7dbbef0a-9d99-45a7-894c-0b136e896a66 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.338308 Apr 02 21:15:36.324405 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2515/5324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:35 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:36.358516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:36.358516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:36.373902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.375462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:36.376723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.377413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:36.823201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:36.837646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-224282e5-c0c1-41da-91e3-176917e59057 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.496870 Apr 02 21:15:36.849091 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2810/5325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:36 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:36.855101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:36.859781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:36.864204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:36.868524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:36.872649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.875010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:36.876407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.879419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:36.885259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.885956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:36.886929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:36.887536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:37.132724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:37.140767 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-66648826-4072-45f2-b8e6-5a58213d3ddc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.289602 Apr 02 21:15:37.141965 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2516/5326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:36 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:37.160830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:37.179071 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6fbdcd78-88ec-4916-85b4-10227807ed50 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.319007 Apr 02 21:15:37.181525 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2811/5327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:36 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:37.323960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1462380719", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "31fced4c-1a00-48a4-a6cd-17c45563c707"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:37.451968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] validate_networks() for [('31fced4c-1a00-48a4-a6cd-17c45563c707', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:15:38.197953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:38.199257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:38.248504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:38.251649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:38.252764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:38.254704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:38.743213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:38.752073 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8242f06c-5ba7-4bef-9c0c-68163bae6b43 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.557933 Apr 02 21:15:38.755597 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2812/5328] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:38 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:38.762304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:15:38.762817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:15:38.763226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:15:38.763616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:15:38.764217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:15:38.780076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:38.788876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:38.788876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:38.793833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:38.869525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:38.876380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Getting quotas for user 27f570c67ed24546ac51341ef8ea2439 and project e25481b7efed4632bcd054e2cec3b161. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:38.921028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:15:38.925980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:15:39.016473 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-714742e9-3035-4d9c-9683-61374d028bca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697280 Apr 02 21:15:39.030417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-771cb6c2-a73b-4f72-87d0-fe9127aff24e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:39.031601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-771cb6c2-a73b-4f72-87d0-fe9127aff24e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:39.032870 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2517/5329] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:15:39.181496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-771cb6c2-a73b-4f72-87d0-fe9127aff24e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:39.189605 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-771cb6c2-a73b-4f72-87d0-fe9127aff24e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1215 microversion: 2.1 time: 0.164009 Apr 02 21:15:39.194917 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2813/5330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:39 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:39.772160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:39.773156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:39.789883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:39.790357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:39.791169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:39.791625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:40.191228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:40.207447 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-63843667-0150-400a-a5d8-0053829f097c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.439884 Apr 02 21:15:40.221384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:40.221856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2518/5331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:39 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:40.222353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:40.231681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:40.232399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:40.233660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:40.234476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:40.359566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:40.373238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fdf9eb4b-417b-48a0-a598-704dbb2b390b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1267 microversion: 2.1 time: 0.164204 Apr 02 21:15:40.374345 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2814/5332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:40 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:41.233233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:41.234456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:41.249414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:41.250597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:41.251596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:41.252211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:41.392629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:41.393417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:41.405980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:41.406926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:41.407747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:41.408197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:41.556258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:41.569452 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0073314-b836-41b7-99f8-f0193e39a1e7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1273 microversion: 2.1 time: 0.181519 Apr 02 21:15:41.571876 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2815/5333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:41 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:42.042311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:42.052491 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f3057a4-f976-4f84-a5ae-299ad74c22df tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.826599 Apr 02 21:15:42.053109 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2519/5334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:41 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:42.591383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:42.592090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:42.624486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:42.625634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:42.631779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:42.636663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:42.702219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5f964fb1-ad51-4d1d-b81c-14542de91653 req-23820fde-8a15-4f22-967a-e28b7b10d187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eec316-b113-4eb9-9745-5ce00e697e7e", "name": "network-vif-plugged", "status": "completed", "tag": "49d2525c-825c-4b83-8f7e-fac6ff834641"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:42.720768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5f964fb1-ad51-4d1d-b81c-14542de91653 req-23820fde-8a15-4f22-967a-e28b7b10d187 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:42.721236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5f964fb1-ad51-4d1d-b81c-14542de91653 req-23820fde-8a15-4f22-967a-e28b7b10d187 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:42.746096 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5f964fb1-ad51-4d1d-b81c-14542de91653 req-23820fde-8a15-4f22-967a-e28b7b10d187 service nova] Creating event network-vif-plugged:49d2525c-825c-4b83-8f7e-fac6ff834641 for instance 23eec316-b113-4eb9-9745-5ce00e697e7e on nch2-master-1 Apr 02 21:15:42.761793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5f964fb1-ad51-4d1d-b81c-14542de91653 req-23820fde-8a15-4f22-967a-e28b7b10d187 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058590 Apr 02 21:15:42.763004 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2520/5335] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:15:43.074010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:43.074926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:43.089796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:43.090312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:43.091233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:43.096904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:43.344040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:43.364778 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6900f1cf-99fd-4a47-a33c-e6a8734b56a2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.774973 Apr 02 21:15:43.371130 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2816/5336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:42 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:43.535623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:43.548153 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a7a2b4c-4310-4867-aa60-5a0f1ebfbe10 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1321 microversion: 2.1 time: 0.481540 Apr 02 21:15:43.562182 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2521/5337] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:43 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1321 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:44.204997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5bd20b38-a6eb-4099-bf92-3a7ce3a2c537 req-d1533bc0-4c8a-4bef-a397-a05e12489e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8", "tag": "df6786e4-d893-4c02-ae92-279c5fe823fc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:44.224490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5bd20b38-a6eb-4099-bf92-3a7ce3a2c537 req-d1533bc0-4c8a-4bef-a397-a05e12489e16 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.227209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5bd20b38-a6eb-4099-bf92-3a7ce3a2c537 req-d1533bc0-4c8a-4bef-a397-a05e12489e16 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:44.274773 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5bd20b38-a6eb-4099-bf92-3a7ce3a2c537 req-d1533bc0-4c8a-4bef-a397-a05e12489e16 service nova] Creating event network-changed:df6786e4-d893-4c02-ae92-279c5fe823fc for instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 on nch1-master-1 Apr 02 21:15:44.295050 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5bd20b38-a6eb-4099-bf92-3a7ce3a2c537 req-d1533bc0-4c8a-4bef-a397-a05e12489e16 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090671 Apr 02 21:15:44.295809 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2817/5338] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:44.385213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:44.386332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:44.408483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.415506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:44.416483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.417103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:44.569025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:44.569802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:44.584914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.585261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:44.586059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.586506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:44.824550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:44.842544 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fe10a44-7a92-4fa0-80ee-61de87df13e2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.461376 Apr 02 21:15:44.844074 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2522/5339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:44 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:44.938384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:44.949385 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d144131-78e8-41a0-b7b6-53149f03a671 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1502 microversion: 2.1 time: 0.385343 Apr 02 21:15:44.969781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:44.970515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:44.973390 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2818/5340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:44 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1502 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:44.985864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.988054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:44.991708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:44.992445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:45.860196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:45.860844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:45.888637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:45.890721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:45.897421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:45.898364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:46.188311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:46.199181 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0218f217-a2db-43df-bad9-1a8d15f476a4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1502 microversion: 2.1 time: 1.235016 Apr 02 21:15:46.213567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2523/5341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:44 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1502 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:46.224566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:46.229075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:46.229677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:46.240828 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-17b9b9d8-b282-4644-bf38-c98419e4d87a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.384330 Apr 02 21:15:46.241457 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2819/5342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:45 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:46.245329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:46.246029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:46.257177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:46.258384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:46.300741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:15:46.414912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c7e5b96-f7df-4727-923b-14cb5adb7374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 204 len: 0 microversion: 2.1 time: 0.199242 Apr 02 21:15:46.416192 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2524/5343] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:15:46 2022] DELETE /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:15:46.424506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:46.425136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:46.432633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:46.433099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:46.433899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:46.434347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:46.657802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:46.665937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aee6d864-34db-4a5b-9676-ef22a74f5591 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1508 microversion: 2.1 time: 0.245553 Apr 02 21:15:46.667197 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2820/5344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:46 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:47.265465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:47.266208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:47.278213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:47.278699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:47.280319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:47.282641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:47.684960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:47.686300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:47.702608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:47.703620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:47.704940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:47.705391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:48.415836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:48.427750 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b35873b-5839-4a5a-af9c-a48b2ff32cce tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1508 microversion: 2.1 time: 0.744498 Apr 02 21:15:48.429092 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2821/5345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:47 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1508 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:48.933943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:48.967996 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a28f52ef-1a92-491c-bd55-c91d0f5fcb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 1.709175 Apr 02 21:15:48.987588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2525/5346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:47 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:49.446442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:49.447620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:49.458869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:49.460370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:49.465031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:49.465669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:49.606047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:49.616260 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d3d022d1-1175-4314-a0d9-e52fee443c55 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 200 len: 1466 microversion: 2.1 time: 0.173859 Apr 02 21:15:49.622257 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2822/5347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:49 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 1466 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:49.723364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b6f88968-1c09-45b0-9731-29ee07f4d2c7 req-350b2075-85f1-4fcc-b2ae-523ad26258cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eec316-b113-4eb9-9745-5ce00e697e7e", "name": "network-vif-deleted", "tag": "49d2525c-825c-4b83-8f7e-fac6ff834641"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:49.742190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b6f88968-1c09-45b0-9731-29ee07f4d2c7 req-350b2075-85f1-4fcc-b2ae-523ad26258cf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:49.742806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b6f88968-1c09-45b0-9731-29ee07f4d2c7 req-350b2075-85f1-4fcc-b2ae-523ad26258cf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:49.814768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b6f88968-1c09-45b0-9731-29ee07f4d2c7 req-350b2075-85f1-4fcc-b2ae-523ad26258cf service nova] Creating event network-vif-deleted:49d2525c-825c-4b83-8f7e-fac6ff834641 for instance 23eec316-b113-4eb9-9745-5ce00e697e7e on nch2-master-1 Apr 02 21:15:49.828676 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b6f88968-1c09-45b0-9731-29ee07f4d2c7 req-350b2075-85f1-4fcc-b2ae-523ad26258cf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109762 Apr 02 21:15:49.834148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2526/5348] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:15:49.994935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:49.996185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:50.005138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:50.006404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:50.007515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:50.008356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:50.328280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:50.337724 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-195e66db-8fb7-4ca8-a7f2-1edf97a92ce6 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.348408 Apr 02 21:15:50.352834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2823/5349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:49 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:50.639848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:50.640903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:50.655812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:50.658466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:50.660133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:50.662698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:50.715240 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 23eec316-b113-4eb9-9745-5ce00e697e7e could not be found. Apr 02 21:15:50.715879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 23eec316-b113-4eb9-9745-5ce00e697e7e could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:15:50.716801 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34699189-81ed-4afd-b80a-483d783a8276 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 404 len: 111 microversion: 2.1 time: 0.082201 Apr 02 21:15:50.729157 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2527/5350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:50 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:15:50.733961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9501a8a4-c148-4290-95fa-5cabde7ffa4e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: .version_select at 0x7f54d4a88160>, body: {"keypair": {"name": "tempest-key-576263254"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:50.765970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-9501a8a4-c148-4290-95fa-5cabde7ffa4e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:50.782935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-9501a8a4-c148-4290-95fa-5cabde7ffa4e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:51.010271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-9501a8a4-c148-4290-95fa-5cabde7ffa4e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:51.018760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-9501a8a4-c148-4290-95fa-5cabde7ffa4e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:51.056721 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9501a8a4-c148-4290-95fa-5cabde7ffa4e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2296 microversion: 2.1 time: 0.324478 Apr 02 21:15:51.063831 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2824/5351] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:15:50 2022] POST /compute/v2.1/os-keypairs => generated 2296 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:51.067844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1caa699a-36f1-4452-87e6-5400f1927437 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '.version_select at 0x7f54c7879af0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:51.070606 ncdv-master-1 devstack@n-api.service[136517]: WARNING oslo_db.sqlalchemy.utils [None req-1caa699a-36f1-4452-87e6-5400f1927437 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 02 21:15:51.084723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1caa699a-36f1-4452-87e6-5400f1927437 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.020674 Apr 02 21:15:51.086513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2528/5352] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Apr 2 21:15:51 2022] GET /compute/v2.1/os-keypairs => generated 544 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:15:51.280742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2008980687", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "key_name": "tempest-key-576263254", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:51.364248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:15:51.426161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e8ad6b1-72c7-4a49-b7ca-ea201d30fb1f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Action: 'create', calling method: .version_select at 0x7f54d4766310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-508642488"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:51.467155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7e8ad6b1-72c7-4a49-b7ca-ea201d30fb1f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:51.477329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7e8ad6b1-72c7-4a49-b7ca-ea201d30fb1f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for user 986a98734ff4476e83fcfbbf337274ca and project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:51.691548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7e8ad6b1-72c7-4a49-b7ca-ea201d30fb1f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:51.702498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7e8ad6b1-72c7-4a49-b7ca-ea201d30fb1f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for user 986a98734ff4476e83fcfbbf337274ca and project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:51.735540 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e8ad6b1-72c7-4a49-b7ca-ea201d30fb1f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.620290 Apr 02 21:15:51.743429 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2825/5353] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:15:51 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:51.748515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:51.749157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:51.772714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:51.773511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:51.775206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:51.777986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:52.162308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:52.177715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87f2219a-918d-45b7-9f37-1e2b6d3593c8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.437355 Apr 02 21:15:52.178584 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2826/5354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:51 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:52.295052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:15:52.296610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:15:52.297595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:15:52.298550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:15:52.299138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:15:52.344003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:52.346443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:52.348589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:52.349582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:52.383188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:15:52.395040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:15:52.432478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:15:52.437639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:15:52.526704 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0055640-2ab7-44a9-b2a4-e3e34b5f7de2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249110 Apr 02 21:15:52.528199 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2529/5355] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:15:52.545031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc81c2e7-9707-4d32-ace0-52d89d446d3f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:52.545793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc81c2e7-9707-4d32-ace0-52d89d446d3f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:52.673176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc81c2e7-9707-4d32-ace0-52d89d446d3f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:52.688895 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc81c2e7-9707-4d32-ace0-52d89d446d3f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1228 microversion: 2.1 time: 0.152575 Apr 02 21:15:52.690399 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2827/5356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:52 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1228 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:53.197189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:53.198756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:53.211710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:53.215518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:53.223154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:53.224098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:53.247596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b23b34a8-17ce-40e6-a702-58ab295b8215 req-e6894b8f-5066-40a2-80fb-d9de0aaf7ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8", "name": "network-vif-plugged", "status": "completed", "tag": "df6786e4-d893-4c02-ae92-279c5fe823fc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:53.269389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b23b34a8-17ce-40e6-a702-58ab295b8215 req-e6894b8f-5066-40a2-80fb-d9de0aaf7ced service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:53.270054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b23b34a8-17ce-40e6-a702-58ab295b8215 req-e6894b8f-5066-40a2-80fb-d9de0aaf7ced service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:53.299456 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b23b34a8-17ce-40e6-a702-58ab295b8215 req-e6894b8f-5066-40a2-80fb-d9de0aaf7ced service nova] Creating event network-vif-plugged:df6786e4-d893-4c02-ae92-279c5fe823fc for instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 on nch1-master-1 Apr 02 21:15:53.307120 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b23b34a8-17ce-40e6-a702-58ab295b8215 req-e6894b8f-5066-40a2-80fb-d9de0aaf7ced service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063449 Apr 02 21:15:53.308225 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2828/5357] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:15:53.707744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:53.708814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:53.723598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:53.724902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:53.726098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:53.728676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:53.820092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:53.826822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:53.834682 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e46baac-dadb-49fb-8aa9-7d1a248600a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.643041 Apr 02 21:15:53.835293 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2530/5358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:53 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:53.835622 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4f95a194-5eef-4559-86e5-d5caca3a2ec5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1280 microversion: 2.1 time: 0.131892 Apr 02 21:15:53.837017 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2829/5359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:53 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:54.861196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:54.861810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:54.862962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:54.863809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:54.891558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:54.894411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:54.898000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:54.898680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:54.900547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:54.901397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:54.902744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:54.905904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:55.342617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:55.360521 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-34c1e96c-8fba-4661-957d-5025b0a54adb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1286 microversion: 2.1 time: 0.509203 Apr 02 21:15:55.361456 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2531/5360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:54 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1286 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:55.553544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:55.564251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c5d5dbc1-1d21-4015-b2b6-d939578c92a4 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1315 microversion: 2.1 time: 0.712968 Apr 02 21:15:55.570478 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2830/5361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:54 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:56.384556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:56.385861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:56.395399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:56.396162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:56.397612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:56.398282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:56.597109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:56.605456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:56.619013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:56.621144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:56.623514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:56.625292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:56.900952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:56.913686 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7b75612-4485-4766-8ddb-e32a2f7b4233 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.539279 Apr 02 21:15:56.914275 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2532/5362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:56 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:57.319035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:57.326959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a926ef56-bea0-4823-aecf-33d208f05f1c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1501 microversion: 2.1 time: 0.741722 Apr 02 21:15:57.331615 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2831/5363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:56 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1501 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:57.348645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:57.349186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:57.369199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:57.369656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:57.370459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:57.370902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:57.542635 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65ce23f3-ad2c-44fd-a126-529ccb185370 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8/action" status: 202 len: 0 microversion: 2.1 time: 0.198246 Apr 02 21:15:57.543392 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2533/5364] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:15:57 2022] POST /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:15:57.553312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:57.554620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:57.565527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:57.567247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:57.571720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:57.572410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:57.933127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:57.934006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:57.951418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:57.951940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:57.953018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:57.953693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:58.417682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:58.431740 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31bdf719-246f-4c42-8df8-4cc547ee626a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.504206 Apr 02 21:15:58.436662 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2534/5365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:57 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:58.661255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:58.671345 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-46c2c589-f4fd-420c-b150-8fdbf5a91810 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1506 microversion: 2.1 time: 1.122822 Apr 02 21:15:58.671948 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2832/5366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:57 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1506 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:15:59.460051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:59.460898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:59.480559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:59.481603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:59.486013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:59.487914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:59.695562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:15:59.696757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:15:59.704704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:59.705990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:59.708255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:59.708932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:59.915124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:15:59.929911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-26147458-293d-45c4-95af-9337c258d982 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.477691 Apr 02 21:15:59.931345 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2535/5367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:59 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:15:59.947738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-01969c94-8787-4ced-8d97-83d4b0208634 req-7da2beb1-3788-4ba4-a8f3-b767de3118e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeae56db-b55b-4c39-8c34-6e06ac357c58", "tag": "bc1ef5d0-0b2d-489a-9af3-c90c36e2c6c9"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:15:59.967709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-01969c94-8787-4ced-8d97-83d4b0208634 req-7da2beb1-3788-4ba4-a8f3-b767de3118e7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:15:59.968676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-01969c94-8787-4ced-8d97-83d4b0208634 req-7da2beb1-3788-4ba4-a8f3-b767de3118e7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:15:59.982697 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-01969c94-8787-4ced-8d97-83d4b0208634 req-7da2beb1-3788-4ba4-a8f3-b767de3118e7 service nova] Creating event network-changed:bc1ef5d0-0b2d-489a-9af3-c90c36e2c6c9 for instance aeae56db-b55b-4c39-8c34-6e06ac357c58 on nch2-master-1 Apr 02 21:16:00.002904 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-01969c94-8787-4ced-8d97-83d4b0208634 req-7da2beb1-3788-4ba4-a8f3-b767de3118e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067352 Apr 02 21:16:00.005267 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2536/5368] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:00.299599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:00.309178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b4b20c13-44ff-4514-8183-19e1d5db5f9a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1486 microversion: 2.1 time: 0.619918 Apr 02 21:16:00.324487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2833/5369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:15:59 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1486 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:00.337337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:00.338424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:00.346257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:00.347197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:00.347969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:00.348568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:00.376641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lazy-loading 'flavor' on Instance uuid 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:16:00.733606 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fcf3ab6f-1c1c-4e5d-8496-21df57642551 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8/action" status: 202 len: 0 microversion: 2.1 time: 0.404197 Apr 02 21:16:00.737713 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2537/5370] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:16:00 2022] POST /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:16:00.756591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:00.758900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:00.789708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:00.796871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:00.799744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:00.800704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:00.951756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:00.952526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:00.960633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:00.961394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:00.962361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:00.962971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:01.237323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:01.246093 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-da4e511c-6eee-4875-9ae2-5e3ecec1c738 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.298550 Apr 02 21:16:01.247256 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2538/5371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:00 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:01.687268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:01.696511 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0031f14-a502-4e49-979e-27b7b8f1df8f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1492 microversion: 2.1 time: 0.957180 Apr 02 21:16:01.710977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2834/5372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:00 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1492 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:02.267034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:02.268916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:02.287303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:02.287999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:02.289036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:02.289638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:02.714719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:02.716126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:02.730390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:02.731038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:02.732160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:02.732797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:02.746528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:02.754873 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4fbc517d-9e33-4261-84e4-eee7a3cb6de6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.494534 Apr 02 21:16:02.760566 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2539/5373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:02 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:03.751077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:03.767094 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6407b07e-1d19-4b16-a9bf-b5200a25fb53 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1513 microversion: 2.1 time: 1.056637 Apr 02 21:16:03.768974 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2835/5374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:02 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1513 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:03.772615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:03.773243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:03.787000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:03.787457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:03.788251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:03.792613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:04.647472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-2033121144-access_point-1879313289", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "43e3ac47-3107-4275-88f5-cd9d12c97ac5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-508642488", "security_groups": [{"name": "tempest-secgroup_access--1385130502"}, {"name": "tempest-secgroup_general--2063870440"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:04.823333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:04.837743 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc8c233d-3423-43c1-bc71-a354c1e8184c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 1.070303 Apr 02 21:16:04.838634 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2540/5375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:03 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:04.851763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:04.853335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:04.872565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:04.873326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:04.874400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:04.876930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:05.153699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] validate_networks() for [('43e3ac47-3107-4275-88f5-cd9d12c97ac5', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:16:05.296908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:05.312238 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-679735c4-3251-4ecc-8fae-5889606c051d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1513 microversion: 2.1 time: 0.472313 Apr 02 21:16:05.313235 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2541/5376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:04 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1513 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:05.858792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:05.860158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:05.885873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:05.887878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:05.889048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:05.889923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:05.917647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:16:05.919198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:16:05.919854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:16:05.922361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:16:05.923041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:16:05.943236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:05.943655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:05.947001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:05.947624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:06.018790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:16:06.044145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for user 986a98734ff4476e83fcfbbf337274ca and project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:16:06.093335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:16:06.095453 ncdv-master-1 devstack@n-api.service[136518]: WARNING nova.utils [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-2033121144-access_point-1879313289 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-2033121144-ac Apr 02 21:16:06.101914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:16:06.191431 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77c3a055-5df6-4d77-86e7-991976a71b24 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.548024 Apr 02 21:16:06.192522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2836/5377] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:16:04 2022] POST /compute/v2.1/servers => generated 458 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:16:06.222169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49d92ecc-07d5-4ced-b27b-5d0db6ab80a9 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:06.222848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49d92ecc-07d5-4ced-b27b-5d0db6ab80a9 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:06.356638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49d92ecc-07d5-4ced-b27b-5d0db6ab80a9 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:06.364362 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49d92ecc-07d5-4ced-b27b-5d0db6ab80a9 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1294 microversion: 2.1 time: 0.160366 Apr 02 21:16:06.365005 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2837/5378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:06 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:06.382652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:06.383276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:06.410387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:06.411233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:06.416137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:06.416869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:06.743182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:06.753971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1882fcf-12e0-4cfd-9932-92b70b31691d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1513 microversion: 2.1 time: 0.374752 Apr 02 21:16:06.757786 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2838/5379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:06 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:07.143484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:07.162763 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55967432-6c64-4577-921c-20354ec3cd9a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 1.309491 Apr 02 21:16:07.165450 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2542/5380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:05 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:07.392723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:07.394470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:07.407235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:07.410330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:07.413787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:07.416773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:07.681461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:07.693335 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0cfe02b7-c596-46ce-800d-99ba1bd2c81f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1290 microversion: 2.1 time: 0.313456 Apr 02 21:16:07.706960 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2839/5381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:07 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1290 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:07.778088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:07.778885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:07.791744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:07.794080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:07.797549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:07.798014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:08.182322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:08.183481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:08.195905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:08.202616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:08.203659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:08.207629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:08.487863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:08.504060 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5783b2a2-367d-4dec-99d1-b76666e17aaa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.730726 Apr 02 21:16:08.522778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2543/5382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:07 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:08.620048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:08.641879 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a04607b-2e18-435d-81d5-8ba9047a6db3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.459620 Apr 02 21:16:08.645371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2840/5383] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:08 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:08.713103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:08.713743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:08.727248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:08.728209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:08.737586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:08.738326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:08.962080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:08.973902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8817a697-8dc4-47ce-aaf2-6c398e9bfd98 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1352 microversion: 2.1 time: 0.265881 Apr 02 21:16:08.977812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2544/5384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:08 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1352 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:09.526194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:09.526744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:09.554874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:09.556201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:09.557264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:09.562089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:09.665351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:09.665981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:09.678876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:09.686260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:09.687183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:09.687834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:10.124808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:10.138086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f69f9286-ae82-43f6-8320-56ea4dcab69e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.616094 Apr 02 21:16:10.140946 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2841/5385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:09 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:10.148104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:10.149022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:10.170433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:10.174787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:10.175844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:10.177180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:10.333285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:10.347230 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d38af5d6-ccac-4188-9b87-f6202c57db17 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1352 microversion: 2.1 time: 0.201493 Apr 02 21:16:10.350392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2842/5386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:10 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1352 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:10.355876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a8871546-73e4-4d79-b114-05140193a2d8 req-e00ff855-384b-4030-af9a-1c34877228a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8", "name": "network-vif-plugged", "status": "completed", "tag": "df6786e4-d893-4c02-ae92-279c5fe823fc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:10.384695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a8871546-73e4-4d79-b114-05140193a2d8 req-e00ff855-384b-4030-af9a-1c34877228a8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:10.385466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a8871546-73e4-4d79-b114-05140193a2d8 req-e00ff855-384b-4030-af9a-1c34877228a8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:10.404740 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a8871546-73e4-4d79-b114-05140193a2d8 req-e00ff855-384b-4030-af9a-1c34877228a8 service nova] Creating event network-vif-plugged:df6786e4-d893-4c02-ae92-279c5fe823fc for instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 on nch1-master-1 Apr 02 21:16:10.420895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:10.422910 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a8871546-73e4-4d79-b114-05140193a2d8 req-e00ff855-384b-4030-af9a-1c34877228a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069069 Apr 02 21:16:10.424293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2843/5387] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:10.448558 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a711d370-e62c-4d4c-876b-aeda582f86e5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.783030 Apr 02 21:16:10.450545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2545/5388] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:09 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:11.161020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:11.164114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:11.183966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:11.188823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:11.190495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:11.193358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:11.370237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:11.373621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:11.399281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:11.400208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:11.404310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:11.405081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:12.234500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:12.263255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfcd8365-3973-4baf-96cb-bf7d57c84015 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 1.109017 Apr 02 21:16:12.264693 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2844/5389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:11 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:12.270369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:12.271147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:12.278554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:12.279327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:12.280336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:12.280997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:12.580251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:12.591698 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e90c3834-4986-49bf-8cb8-6902228afbfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.325553 Apr 02 21:16:12.599908 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2845/5390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:12 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:12.605598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5dc84152-5f59-4c40-8731-9bc1a477d24d req-8fa37085-9f1d-4e22-89d6-b3481b6ea438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeae56db-b55b-4c39-8c34-6e06ac357c58", "name": "network-vif-plugged", "status": "completed", "tag": "bc1ef5d0-0b2d-489a-9af3-c90c36e2c6c9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:12.617362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5dc84152-5f59-4c40-8731-9bc1a477d24d req-8fa37085-9f1d-4e22-89d6-b3481b6ea438 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:12.619101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5dc84152-5f59-4c40-8731-9bc1a477d24d req-8fa37085-9f1d-4e22-89d6-b3481b6ea438 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:12.640696 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5dc84152-5f59-4c40-8731-9bc1a477d24d req-8fa37085-9f1d-4e22-89d6-b3481b6ea438 service nova] Creating event network-vif-plugged:bc1ef5d0-0b2d-489a-9af3-c90c36e2c6c9 for instance aeae56db-b55b-4c39-8c34-6e06ac357c58 on nch2-master-1 Apr 02 21:16:12.648399 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5dc84152-5f59-4c40-8731-9bc1a477d24d req-8fa37085-9f1d-4e22-89d6-b3481b6ea438 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046754 Apr 02 21:16:12.649475 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2846/5391] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:13.282291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:13.284408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:13.299122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:13.305842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:13.306783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:13.307641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:13.371888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:13.383597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-30a7c2c7-ef39-435b-a700-840b52da674d tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 2.022218 Apr 02 21:16:13.394007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2546/5392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:11 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:13.615306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:13.616320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:13.622088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:13.628774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:13.629603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:13.630588 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b2716f62-55e7-41b0-a25e-08f19000af2d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.353427 Apr 02 21:16:13.630936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:13.632029 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2847/5393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:13 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:13.632337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:14.157923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:14.167869 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-000100c8-bff1-462d-a78e-7ee62ca16327 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1328 microversion: 2.1 time: 0.556661 Apr 02 21:16:14.175383 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2547/5394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:13 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1328 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:14.402276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:14.402891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:14.419971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:14.428709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:14.432703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:14.433379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:14.650297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:14.651029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:14.667244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:14.677038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:14.683480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:14.684648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:14.926983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:14.935875 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78af5d56-8710-4891-b3b6-3b438f2ef31f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.537982 Apr 02 21:16:14.959081 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2848/5395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:14 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:15.189257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:15.189762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:15.201243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.203397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.208566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.211424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.504173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:15.513892 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aabee0c8-5cc3-4797-a9ab-ef166f0c5b70 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1509 microversion: 2.1 time: 0.328554 Apr 02 21:16:15.518946 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2849/5396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:15 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:15.542278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:15.543056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:15.555926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.556735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.561328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.561924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.582934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:15.595236 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-780a74c6-7450-42d4-b234-c782a48d25aa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.951263 Apr 02 21:16:15.607000 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2548/5397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:14 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:15.897304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:15.908233 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d35d999e-abf0-4ac0-9219-927c08e61b71 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1509 microversion: 2.1 time: 0.370681 Apr 02 21:16:15.908997 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2850/5398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:15 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:15.924555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:15.926160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:15.952555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.953050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.954036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.954496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.967491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:15.976986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:15.977394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.984737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:15.985999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:15.986628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:16.020498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:16:16.271869 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44ba7bfd-6460-4f40-b3cb-598a46cff3d3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 204 len: 0 microversion: 2.1 time: 0.350378 Apr 02 21:16:16.276010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2549/5399] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:16:15 2022] DELETE /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:16:16.292558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:16.293664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:16.308198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:16.309307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:16.311677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:16.313770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:16.362264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:16.379701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a5f03f8-b47a-4ea5-bd06-eb75b7b3d88b tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.413833 Apr 02 21:16:16.380385 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2851/5400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:15 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:16.613797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:16.614450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:16.628771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:16.645579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:16.645579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:16.645579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:16.985296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:16.994905 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be5630dc-0bc3-43c8-aa23-2a3503d0f77d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.385850 Apr 02 21:16:17.002237 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2852/5401] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:16 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:17.008786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a29186e7-8f7c-4da4-a85d-45934b71e8c3 req-7b2e7834-9975-4774-a651-7bc6f9311873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f816b0b7-9b69-4dab-b07b-539b28950094", "tag": "9721df02-c2e2-4957-a3be-57a586573989"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:17.035514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a29186e7-8f7c-4da4-a85d-45934b71e8c3 req-7b2e7834-9975-4774-a651-7bc6f9311873 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:17.036055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a29186e7-8f7c-4da4-a85d-45934b71e8c3 req-7b2e7834-9975-4774-a651-7bc6f9311873 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:17.053425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a29186e7-8f7c-4da4-a85d-45934b71e8c3 req-7b2e7834-9975-4774-a651-7bc6f9311873 service nova] Creating event network-changed:9721df02-c2e2-4957-a3be-57a586573989 for instance f816b0b7-9b69-4dab-b07b-539b28950094 on nch1-master-1 Apr 02 21:16:17.059701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a29186e7-8f7c-4da4-a85d-45934b71e8c3 req-7b2e7834-9975-4774-a651-7bc6f9311873 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055695 Apr 02 21:16:17.061062 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2853/5402] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:17.397439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:17.398375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:17.414756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:17.415367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:17.418949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:17.419528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:17.678858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:17.690436 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6d64ef4-dc27-4609-ab49-3a0f052afb1f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1515 microversion: 2.1 time: 1.409133 Apr 02 21:16:17.691642 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2550/5403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:16 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1515 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:17.774163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:17.783038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d6a7584-2b68-4729-86cc-a5b830faf2d4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.390622 Apr 02 21:16:17.783921 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2854/5404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:17 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:18.020648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:18.021288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:18.035241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.038048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.040206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.044257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.551330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d6c5d330-203e-4eef-8e36-cb67c8f2967d req-41049369-21b7-476d-adf5-43a8b38819db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeae56db-b55b-4c39-8c34-6e06ac357c58", "name": "network-vif-deleted", "tag": "bc1ef5d0-0b2d-489a-9af3-c90c36e2c6c9"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:18.574707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d6c5d330-203e-4eef-8e36-cb67c8f2967d req-41049369-21b7-476d-adf5-43a8b38819db service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.596199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d6c5d330-203e-4eef-8e36-cb67c8f2967d req-41049369-21b7-476d-adf5-43a8b38819db service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.624178 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d6c5d330-203e-4eef-8e36-cb67c8f2967d req-41049369-21b7-476d-adf5-43a8b38819db service nova] Creating event network-vif-deleted:bc1ef5d0-0b2d-489a-9af3-c90c36e2c6c9 for instance aeae56db-b55b-4c39-8c34-6e06ac357c58 on nch2-master-1 Apr 02 21:16:18.636653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d6c5d330-203e-4eef-8e36-cb67c8f2967d req-41049369-21b7-476d-adf5-43a8b38819db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096873 Apr 02 21:16:18.638403 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2855/5405] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:18.708511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:18.709550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:18.723747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.724399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.727380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.727837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.787034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.788367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.789021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lazy-loading 'fault' on Instance uuid aeae56db-b55b-4c39-8c34-6e06ac357c58 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:16:18.835182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:18.845415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49a09512-7866-4d9a-92c2-cda0710a5bfd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 200 len: 1318 microversion: 2.1 time: 0.141610 Apr 02 21:16:18.855185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2856/5406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:18 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:18.855185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:18.855185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:18.860092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.863501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:18.864647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:18.865357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:19.041908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:19.051590 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5efa9628-e510-4439-8833-d7f0c5b9344b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 1.036860 Apr 02 21:16:19.057288 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2551/5407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:18 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:19.122059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:19.134508 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c7f4081-71f0-434e-a292-ddc13523bfd1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.283778 Apr 02 21:16:19.137740 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2857/5408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:18 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:19.863667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:19.864630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:19.888965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:19.889821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:19.890870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:19.891323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:19.925759 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance aeae56db-b55b-4c39-8c34-6e06ac357c58 could not be found. Apr 02 21:16:19.926671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance aeae56db-b55b-4c39-8c34-6e06ac357c58 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:16:19.927998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f495ec4-bfef-4562-aec8-3c427340335e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 404 len: 111 microversion: 2.1 time: 0.068426 Apr 02 21:16:19.930390 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2552/5409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:19 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:16:19.943532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0588467a-1c70-4935-814f-93ada9c2a7b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '.version_select at 0x7f54d4ad88b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:19.985385 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0588467a-1c70-4935-814f-93ada9c2a7b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-key-576263254" status: 202 len: 0 microversion: 2.1 time: 0.051684 Apr 02 21:16:19.988527 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2858/5410] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Apr 2 21:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-576263254 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:16:20.072524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1042082599", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:20.075270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:20.076390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:20.091196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:20.095895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:20.097006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:20.097480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:20.153774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:16:20.702216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:20.712241 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfdce9ef-5e41-4036-b6aa-2cf1d812018d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.641856 Apr 02 21:16:20.722944 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2859/5411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:20 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:20.730717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:20.731350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:20.746120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:20.746577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:20.747379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:20.747828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:21.465387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:21.480960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8249623e-f9dc-4dd6-ba6f-ac28b19134c0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.756649 Apr 02 21:16:21.481648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2860/5412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:20 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:21.730008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:21.731082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:21.743858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:21.744569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:21.749515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:21.750242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:21.801373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:16:21.803852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:16:21.804695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:16:21.805292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:16:21.805882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:16:21.846626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:21.847294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:21.848803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:21.849583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:21.898008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:16:21.913432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:16:21.943116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:16:21.945993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:16:22.027835 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1cb221f2-d26d-4a32-aba2-9091f40a411a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.959412 Apr 02 21:16:22.029154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2553/5413] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:16:22.045914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-127e80e8-726b-4de3-90cb-3e8d9beb48fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:22.049694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-127e80e8-726b-4de3-90cb-3e8d9beb48fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:22.103021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:22.112192 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f102223-2ca7-4920-aa43-1e41e72ccb84 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.386115 Apr 02 21:16:22.123676 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2861/5414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:21 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:22.236797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-127e80e8-726b-4de3-90cb-3e8d9beb48fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:22.259983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-127e80e8-726b-4de3-90cb-3e8d9beb48fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1209 microversion: 2.1 time: 0.223629 Apr 02 21:16:22.270010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2554/5415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:22 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1209 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:22.499794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:22.499794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:22.511958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:22.513893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:22.514740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:22.515207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:22.843015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:22.862118 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b7b5d83c-3ca0-4852-940b-4d6fd9cbc9ad tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.366939 Apr 02 21:16:22.882168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2862/5416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:22 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:23.130487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:23.131751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:23.163861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:23.170896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:23.172311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:23.173812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:23.278336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:23.280167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:23.290096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:23.290782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:23.291748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:23.292364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:23.490476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:23.502879 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e986d916-44fe-42f3-a848-af51b165905f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.376511 Apr 02 21:16:23.505319 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2555/5417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:23 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:23.697745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:23.712857 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-275e08bc-8fdc-4b57-907c-25462ff1e54a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1261 microversion: 2.1 time: 0.439036 Apr 02 21:16:23.716784 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2863/5418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:23 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1261 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:23.888951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:23.889840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:23.900320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:23.900817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:23.901622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:23.902073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:24.228042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:24.244316 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e45d63e-0943-40a7-96ed-5600773319b0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.359677 Apr 02 21:16:24.258226 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2556/5419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:23 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:24.525855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:24.534292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:24.577380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:24.578398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:24.580892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:24.582246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:24.734876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:24.736420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:24.752172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:24.753618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:24.757507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:24.758218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:24.913760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:24.924170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-40b4f9e6-2c8d-4eea-aaa7-402d3a65cabf tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1267 microversion: 2.1 time: 0.193356 Apr 02 21:16:24.925333 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2557/5420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:24 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:25.263151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:25.266105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:25.281615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:25.285658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:25.286521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:25.286987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:25.428780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:25.437570 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-699da72b-2294-4623-bb10-7809bf9efa01 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.916677 Apr 02 21:16:25.452516 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2864/5421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:24 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:25.629475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:25.639832 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8dd9cdc-5aa7-457a-88e4-3edd3bd47e23 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.379230 Apr 02 21:16:25.651605 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2558/5422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:25 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:25.944131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:25.945269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:25.958684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:25.960002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:25.967557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:25.975063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:26.412202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:26.420221 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56edd7aa-0327-47fb-831a-bb5367c49613 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.482256 Apr 02 21:16:26.428762 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2865/5423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:25 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:26.481109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:26.482808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:26.496663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:26.498833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:26.499774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:26.500466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:26.660867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:26.661564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:26.672677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:26.675346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:26.676197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:26.679587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:26.814337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:26.827385 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-511c4bf2-6873-4c2b-a35c-4137b7c9f3a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.353994 Apr 02 21:16:26.841777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2559/5424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:26 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:27.325307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:27.334752 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-77be902e-9673-46cf-83dc-6177c56c0037 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.680489 Apr 02 21:16:27.341838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2866/5425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:26 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:27.460836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:27.461616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:27.476593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:27.477511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:27.478665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:27.479369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:27.697602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a1b77bea-85c3-45d8-8610-10929d7e2670 req-aa7fbddc-2866-46ba-9df8-507bb9d091f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816b0b7-9b69-4dab-b07b-539b28950094", "name": "network-vif-plugged", "status": "completed", "tag": "9721df02-c2e2-4957-a3be-57a586573989"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:27.714790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:27.724653 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e49abb08-7f6b-48ef-adf4-fb54f7adabfb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.287967 Apr 02 21:16:27.726011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a1b77bea-85c3-45d8-8610-10929d7e2670 req-aa7fbddc-2866-46ba-9df8-507bb9d091f5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:27.727464 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2560/5426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:27 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:27.728107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a1b77bea-85c3-45d8-8610-10929d7e2670 req-aa7fbddc-2866-46ba-9df8-507bb9d091f5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:27.759304 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a1b77bea-85c3-45d8-8610-10929d7e2670 req-aa7fbddc-2866-46ba-9df8-507bb9d091f5 service nova] Creating event network-vif-plugged:9721df02-c2e2-4957-a3be-57a586573989 for instance f816b0b7-9b69-4dab-b07b-539b28950094 on nch1-master-1 Apr 02 21:16:27.770190 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a1b77bea-85c3-45d8-8610-10929d7e2670 req-aa7fbddc-2866-46ba-9df8-507bb9d091f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082025 Apr 02 21:16:27.770817 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2867/5427] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:16:27.854993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:27.855929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:27.873019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:27.873722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:27.874778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:27.875444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:28.007749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1e2faf9e-05b7-404c-99d9-3cb4cfddbabf req-a34133fa-6be8-4867-9ff3-60287ae537f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4747f8-3526-4b56-b80a-4b130933a54d", "tag": "49516587-f70d-491b-9822-ca1c6a6cd7bf"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:28.025747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1e2faf9e-05b7-404c-99d9-3cb4cfddbabf req-a34133fa-6be8-4867-9ff3-60287ae537f3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:28.026520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1e2faf9e-05b7-404c-99d9-3cb4cfddbabf req-a34133fa-6be8-4867-9ff3-60287ae537f3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:28.039457 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1e2faf9e-05b7-404c-99d9-3cb4cfddbabf req-a34133fa-6be8-4867-9ff3-60287ae537f3 service nova] Creating event network-changed:49516587-f70d-491b-9822-ca1c6a6cd7bf for instance 4e4747f8-3526-4b56-b80a-4b130933a54d on nch2-master-1 Apr 02 21:16:28.044653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1e2faf9e-05b7-404c-99d9-3cb4cfddbabf req-a34133fa-6be8-4867-9ff3-60287ae537f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042766 Apr 02 21:16:28.045900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2868/5428] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:16:28.352316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:28.352980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:28.372824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:28.373299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:28.378078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:28.378319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:28.395006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:28.408306 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c719cba9-52b6-44f1-a8e5-db456d358319 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.557621 Apr 02 21:16:28.411261 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2561/5429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:27 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:28.743854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:28.744525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:28.752486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:28.767169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:28.773120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:28.776196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:28.838591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:28.857959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2255458f-185f-48b3-a10e-cebd9fc72679 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1472 microversion: 2.1 time: 0.505423 Apr 02 21:16:28.859575 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2869/5430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:28 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:29.428752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:29.429225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:29.481583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:29.482380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:29.487863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:29.490310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:29.575039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:29.588246 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4cc8be9-aa4d-4c30-9658-9c0ccd488081 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.848305 Apr 02 21:16:29.590321 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2562/5431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:28 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:29.887646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:29.888315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:29.905090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:29.905593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:29.921602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:29.922277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:30.045403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:30.062640 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-889e4722-3e31-4e05-b5bf-882f30855857 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.638588 Apr 02 21:16:30.073102 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2870/5432] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:29 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:30.607390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:30.608447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:30.626669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:30.627533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:30.636155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:30.637079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:30.653784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:30.670160 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fdb65896-351d-4c44-b1d1-182646ae7b5f tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1644 microversion: 2.1 time: 0.794727 Apr 02 21:16:30.670763 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2563/5433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:29 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1644 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:30.693615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:30.704880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:30.713209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:30.713676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:30.714467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:30.715211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:31.088766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:31.097113 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4f6f416-2675-42fe-9708-4c6c460e5805 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.493932 Apr 02 21:16:31.098491 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2871/5434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:30 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:31.112767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:31.113788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:31.124492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:31.125163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:31.126696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:31.127422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:31.169631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:31.178593 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f1287d8-4242-4c8e-aa24-6bb534538188 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1644 microversion: 2.1 time: 0.490635 Apr 02 21:16:31.182378 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2564/5435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:30 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1644 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:31.199305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:31.200174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:31.208075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:31.208801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:31.209755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:31.210359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:31.539084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:31.554856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5eca7b0a-3f72-452a-8f3c-9fc27a9508b7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1508 microversion: 2.1 time: 0.452196 Apr 02 21:16:31.555531 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2872/5436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:31 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:31.870674 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa5368a8-6486-4806-9770-21b603875db9 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1795 microversion: 2.1 time: 0.676030 Apr 02 21:16:31.873860 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2565/5437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:31 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1795 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:32.115405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:32.116026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:32.131228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:32.131691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:32.132509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:32.132963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:32.514840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:32.530273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab5b9105-a76d-4f8a-af3b-ea1ab4eabd93 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.418688 Apr 02 21:16:32.538768 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2873/5438] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:32 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:32.572032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:32.572663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:32.580024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:32.580734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:32.581679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:32.582280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:33.031467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:33.041178 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55ddfeaf-4c59-410d-8250-0e311e180498 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1505 microversion: 2.1 time: 0.472995 Apr 02 21:16:33.049081 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2566/5439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:32 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:33.547639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:33.548392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:33.563980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:33.564445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:33.567925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:33.568385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:34.048031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:34.058679 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a531c5e1-b5cd-4046-85ca-968c332ba6af tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.515139 Apr 02 21:16:34.064715 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2874/5440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:33 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:34.073295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:34.074461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:34.092547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:34.093445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:34.094933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:34.095746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:34.392047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4bb599da-b8ac-4083-8100-af472cadb6a5 req-c3386872-613e-4ae6-a7de-f926b63160da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8", "name": "network-vif-unplugged", "status": "completed", "tag": "df6786e4-d893-4c02-ae92-279c5fe823fc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:34.401124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4bb599da-b8ac-4083-8100-af472cadb6a5 req-c3386872-613e-4ae6-a7de-f926b63160da service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:34.402017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4bb599da-b8ac-4083-8100-af472cadb6a5 req-c3386872-613e-4ae6-a7de-f926b63160da service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:34.408722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:34.416809 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4bb599da-b8ac-4083-8100-af472cadb6a5 req-c3386872-613e-4ae6-a7de-f926b63160da service nova] Creating event network-vif-unplugged:df6786e4-d893-4c02-ae92-279c5fe823fc for instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 on nch1-master-1 Apr 02 21:16:34.420429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-133b19e9-9d66-47b5-a4d6-d32b70160774 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1505 microversion: 2.1 time: 0.355256 Apr 02 21:16:34.423751 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4bb599da-b8ac-4083-8100-af472cadb6a5 req-c3386872-613e-4ae6-a7de-f926b63160da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035479 Apr 02 21:16:34.424888 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2875/5441] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:16:34.434172 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2567/5442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:34 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:35.083603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:35.084394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:35.093194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:35.093717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:35.095133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:35.095590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:35.396616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:35.406357 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0f74acad-8972-41c9-8a7b-26a2e47e4475 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.330739 Apr 02 21:16:35.409185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2876/5443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:35 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:35.442875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:35.443528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:35.487595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:35.488212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:35.489139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:35.490404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:35.822293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-636a8c52-865c-437d-ba1f-d3d103c2d224 req-663007b2-72d4-4b8f-a587-df179fc17d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f816b0b7-9b69-4dab-b07b-539b28950094", "tag": "9721df02-c2e2-4957-a3be-57a586573989"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:35.845844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-636a8c52-865c-437d-ba1f-d3d103c2d224 req-663007b2-72d4-4b8f-a587-df179fc17d3a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:35.846452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-636a8c52-865c-437d-ba1f-d3d103c2d224 req-663007b2-72d4-4b8f-a587-df179fc17d3a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:35.894267 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-636a8c52-865c-437d-ba1f-d3d103c2d224 req-663007b2-72d4-4b8f-a587-df179fc17d3a service nova] Creating event network-changed:9721df02-c2e2-4957-a3be-57a586573989 for instance f816b0b7-9b69-4dab-b07b-539b28950094 on nch1-master-1 Apr 02 21:16:35.909525 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-636a8c52-865c-437d-ba1f-d3d103c2d224 req-663007b2-72d4-4b8f-a587-df179fc17d3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092093 Apr 02 21:16:35.915778 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2877/5444] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:16:36.430499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:36.432143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:36.447701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:36.448479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:36.450820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:36.455045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:36.650252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:36.661992 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e782745-8194-4bb0-a08c-e53efdca55e0 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1505 microversion: 2.1 time: 1.226438 Apr 02 21:16:36.673439 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2568/5445] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:35 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1505 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:36.674579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-966cbad6-b9c1-4983-bbe3-2554fe3f6fe6 req-1fe97b77-0eba-4f9a-a97b-35a098bb3a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4747f8-3526-4b56-b80a-4b130933a54d", "name": "network-vif-plugged", "status": "completed", "tag": "49516587-f70d-491b-9822-ca1c6a6cd7bf"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:36.693628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-966cbad6-b9c1-4983-bbe3-2554fe3f6fe6 req-1fe97b77-0eba-4f9a-a97b-35a098bb3a0f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:36.694094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-966cbad6-b9c1-4983-bbe3-2554fe3f6fe6 req-1fe97b77-0eba-4f9a-a97b-35a098bb3a0f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:36.726994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-966cbad6-b9c1-4983-bbe3-2554fe3f6fe6 req-1fe97b77-0eba-4f9a-a97b-35a098bb3a0f service nova] Creating event network-vif-plugged:49516587-f70d-491b-9822-ca1c6a6cd7bf for instance 4e4747f8-3526-4b56-b80a-4b130933a54d on nch2-master-1 Apr 02 21:16:36.740253 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-966cbad6-b9c1-4983-bbe3-2554fe3f6fe6 req-1fe97b77-0eba-4f9a-a97b-35a098bb3a0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073798 Apr 02 21:16:36.740927 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2569/5446] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:37.326874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:37.337278 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cfe54852-fff3-4e9d-9a8f-0d0c35232a57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.912311 Apr 02 21:16:37.341770 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2878/5447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:36 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:37.682535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:37.683380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:37.691236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:37.691706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:37.692533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:37.692995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.171288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:38.179204 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-58b5f831-a98d-4e9f-a107-43d489a4601d tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 200 len: 1448 microversion: 2.1 time: 0.502294 Apr 02 21:16:38.179790 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2570/5448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:37 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 1448 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:38.196242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:38.196939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:38.204534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.204988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.205762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.206200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.353667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:38.354599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:38.360752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:38.361354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.361994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.362942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.363541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.369269 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cb594c34-a9cf-49c8-8cf1-19249dc162a5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.176952 Apr 02 21:16:38.370198 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2879/5449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:38.393716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:38.394514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:38.401186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.401972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.406163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.406651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.551129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:38.559512 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10dc5bd3-ce0e-4ce0-b872-cd710f90f469 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.171146 Apr 02 21:16:38.560041 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2880/5450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:38.582609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:38.583755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:38.591232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.592018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.593058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:38.593697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:38.730236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:38.739770 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-53ba9087-d223-4a16-8dbf-aaaa7496b171 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1309 microversion: 2.1 time: 0.389996 Apr 02 21:16:38.740367 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2571/5451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:38 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:39.037952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:39.046719 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a43b866-19ef-48cf-a19d-a163eec6578b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.474309 Apr 02 21:16:39.048775 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2881/5452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:38 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:39.063914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:39.064558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:39.080791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.081518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:39.082490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.083095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:39.325116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:39.353598 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-18b9b8aa-b27d-415a-982e-d24b5f4bb880 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.293420 Apr 02 21:16:39.374440 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2572/5453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:39 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:39.379533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a42dc38e-f84d-43ba-9e98-53847db8d0c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:39.386801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a42dc38e-f84d-43ba-9e98-53847db8d0c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.387262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a42dc38e-f84d-43ba-9e98-53847db8d0c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:39.412827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a42dc38e-f84d-43ba-9e98-53847db8d0c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Going to try to stop instance {{(pid=136518) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:16:39.477846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a42dc38e-f84d-43ba-9e98-53847db8d0c9 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.101566 Apr 02 21:16:39.482310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2882/5454] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:16:39 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:16:39.489941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:39.490874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:39.501513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.502230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:39.503463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.504120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:39.757750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:39.759298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:39.766786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.767883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:39.768780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:39.769236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:40.013102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:40.022300 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-37d063ec-6f55-4fc6-8ce0-9b08825f6af4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1491 microversion: 2.1 time: 0.268945 Apr 02 21:16:40.023671 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2883/5455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:39 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1491 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:40.059231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:40.073103 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3ff2a4d-fed3-4d1a-9fad-38f5ad6d78eb tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.589889 Apr 02 21:16:40.079385 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2573/5456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:39 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:40.109189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1042082599", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:40.173516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:16:41.092787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:41.093407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:41.104003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:41.104821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:41.105842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:41.106491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:41.142320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:16:41.143041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:16:41.143536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:16:41.143952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:16:41.144370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:16:41.165032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:41.165492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:41.166311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:41.166759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:41.211748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:16:41.219039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:16:41.238167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:16:41.241593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:16:41.330394 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2fa4fd91-0a4f-4c5a-9571-13d3839f273e tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226238 Apr 02 21:16:41.341902 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2884/5457] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:16:41.356447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-15554aa3-8f59-436c-b589-5bdc51ec581a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:41.359115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-15554aa3-8f59-436c-b589-5bdc51ec581a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:41.419510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:41.433901 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-77e7c504-49da-47ca-81e1-2f4766735f76 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.345140 Apr 02 21:16:41.434511 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2574/5458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:41 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:41.513088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-15554aa3-8f59-436c-b589-5bdc51ec581a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:41.530632 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-15554aa3-8f59-436c-b589-5bdc51ec581a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1209 microversion: 2.1 time: 0.183470 Apr 02 21:16:41.533932 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2885/5459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:41 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1209 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:42.451155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:42.451786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:42.461437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:42.462145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:42.463310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:42.463918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:42.560852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:42.563496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:42.577088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:42.582472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:42.583736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:42.585049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:42.758074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:42.779982 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad914f94-79c1-413f-b8ed-7cf881fb4252 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1269 microversion: 2.1 time: 0.232451 Apr 02 21:16:42.795298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2886/5460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:42 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1269 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:43.233550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:43.243430 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ac94da0-3199-40c2-8858-2801167d4d94 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.796075 Apr 02 21:16:43.244030 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2575/5461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:42 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:43.799603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:43.800238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:43.807765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:43.820483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:43.821795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:43.822570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:44.261362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:44.262682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:44.270591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:44.271148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:44.271999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:44.272767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:44.557817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:44.569614 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7097aba8-c747-44ac-9876-b315d0311200 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.312221 Apr 02 21:16:44.570401 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2576/5462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:44 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:44.622344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:44.634868 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5ae9e39e-d770-44e3-a5a0-93b1aa2152e1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.839194 Apr 02 21:16:44.636208 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2887/5463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:43 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:45.540927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-95429afc-5cea-430a-a6e4-a78c3d62e8ca req-d37bcc6b-24b9-47b1-8fed-2132ac744527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b096d4a-2acb-43b8-a508-f3c6516021a7", "tag": "c8296092-bf50-473d-b19c-ff200d218ef3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:45.577653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-95429afc-5cea-430a-a6e4-a78c3d62e8ca req-d37bcc6b-24b9-47b1-8fed-2132ac744527 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:45.578157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-95429afc-5cea-430a-a6e4-a78c3d62e8ca req-d37bcc6b-24b9-47b1-8fed-2132ac744527 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:45.588115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:45.588773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:45.599199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:45.603132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:45.604189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:45.604787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:45.608623 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-95429afc-5cea-430a-a6e4-a78c3d62e8ca req-d37bcc6b-24b9-47b1-8fed-2132ac744527 service nova] Creating event network-changed:c8296092-bf50-473d-b19c-ff200d218ef3 for instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 on nch2-master-1 Apr 02 21:16:45.620086 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-95429afc-5cea-430a-a6e4-a78c3d62e8ca req-d37bcc6b-24b9-47b1-8fed-2132ac744527 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093198 Apr 02 21:16:45.621427 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2577/5464] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:45.654052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:45.655004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:45.662501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:45.663378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:45.664323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:45.664962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:45.974529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:45.984845 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a52cc876-5d20-4003-85ea-670919eccf8e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.401402 Apr 02 21:16:45.985441 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2888/5465] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:45 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:46.028017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:46.036723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ab71a9c-a3ba-45f4-8e9f-a776116a6e0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.387181 Apr 02 21:16:46.037459 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2578/5466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:45 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:47.025478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:47.026397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:47.038488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:47.039257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:47.040158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:47.040735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:47.054230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:47.054955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:47.062117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:47.062579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:47.063423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:47.063872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:47.209973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:47.224437 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e86227d1-b9dd-4021-a4b8-754ba4e4a9e1 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.222290 Apr 02 21:16:47.227001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2889/5467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:47 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:47.724098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:47.732251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8f5b894-7174-43ea-90ed-79267234f72f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.682164 Apr 02 21:16:47.732925 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2579/5468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:47 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:48.243128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:48.244044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:48.250695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:48.251161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:48.252036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:48.252512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:48.484986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:48.494313 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1cf9f8d4-47de-4b18-9fe6-7c8e3dc82e6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.254818 Apr 02 21:16:48.495435 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2890/5469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:48 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:48.753316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:48.755050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:48.768984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:48.770491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:48.771878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:48.773039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:49.039560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:49.052852 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e023f44-57fa-49a5-a51d-f0a0a98c3704 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.307000 Apr 02 21:16:49.053631 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2580/5470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:48 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:49.522144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:49.526773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:49.538778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:49.540142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:49.541309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:49.543870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:49.773239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:49.781109 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79fbd710-ff3f-489f-93b9-767786a4fe6e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1678 microversion: 2.1 time: 0.271578 Apr 02 21:16:49.791880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2891/5471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:49 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:50.072929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:50.074246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:50.104284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:50.105105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:50.108491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:50.109293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:50.465525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:50.473076 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f18afe8-e77e-439b-8403-32cf10080115 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.406223 Apr 02 21:16:50.473679 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2581/5472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:50 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:50.799519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:50.799957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:50.814193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:50.814678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:50.817657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:50.818155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:51.067654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:51.077581 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d275a3f-37c2-4863-a6e7-1f9bc1c02dea tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1655 microversion: 2.1 time: 0.282032 Apr 02 21:16:51.079483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2892/5473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:50 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1655 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:51.100672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-099294a2-9b9b-4811-a560-549f290ce8ca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:51.108704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-099294a2-9b9b-4811-a560-549f290ce8ca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:51.118883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-099294a2-9b9b-4811-a560-549f290ce8ca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:51.178226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-099294a2-9b9b-4811-a560-549f290ce8ca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Going to try to start instance {{(pid=136517) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:16:51.249092 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-099294a2-9b9b-4811-a560-549f290ce8ca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.154204 Apr 02 21:16:51.251415 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2582/5474] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:16:51 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:16:51.259461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:51.260316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:51.270598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:51.271581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:51.274927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:51.276784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:51.493882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:51.494719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:51.504313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:51.505030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:51.505905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:51.506453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:51.578890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:51.591765 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d058981-845c-4056-8201-463b37bac31c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1664 microversion: 2.1 time: 0.336225 Apr 02 21:16:51.593589 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2893/5475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:51 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1664 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:52.000189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:52.015385 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efe8ea6f-ee3a-425f-ac9a-f079df6691ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.527907 Apr 02 21:16:52.017014 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2583/5476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:51 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:52.611060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:52.611846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:52.621207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:52.622325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:52.623441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:52.624347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:52.945301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:52.966080 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-82aff144-b34a-47da-ac5c-78332e4f5a31 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1664 microversion: 2.1 time: 0.358403 Apr 02 21:16:52.968224 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2894/5477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:52 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1664 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:53.032849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:53.034037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:53.042614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:53.043772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:53.050072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:53.053532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:53.517258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:53.533098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3ade42b-1e8d-40e6-968f-5bc4bb4afbf3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.504416 Apr 02 21:16:53.534843 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2584/5478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:53 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:53.959386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a4046dda-bf0c-45b5-9745-2ae676215a45 req-d594f434-3aae-48ab-b6b7-1aaa36c7fc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b096d4a-2acb-43b8-a508-f3c6516021a7", "name": "network-vif-plugged", "status": "completed", "tag": "c8296092-bf50-473d-b19c-ff200d218ef3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:53.972015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a4046dda-bf0c-45b5-9745-2ae676215a45 req-d594f434-3aae-48ab-b6b7-1aaa36c7fc2f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:53.972722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a4046dda-bf0c-45b5-9745-2ae676215a45 req-d594f434-3aae-48ab-b6b7-1aaa36c7fc2f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:53.989751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:53.990558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:53.997449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:54.006257 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a4046dda-bf0c-45b5-9745-2ae676215a45 req-d594f434-3aae-48ab-b6b7-1aaa36c7fc2f service nova] Creating event network-vif-plugged:c8296092-bf50-473d-b19c-ff200d218ef3 for instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 on nch2-master-1 Apr 02 21:16:54.013262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:54.014123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:54.016821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a4046dda-bf0c-45b5-9745-2ae676215a45 req-d594f434-3aae-48ab-b6b7-1aaa36c7fc2f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062063 Apr 02 21:16:54.018215 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2895/5479] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:16:54.018990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:54.310666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:54.324325 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a6f83bd-5166-48a9-9f7d-7a4e19ace6bc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.339620 Apr 02 21:16:54.325269 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2585/5480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:53 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:54.342584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:54.343204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:54.350748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:54.351497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:54.352502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:54.353109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:54.550973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:54.553173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:54.572267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:54.576212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:54.577517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:54.579489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:54.780422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:54.790567 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dda1df20-d39b-4020-87ee-8e70cf0e05ed tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1309 microversion: 2.1 time: 0.244116 Apr 02 21:16:54.791479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2586/5481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:54 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:55.233851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:55.243564 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cffdc53f-ed1e-45fc-95a8-57abca8df221 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.905246 Apr 02 21:16:55.245256 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2896/5482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:54 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:55.264836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:55.266001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:55.273131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.273857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.275033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.275641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.500931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:55.509665 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-148f97e3-0a77-4357-8b46-891403d60f4a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.248674 Apr 02 21:16:55.511306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2587/5483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:55 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:55.531552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:55.534972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:55.542402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.542864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.552531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.553228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.808284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:55.809283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:55.818479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.819612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.820694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.821954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.920160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:55.931384 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33aef070-1de3-4430-8c79-5189097c2fca tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.404947 Apr 02 21:16:55.932610 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2897/5484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:55 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:55.948426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:55.949326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:55.956080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.956565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:55.957524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:55.958130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.022407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:56.030423 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7fe990c8-1c0c-4bab-a592-5256211d000b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1490 microversion: 2.1 time: 0.226647 Apr 02 21:16:56.031541 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2588/5485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:55 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1490 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:56.046493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:56.047895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:56.054329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.054788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.055556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.056162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.212587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:56.221512 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b90c531a-ec10-47dd-b674-e1d884956f6a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1491 microversion: 2.1 time: 0.178733 Apr 02 21:16:56.222443 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2589/5486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:56 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1491 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:56.240089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:56.241280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:56.248052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.248658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.250799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.250799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.256956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:56.269412 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2ed741a-31a0-4094-8669-5830535c2466 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.324324 Apr 02 21:16:56.281704 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2898/5487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:55 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:56.287031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:56.287590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:56.294225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.294696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.295495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.295946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.333022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lazy-loading 'flavor' on Instance uuid 0a31e29c-ab4b-4383-a315-70c35db9708c {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:16:56.427156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6870c203-a953-4595-b4a9-b9f28e8341e3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.142660 Apr 02 21:16:56.428591 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2899/5488] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:16:56 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:16:56.462621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:56.464712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:56.470780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:56.484761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d3ccff1-7c0c-4d5c-856c-b28a1df481f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1490 microversion: 2.1 time: 0.249894 Apr 02 21:16:56.488054 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2590/5489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:56 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1490 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:56.490318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.491444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.492755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.493577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.505357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:56.506690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:56.514960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.515697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.516690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.517927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.559883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:16:56.686931 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2580114-235e-41ac-a916-7f3f687897be tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 204 len: 0 microversion: 2.1 time: 0.185621 Apr 02 21:16:56.687874 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2591/5490] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:16:56 2022] DELETE /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:16:56.698022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:56.698983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:56.707150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.707670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.708557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:56.708958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:56.799001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:56.809732 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f61fc6b1-4514-43e9-9185-9aaa935f4bbe tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1676 microversion: 2.1 time: 0.363509 Apr 02 21:16:56.810566 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2900/5491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:56 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1676 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:56.937708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:56.947137 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-242399e3-253d-4d7a-a519-6d9bb822e47f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1496 microversion: 2.1 time: 0.253081 Apr 02 21:16:56.948474 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2592/5492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:56 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1496 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:57.830239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:57.831767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:57.840986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:57.841957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:57.843784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:57.844565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:57.965732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:57.967102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:57.974664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:57.975378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:57.976163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:57.976796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:58.253304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:58.262898 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f214954-5e15-47b4-90e8-a0c65e190dc9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1496 microversion: 2.1 time: 0.301529 Apr 02 21:16:58.266647 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2593/5493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:57 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1496 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:58.363688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:58.374124 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48fcc02a-7b2e-42f0-8ff4-893edb008536 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1659 microversion: 2.1 time: 0.550329 Apr 02 21:16:58.386450 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2901/5494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:57 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1659 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:58.392578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:58.393372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:58.400363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:58.401030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:58.402086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:58.403053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:58.527663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a13580c1-a676-4ff4-9acf-109c2305e57c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action" status: 202 len: 0 microversion: 2.1 time: 0.138802 Apr 02 21:16:58.533777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2594/5495] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:16:58 2022] POST /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:16:58.555278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:58.559735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:58.571807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:58.572934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:58.575013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:58.575672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:58.896249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:58.912151 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-04a90015-d218-4edb-8d1d-21aeb2dae96b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1665 microversion: 2.1 time: 0.375673 Apr 02 21:16:58.938559 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2902/5496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:58 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1665 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:16:59.004573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f7c6354e-d3bb-4cbd-af42-6f59797f82ea req-08d6d528-0e5b-4433-9594-b73f5090f704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b096d4a-2acb-43b8-a508-f3c6516021a7", "name": "network-vif-deleted", "tag": "c8296092-bf50-473d-b19c-ff200d218ef3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:16:59.024247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7c6354e-d3bb-4cbd-af42-6f59797f82ea req-08d6d528-0e5b-4433-9594-b73f5090f704 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.024662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f7c6354e-d3bb-4cbd-af42-6f59797f82ea req-08d6d528-0e5b-4433-9594-b73f5090f704 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.039863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f7c6354e-d3bb-4cbd-af42-6f59797f82ea req-08d6d528-0e5b-4433-9594-b73f5090f704 service nova] Creating event network-vif-deleted:c8296092-bf50-473d-b19c-ff200d218ef3 for instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 on nch2-master-1 Apr 02 21:16:59.050182 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f7c6354e-d3bb-4cbd-af42-6f59797f82ea req-08d6d528-0e5b-4433-9594-b73f5090f704 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049436 Apr 02 21:16:59.051778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2595/5497] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:16:59.281736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:59.282559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:59.290132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.290598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.291429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.291891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.327243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.328559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.329193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lazy-loading 'fault' on Instance uuid 0b096d4a-2acb-43b8-a508-f3c6516021a7 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:16:59.376142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:16:59.387810 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5f1d5f5-7dec-4c22-a627-fa5ea5ae8a0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 200 len: 1299 microversion: 2.1 time: 0.110328 Apr 02 21:16:59.390836 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2903/5498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:59 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:16:59.794112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:59.795643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:59.804826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.805567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.806496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.807040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.903972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lazy-loading 'services' on Instance uuid 3e8a56c3-afa0-4089-be5b-a45a7dbea62b {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:16:59.930240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:16:59.931047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:16:59.939020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.939760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:16:59.940815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:16:59.941487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:00.038832 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f0779f0-b014-4721-879b-84a4e10e0166 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b/os-volume_attachments/8fe875f0-142e-4db8-8a87-f78692047798" status: 202 len: 0 microversion: 2.1 time: 0.248988 Apr 02 21:17:00.042533 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2596/5499] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:16:59 2022] DELETE /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b/os-volume_attachments/8fe875f0-142e-4db8-8a87-f78692047798 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:17:00.247202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:00.259079 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8567c11-9ad4-4127-b656-d106cc81d17f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1665 microversion: 2.1 time: 0.333046 Apr 02 21:17:00.259925 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2904/5500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:16:59 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1665 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:00.413664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:00.414259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:00.426657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:00.427559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:00.428602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:00.429385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:00.457085 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 could not be found. Apr 02 21:17:00.457987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:00.461661 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2aeeed2-5524-4ce4-be39-e343ce7e40bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 404 len: 111 microversion: 2.1 time: 0.058475 Apr 02 21:17:00.463763 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2597/5501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:00 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:00.472088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:00.472718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:00.488675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:00.490202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:00.491383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:00.492558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:00.544210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:00.706714 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1756c4e2-5ae2-479d-bc6f-941651cede64 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 204 len: 0 microversion: 2.1 time: 0.239418 Apr 02 21:17:00.707381 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2905/5502] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:00 2022] DELETE /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:00.716314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:00.717224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:00.723637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:00.724299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:00.725292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:00.725909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.059806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:01.069035 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39516984-9d5e-49d3-9c3d-3a87fd53e76f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1497 microversion: 2.1 time: 0.356874 Apr 02 21:17:01.070224 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2598/5503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:00 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:01.275482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:01.276244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:01.278324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:01.279535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:01.292288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:01.293806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.294870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:01.295637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.297675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:01.298167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.302332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:01.302990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.372797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:01.534672 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16f4f65b-9ea1-4be4-8e2b-b73af3a31c84 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 204 len: 0 microversion: 2.1 time: 0.280934 Apr 02 21:17:01.535299 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2906/5504] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:01 2022] DELETE /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:01.552541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:01.557615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:01.569188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:01.569909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.571753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:01.572410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:01.638330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:01.651087 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f024283-3740-43b9-9138-e1f4bda51ffa tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1665 microversion: 2.1 time: 0.373326 Apr 02 21:17:01.652046 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2599/5505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:01 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1665 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:01.872712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:01.883669 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad48be1a-d6d5-41af-b225-8dffb57335f6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1515 microversion: 2.1 time: 0.343206 Apr 02 21:17:01.884348 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2907/5506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:01 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:02.087017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:02.088230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:02.095660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.096114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.096917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.097359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.543889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:02.552417 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76a17af3-4eb5-4e0d-8403-ca692240ff73 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1497 microversion: 2.1 time: 0.469249 Apr 02 21:17:02.553144 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2600/5507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:02 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1497 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:02.669145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:02.669770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:02.678161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.678617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.679411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.679859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.827069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:02.837045 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9fa73f3-7e07-48df-aa51-12d6dd0d6d38 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.171780 Apr 02 21:17:02.837928 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2908/5508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:02 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:02.855512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:02.856147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:02.863086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.863734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.864597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.865350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.903609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:02.904238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:02.910609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.911159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:02.911953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:02.912397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:03.055924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:03.063729 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9df6ecc0-1d9a-451a-a76e-76601273c641 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1515 microversion: 2.1 time: 0.166044 Apr 02 21:17:03.064325 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2909/5509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:02 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:03.451463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:03.460688 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e27cdd80-df20-4d19-a41e-3d3245d49b6b tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1668 microversion: 2.1 time: 0.610252 Apr 02 21:17:03.461275 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2601/5510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:02 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1668 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:03.478663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:03.479167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:03.485292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:03.485753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:03.486537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:03.487638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:03.511279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:03.517709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Working on deleting snapshot 46dda4d0-58cb-484b-ba99-d9f71254b57f from shelved instance... Apr 02 21:17:03.571781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:03.572664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:03.591789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:03.592242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:03.595429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:03.596053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:04.068211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:04.084207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b1c0b6f3-3d6d-4358-8861-4aeabd3df192 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 200 len: 1497 microversion: 2.1 time: 0.517946 Apr 02 21:17:04.085730 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2602/5511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:03 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 1497 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:04.095646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:04.096562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:04.114529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:04.121187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:04.125894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:04.126587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:04.292193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Doing local delete in cell 7db0541f-0b31-4938-8529-5d83d9e68243(cell1) {{(pid=136518) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 02 21:17:04.293300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:04.294003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:04.294681 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 02 21:17:04.299474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] deallocate_for_instance() {{(pid=136518) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 02 21:17:04.521552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:04.530186 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fd63d9de-2a51-4d3a-a79e-351ba5bbc870 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 200 len: 1515 microversion: 2.1 time: 0.442821 Apr 02 21:17:04.540610 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2603/5512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:04 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 1515 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:04.546168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-06f7f216-056b-4acf-bf9f-4097730d08b0 req-93028c25-6555-42ab-acc7-f9f5c9cfa60b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4747f8-3526-4b56-b80a-4b130933a54d", "name": "network-vif-deleted", "tag": "49516587-f70d-491b-9822-ca1c6a6cd7bf"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:04.555417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-06f7f216-056b-4acf-bf9f-4097730d08b0 req-93028c25-6555-42ab-acc7-f9f5c9cfa60b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:04.556179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-06f7f216-056b-4acf-bf9f-4097730d08b0 req-93028c25-6555-42ab-acc7-f9f5c9cfa60b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:04.568930 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-06f7f216-056b-4acf-bf9f-4097730d08b0 req-93028c25-6555-42ab-acc7-f9f5c9cfa60b service nova] Creating event network-vif-deleted:49516587-f70d-491b-9822-ca1c6a6cd7bf for instance 4e4747f8-3526-4b56-b80a-4b130933a54d on nch2-master-1 Apr 02 21:17:04.575368 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-06f7f216-056b-4acf-bf9f-4097730d08b0 req-93028c25-6555-42ab-acc7-f9f5c9cfa60b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Apr 02 21:17:04.576497 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2604/5513] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:05.103115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:05.103995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:05.119310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.119310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.120053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.120518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.149841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 4e4747f8-3526-4b56-b80a-4b130933a54d could not be found. Apr 02 21:17:05.153233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 4e4747f8-3526-4b56-b80a-4b130933a54d could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:05.158765 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b6a9f84e-9c71-483a-86f0-ea7789c7c161 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 404 len: 111 microversion: 2.1 time: 0.058638 Apr 02 21:17:05.159603 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2605/5514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:05 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:17:05.323581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-134567263", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:05.430358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:17:05.570545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Updating instance_info_cache with network_info: [] {{(pid=136518) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 02 21:17:05.808434 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e16433f9-9a40-4457-880f-f132c61f1db3 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 204 len: 0 microversion: 2.1 time: 2.333540 Apr 02 21:17:05.809280 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2910/5515] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:03 2022] DELETE /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 0 bytes in 2335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:05.817129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:05.817752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3e8a56c3-afa0-4089-be5b-a45a7dbea62b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:05.824053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.824539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.825497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.826097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.841263 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] HTTP exception thrown: Instance 3e8a56c3-afa0-4089-be5b-a45a7dbea62b could not be found. Apr 02 21:17:05.842121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Returning 404 to user: Instance 3e8a56c3-afa0-4089-be5b-a45a7dbea62b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:05.843960 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8b333c7-7db0-4639-8d9b-454afc1a8405 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b" status: 404 len: 111 microversion: 2.1 time: 0.030255 Apr 02 21:17:05.845106 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2911/5516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:05 2022] GET /compute/v2.1/servers/3e8a56c3-afa0-4089-be5b-a45a7dbea62b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:05.851250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-cbbca27f-f6f7-4a20-b43f-22ea1ff17c5b req-1f74581d-d159-4b3c-81f7-84e3ded373c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8", "name": "network-vif-deleted", "tag": "df6786e4-d893-4c02-ae92-279c5fe823fc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:05.878438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cbbca27f-f6f7-4a20-b43f-22ea1ff17c5b req-1f74581d-d159-4b3c-81f7-84e3ded373c6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.879068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cbbca27f-f6f7-4a20-b43f-22ea1ff17c5b req-1f74581d-d159-4b3c-81f7-84e3ded373c6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.893965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_external_events [req-cbbca27f-f6f7-4a20-b43f-22ea1ff17c5b req-1f74581d-d159-4b3c-81f7-84e3ded373c6 service nova] Unable to find a host for instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8. Dropping event network-vif-deleted {{(pid=136518) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 02 21:17:05.895263 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-cbbca27f-f6f7-4a20-b43f-22ea1ff17c5b req-1f74581d-d159-4b3c-81f7-84e3ded373c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049004 Apr 02 21:17:05.896320 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2912/5517] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 02 21:17:05.900987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:05.901914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:05.909798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.910525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.911478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.912077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.930941 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] HTTP exception thrown: Instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 could not be found. Apr 02 21:17:05.931933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Returning 404 to user: Instance 76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:05.933254 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f0cb49b5-0c9d-43df-b2a6-e6f6559286e8 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8" status: 404 len: 111 microversion: 2.1 time: 0.035835 Apr 02 21:17:05.934909 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2913/5518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:05 2022] GET /compute/v2.1/servers/76eddfd3-3de5-4778-b1d3-fd2ce95ccbd8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:05.943493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:05.943999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:05.951406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.951862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.954028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:05.954476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:05.999588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:06.200559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6f1ae81a-bf4b-401f-8dd3-e8e2287e4406 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 204 len: 0 microversion: 2.1 time: 0.260164 Apr 02 21:17:06.202464 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2914/5519] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:05 2022] DELETE /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:17:06.213713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:06.214891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:06.240087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:06.241064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:06.241892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:06.242341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:06.433669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:06.444185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-88030109-ec3f-48d2-adff-86c203f1ceb2 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1465 microversion: 2.1 time: 0.237002 Apr 02 21:17:06.446210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2915/5520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:06 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1465 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:06.599612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-af638c16-3bd5-4629-89bf-38c25ba76456 req-89626777-b4d9-443f-aa0e-e7d6c8cb202d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8a56c3-afa0-4089-be5b-a45a7dbea62b", "name": "network-vif-deleted", "tag": "6bd2b363-0b40-48fc-a62c-c4ba112f7195"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:06.616743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:17:06.618594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:17:06.619352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:17:06.620104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:17:06.620743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:17:06.643032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-af638c16-3bd5-4629-89bf-38c25ba76456 req-89626777-b4d9-443f-aa0e-e7d6c8cb202d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:06.646106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-af638c16-3bd5-4629-89bf-38c25ba76456 req-89626777-b4d9-443f-aa0e-e7d6c8cb202d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:06.649402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:06.659075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:06.661001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:06.664847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:06.670236 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-af638c16-3bd5-4629-89bf-38c25ba76456 req-89626777-b4d9-443f-aa0e-e7d6c8cb202d service nova] Creating event network-vif-deleted:6bd2b363-0b40-48fc-a62c-c4ba112f7195 for instance 3e8a56c3-afa0-4089-be5b-a45a7dbea62b on nch1-master-1 Apr 02 21:17:06.678169 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-af638c16-3bd5-4629-89bf-38c25ba76456 req-89626777-b4d9-443f-aa0e-e7d6c8cb202d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082170 Apr 02 21:17:06.679414 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2916/5521] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:17:06.715434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:17:06.733492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:17:06.771916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:17:06.774362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:17:06.901263 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c91075e-9fc5-472b-a84d-ee82a029f7fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581499 Apr 02 21:17:06.909205 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2606/5522] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:17:06.917825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4e2a0b3-0ca5-4c2e-a237-a2f520ec9de8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:06.918601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4e2a0b3-0ca5-4c2e-a237-a2f520ec9de8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:07.071927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4e2a0b3-0ca5-4c2e-a237-a2f520ec9de8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:07.085030 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4e2a0b3-0ca5-4c2e-a237-a2f520ec9de8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1208 microversion: 2.1 time: 0.173351 Apr 02 21:17:07.085719 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2917/5523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:06 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:07.466076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:07.466886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:07.487164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:07.490852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:07.494325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:07.498714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:08.077184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:08.090819 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0bf05261-5247-4a06-8271-02eae36240cf tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1465 microversion: 2.1 time: 0.629730 Apr 02 21:17:08.111106 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2607/5524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:07 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1465 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:08.112870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:08.113479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:08.122373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:08.123434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:08.125150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:08.126485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:08.194127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:08.202477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ed2ab16-9e20-467d-aa0e-fdcedfdeea7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1260 microversion: 2.1 time: 0.102942 Apr 02 21:17:08.203335 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2918/5525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:08 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1260 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:09.130464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:09.134348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:09.156417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:09.156922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:09.157704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:09.158857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:09.237564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:09.238989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:09.302160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:09.305207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:09.306499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:09.310955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:09.799458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:09.817000 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c581bc87-4aab-47c1-981f-29950a938fea tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.599296 Apr 02 21:17:09.821349 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2919/5526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:09 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:09.838575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0dd8f2ef-a473-4a2d-9af3-ca1aacbea817 req-54672bba-9b40-4259-92da-6d71952f85e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d9530c-b3bf-45b7-9ccd-97479fa1cb08", "name": "network-vif-deleted", "tag": "97ef2fec-e36f-410f-8236-562ad8528080"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:09.850681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0dd8f2ef-a473-4a2d-9af3-ca1aacbea817 req-54672bba-9b40-4259-92da-6d71952f85e2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:09.853319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0dd8f2ef-a473-4a2d-9af3-ca1aacbea817 req-54672bba-9b40-4259-92da-6d71952f85e2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:09.874165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0dd8f2ef-a473-4a2d-9af3-ca1aacbea817 req-54672bba-9b40-4259-92da-6d71952f85e2 service nova] Creating event network-vif-deleted:97ef2fec-e36f-410f-8236-562ad8528080 for instance f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 on nch1-master-1 Apr 02 21:17:09.886128 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0dd8f2ef-a473-4a2d-9af3-ca1aacbea817 req-54672bba-9b40-4259-92da-6d71952f85e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063503 Apr 02 21:17:09.890668 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2920/5527] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:09.995972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:10.011963 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ed6f64c-7709-42b6-9d6f-c662163ae723 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 200 len: 1465 microversion: 2.1 time: 0.894656 Apr 02 21:17:10.012819 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2608/5528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:09 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 1465 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:10.823240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7c351b6f-2b7b-489a-b08a-d085b3344257 req-f66ad887-ebc2-4a13-a453-af9913cf75d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a263231-bf3c-4b10-a7b8-37853a186b7f", "tag": "cd8b887a-a1aa-4929-bb9c-4a89a1e075eb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:10.837917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:10.838990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:10.855076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7c351b6f-2b7b-489a-b08a-d085b3344257 req-f66ad887-ebc2-4a13-a453-af9913cf75d8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:10.857556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:10.858171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7c351b6f-2b7b-489a-b08a-d085b3344257 req-f66ad887-ebc2-4a13-a453-af9913cf75d8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:10.860933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:10.863133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:10.866989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:10.889905 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7c351b6f-2b7b-489a-b08a-d085b3344257 req-f66ad887-ebc2-4a13-a453-af9913cf75d8 service nova] Creating event network-changed:cd8b887a-a1aa-4929-bb9c-4a89a1e075eb for instance 5a263231-bf3c-4b10-a7b8-37853a186b7f on nch1-master-1 Apr 02 21:17:10.902024 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7c351b6f-2b7b-489a-b08a-d085b3344257 req-f66ad887-ebc2-4a13-a453-af9913cf75d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079174 Apr 02 21:17:10.903118 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2921/5529] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:17:11.054082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:11.060218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: f1d9530c-b3bf-45b7-9ccd-97479fa1cb08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:11.078465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:11.078906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:11.080395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:11.081202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:11.104900 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] HTTP exception thrown: Instance f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 could not be found. Apr 02 21:17:11.105795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Returning 404 to user: Instance f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:11.106825 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-58e6ce7c-b102-4800-83ce-b1906cc9b800 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08" status: 404 len: 111 microversion: 2.1 time: 0.077603 Apr 02 21:17:11.115962 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2922/5530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:11 2022] GET /compute/v2.1/servers/f1d9530c-b3bf-45b7-9ccd-97479fa1cb08 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:11.122025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:11.122760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:11.132952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:11.134741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:11.136993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:11.137660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:11.139025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:11.151506 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67e14e99-e31c-428b-a5e5-9788a8342971 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.317357 Apr 02 21:17:11.163357 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2609/5531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:10 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:11.176868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:11.331379 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ea280a4-5c79-4776-9d49-60c7b8043167 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 204 len: 0 microversion: 2.1 time: 0.212874 Apr 02 21:17:11.337996 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2923/5532] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:11 2022] DELETE /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:11.344381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:11.345337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:11.353652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:11.354346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:11.355350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:11.355793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:11.533663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:11.541425 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f11dbde8-3533-4c6e-889c-82a7c0527dac tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1506 microversion: 2.1 time: 0.202063 Apr 02 21:17:11.542275 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2610/5533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:11 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:12.175652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:12.177283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:12.177659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1004016082", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "146ce8d9-8798-4b34-95b9-d9b14df14138"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:12.192356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:12.192904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:12.193876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:12.194437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:12.265703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] validate_networks() for [('146ce8d9-8798-4b34-95b9-d9b14df14138', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:17:12.727956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:12.737255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f007ec13-61ba-41be-86cd-7adbc752ed20 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.570720 Apr 02 21:17:12.746441 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2924/5534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:12 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:12.746441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:12.746441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:12.752469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:12.753055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:12.753937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:12.754530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:13.058008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:13.071667 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c749e92-cc8b-44aa-b3ca-3c6fca22a72a tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1506 microversion: 2.1 time: 0.332278 Apr 02 21:17:13.073050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2925/5535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:12 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:13.138437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:17:13.141023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:17:13.141902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:17:13.142566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:17:13.143358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:17:13.158532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:13.162501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:13.165258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:13.167227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:13.203344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Getting quotas for project b5fe471f4a924fd98ef24aa24abb736c. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:17:13.211899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Getting quotas for user 08aca3700d594a349789d5f3847894dc and project b5fe471f4a924fd98ef24aa24abb736c. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:17:13.227340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:17:13.230169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:17:13.300645 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b40b60c3-826e-4b65-948b-112c6ad63901 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126891 Apr 02 21:17:13.302966 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2611/5536] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:17:13.313425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59e7d0a4-efbe-43c9-9004-9fbb9f5981b0 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:13.314896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59e7d0a4-efbe-43c9-9004-9fbb9f5981b0 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:13.422272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-59e7d0a4-efbe-43c9-9004-9fbb9f5981b0 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:13.434789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59e7d0a4-efbe-43c9-9004-9fbb9f5981b0 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1219 microversion: 2.1 time: 0.122769 Apr 02 21:17:13.447900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2926/5537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:13 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:13.757253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:13.758899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:13.774783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-89d690a5-46bf-4da3-8c95-e4a835fe76a1 req-0a0acc20-6154-4464-88e7-08c7e5c773a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adbbd4b-aefc-49b8-a3c2-2351473c3d84", "name": "network-vif-deleted", "tag": "2843b7a2-9385-4edc-aafb-6c4f41566ea0"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:13.793930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:13.794728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:13.797877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-89d690a5-46bf-4da3-8c95-e4a835fe76a1 req-0a0acc20-6154-4464-88e7-08c7e5c773a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:13.799009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:13.799887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:13.803478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-89d690a5-46bf-4da3-8c95-e4a835fe76a1 req-0a0acc20-6154-4464-88e7-08c7e5c773a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:13.843333 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-89d690a5-46bf-4da3-8c95-e4a835fe76a1 req-0a0acc20-6154-4464-88e7-08c7e5c773a7 service nova] Creating event network-vif-deleted:2843b7a2-9385-4edc-aafb-6c4f41566ea0 for instance 1adbbd4b-aefc-49b8-a3c2-2351473c3d84 on nch2-master-1 Apr 02 21:17:13.852796 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-89d690a5-46bf-4da3-8c95-e4a835fe76a1 req-0a0acc20-6154-4464-88e7-08c7e5c773a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081683 Apr 02 21:17:13.861787 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2927/5538] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:14.091089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:14.092226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:14.112322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:14.114733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:14.115274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:14.121651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:14.122454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:14.144696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3062a34-40b2-4ff4-8b94-2d8723b27ab5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.391244 Apr 02 21:17:14.145724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2612/5539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:13 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:14.202138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:14.203334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:14.204006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lazy-loading 'fault' on Instance uuid 1adbbd4b-aefc-49b8-a3c2-2351473c3d84 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:17:14.289064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:14.311371 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d38f8326-cf88-450c-8551-e18d3c0dcdd7 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 200 len: 1304 microversion: 2.1 time: 0.224903 Apr 02 21:17:14.315963 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2928/5540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:14 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:14.457526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:14.458326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:14.471052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:14.471514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:14.474272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:14.475517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:14.554493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:14.562201 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f41e7e0-8ae0-421e-847f-a447c4b207eb tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1271 microversion: 2.1 time: 0.111679 Apr 02 21:17:14.563131 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2613/5541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:14 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:15.162273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:15.163352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:15.178634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.181202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.182892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.184967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.333479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:15.333948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 1adbbd4b-aefc-49b8-a3c2-2351473c3d84] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:15.361867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.362326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.363118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.370617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.400217 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] HTTP exception thrown: Instance 1adbbd4b-aefc-49b8-a3c2-2351473c3d84 could not be found. Apr 02 21:17:15.401127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Returning 404 to user: Instance 1adbbd4b-aefc-49b8-a3c2-2351473c3d84 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:15.406037 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c870300d-e726-4d97-a861-dcc8bb100bc5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84" status: 404 len: 111 microversion: 2.1 time: 0.076484 Apr 02 21:17:15.407439 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2614/5542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:15 2022] GET /compute/v2.1/servers/1adbbd4b-aefc-49b8-a3c2-2351473c3d84 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:17:15.419525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:15.423293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:15.437292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.459105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.460003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.460535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.520547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:15.521271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:15.531542 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a54f872-898b-498a-9b00-5126bc9e254b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.369721 Apr 02 21:17:15.536009 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2929/5543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:15 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:15.588344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:15.589458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:15.608051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.608633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.610049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.611896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.684826 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1e54bbaf-fb5a-4e5d-95a8-d3f6e614fc37 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 204 len: 0 microversion: 2.1 time: 0.272054 Apr 02 21:17:15.701443 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2615/5544] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:15 2022] DELETE /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:15.747435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:15.750367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:15.762537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.763183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.766662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:15.767534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:15.976715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:15.985676 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-730f658a-325a-40c2-8406-552214df5536 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.408178 Apr 02 21:17:15.986267 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2930/5545] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:15 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:16.009882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:16.017977 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c97f923d-e411-42bc-b3f3-4acf57b742e5 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1494 microversion: 2.1 time: 0.307766 Apr 02 21:17:16.018664 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2616/5546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:15 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1494 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:16.551019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:16.551913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:16.563509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:16.566780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:16.567882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:16.569005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:16.780711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6faae3eb-90f5-4c22-9321-51af96846ea4 req-941d9be6-a0c9-4f46-8ae7-3e567bd11649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a263231-bf3c-4b10-a7b8-37853a186b7f", "name": "network-vif-plugged", "status": "completed", "tag": "cd8b887a-a1aa-4929-bb9c-4a89a1e075eb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:16.803817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6faae3eb-90f5-4c22-9321-51af96846ea4 req-941d9be6-a0c9-4f46-8ae7-3e567bd11649 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:16.806713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6faae3eb-90f5-4c22-9321-51af96846ea4 req-941d9be6-a0c9-4f46-8ae7-3e567bd11649 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:16.839885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:16.841501 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6faae3eb-90f5-4c22-9321-51af96846ea4 req-941d9be6-a0c9-4f46-8ae7-3e567bd11649 service nova] Creating event network-vif-plugged:cd8b887a-a1aa-4929-bb9c-4a89a1e075eb for instance 5a263231-bf3c-4b10-a7b8-37853a186b7f on nch1-master-1 Apr 02 21:17:16.852724 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30c04e2c-74e9-4bb1-82a6-e2b6520f4374 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.305604 Apr 02 21:17:16.857440 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2931/5547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:16 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:16.864720 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6faae3eb-90f5-4c22-9321-51af96846ea4 req-941d9be6-a0c9-4f46-8ae7-3e567bd11649 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080589 Apr 02 21:17:16.864720 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2617/5548] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:17.005309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:17.006576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:17.025140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.025961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:17.026801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.030951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:17.035584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:17.046658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:17.060211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.067096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:17.068240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.068877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:17.312850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:17.325593 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ee04ae0-60a2-44a3-a649-82ad53ddf858 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.323858 Apr 02 21:17:17.329220 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2932/5549] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:16 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:17.441002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9020e62a-15f4-4766-875c-b5edf19bc614 req-e0df62ff-9650-4464-b0ce-68a5201c4811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3404d76c-428c-4447-94c1-98c5a0283dca", "tag": "c626a37a-e921-41cb-8c32-afdbb4e2a5ca"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:17.450556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9020e62a-15f4-4766-875c-b5edf19bc614 req-e0df62ff-9650-4464-b0ce-68a5201c4811 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.451340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9020e62a-15f4-4766-875c-b5edf19bc614 req-e0df62ff-9650-4464-b0ce-68a5201c4811 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:17.474008 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9020e62a-15f4-4766-875c-b5edf19bc614 req-e0df62ff-9650-4464-b0ce-68a5201c4811 service nova] Creating event network-changed:c626a37a-e921-41cb-8c32-afdbb4e2a5ca for instance 3404d76c-428c-4447-94c1-98c5a0283dca on nch2-master-1 Apr 02 21:17:17.501561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9020e62a-15f4-4766-875c-b5edf19bc614 req-e0df62ff-9650-4464-b0ce-68a5201c4811 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066149 Apr 02 21:17:17.504137 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2933/5550] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:17.591155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:17.599301 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7b3feca6-8307-4d07-acd4-b914cb144815 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1494 microversion: 2.1 time: 0.567741 Apr 02 21:17:17.599817 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2618/5551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:17 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1494 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:17.875385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:17.876736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:17.884152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.884725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:17.885755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:17.886414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:18.173546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:18.184480 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9e011b1-6532-4099-8609-10e9b482cccb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1308 microversion: 2.1 time: 0.314052 Apr 02 21:17:18.185891 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2934/5552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:17 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:18.347381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:18.348618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:18.356983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:18.357731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:18.359481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:18.360089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:18.617634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:18.618441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:18.630323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:18.631371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:18.632178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:18.632664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:18.657268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:18.672974 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4612308e-4805-467a-bbca-95de1c27d074 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.328379 Apr 02 21:17:18.682082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:18.683054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:18.683840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lazy-loading 'fault' on Instance uuid 9cafb483-0676-4e62-8476-0173f608446a {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:17:18.684745 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2619/5553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:18 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:18.785466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:18.807200 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be3ad250-b326-4f80-af59-5032c54f4302 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 200 len: 1304 microversion: 2.1 time: 0.193542 Apr 02 21:17:18.824897 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2935/5554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:18 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:19.202767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:19.203307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:19.211094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.212419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.214625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.215736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.383017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:19.390433 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f9d5710-67b6-41c2-8cdc-b2cfe9e2aa9b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1489 microversion: 2.1 time: 0.192437 Apr 02 21:17:19.391411 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2620/5555] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:19 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1489 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:19.407317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:19.408582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:19.419384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.419980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.421406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.422176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.506047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00a55e96-a3d3-47a7-b00b-cafe4eb899b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "PUT /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1084 microversion: 2.1 time: 0.103165 Apr 02 21:17:19.506699 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2936/5556] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:17:19 2022] PUT /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1084 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:19.520517 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:19.521414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:19.529420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.530737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.531727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.532361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.604940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e53e6ec9-acc2-4bfa-9b03-e0a113cb94d5 req-309bfadc-7469-4174-8fb2-4e92ad331ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cafb483-0676-4e62-8476-0173f608446a", "name": "network-vif-deleted", "tag": "d4c6aff0-bf35-4f5b-baaa-ec39dcbe3a9a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:19.614114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e53e6ec9-acc2-4bfa-9b03-e0a113cb94d5 req-309bfadc-7469-4174-8fb2-4e92ad331ff9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.614868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e53e6ec9-acc2-4bfa-9b03-e0a113cb94d5 req-309bfadc-7469-4174-8fb2-4e92ad331ff9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.626970 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e53e6ec9-acc2-4bfa-9b03-e0a113cb94d5 req-309bfadc-7469-4174-8fb2-4e92ad331ff9 service nova] Creating event network-vif-deleted:d4c6aff0-bf35-4f5b-baaa-ec39dcbe3a9a for instance 9cafb483-0676-4e62-8476-0173f608446a on nch1-master-1 Apr 02 21:17:19.636337 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e53e6ec9-acc2-4bfa-9b03-e0a113cb94d5 req-309bfadc-7469-4174-8fb2-4e92ad331ff9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034962 Apr 02 21:17:19.637913 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2937/5557] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:19.694322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:19.696271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:19.704037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.704852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.705868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.706519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.729806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:19.767622 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e49002cf-b679-49b7-8c1e-9cc2d5b1031b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1510 microversion: 2.1 time: 0.250574 Apr 02 21:17:19.770178 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2621/5558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:19 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:19.783746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:19.784367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:19.790189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.790651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.791421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.791863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.942626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:19.950155 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4be74fa2-12cd-4745-92df-d73e122be4f6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1510 microversion: 2.1 time: 0.170671 Apr 02 21:17:19.950744 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2622/5559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:19 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:19.961365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:19.961900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 9cafb483-0676-4e62-8476-0173f608446a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:19.970661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.971421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.972719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:19.973373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:19.989605 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] HTTP exception thrown: Instance 9cafb483-0676-4e62-8476-0173f608446a could not be found. Apr 02 21:17:19.990277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Returning 404 to user: Instance 9cafb483-0676-4e62-8476-0173f608446a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:19.991849 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a4cc13f-b9f4-4bda-9c9c-fbb3b6f36990 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a" status: 404 len: 111 microversion: 2.1 time: 0.039848 Apr 02 21:17:19.993176 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2623/5560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:19 2022] GET /compute/v2.1/servers/9cafb483-0676-4e62-8476-0173f608446a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:19.999727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:20.000277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:20.006335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.006792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.007761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.008203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.033637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:20.116051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:20.132926 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-03af42bc-9a47-422e-973b-b859a69791a8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 204 len: 0 microversion: 2.1 time: 0.138186 Apr 02 21:17:20.134070 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2624/5561] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:19 2022] DELETE /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:20.135626 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2f155cf-409f-44fe-ab93-b68a0dcd5038 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.448956 Apr 02 21:17:20.136738 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2938/5562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:19 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:20.143523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:20.144503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:20.152676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:20.153299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:20.159625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.160627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.161204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.161686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.162156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.162479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.162925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.164080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.192655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:20.311100 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6e3fe489-9000-4f00-a647-b8597c1a472e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 204 len: 0 microversion: 2.1 time: 0.168941 Apr 02 21:17:20.312446 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2625/5563] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:20 2022] DELETE /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:20.321851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:20.325366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:20.345473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.346595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.347891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:20.348825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:20.436810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:20.449831 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec9d6702-cd76-4f02-b6db-0306531d1eee tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1516 microversion: 2.1 time: 0.311787 Apr 02 21:17:20.451238 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2939/5564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:20 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:20.565701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:20.578852 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f07551b-15a4-41c0-b4a9-a312a3f33bcc tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1674 microversion: 2.1 time: 0.262174 Apr 02 21:17:20.579710 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2626/5565] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:20 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1674 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:21.154016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:21.154978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:21.164336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:21.164998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:21.166109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:21.166653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:21.418712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:21.431121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c2cac3e-447b-4dfd-a720-fed9f7b6dd48 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.282166 Apr 02 21:17:21.431794 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2940/5566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:21 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:21.477294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:21.478148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:21.487616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:21.488692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:21.490502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:21.491419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:21.601786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:21.610665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:21.631296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:21.631990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:21.633073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:21.634221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:21.781817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:21.793605 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e4e8a9a-8a48-4ec3-82a1-79c4c83cc052 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1516 microversion: 2.1 time: 0.322356 Apr 02 21:17:21.800519 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2627/5567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:21 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1516 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:21.841633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:21.851086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ddee6ad-a96c-4220-af31-ec82ecddf25e tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1674 microversion: 2.1 time: 0.258515 Apr 02 21:17:21.851974 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2941/5568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:21 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1674 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:22.450513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:22.452540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:22.461710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:22.464194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:22.465394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:22.466225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:22.818713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:22.819867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:22.835960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:22.845549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:22.848279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:22.849726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:23.039510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:23.051205 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebe2473c-8464-4c3a-ab12-f9bceb572f44 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 200 len: 1474 microversion: 2.1 time: 0.235182 Apr 02 21:17:23.051889 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2942/5569] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:22 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:23.067508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:23.068061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:23.080131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:23.081230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:23.088046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:23.088560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:23.358242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:23.370182 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4427c761-0b1c-4a32-9105-00ed736ed755 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.923496 Apr 02 21:17:23.382071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2628/5570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:22 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:23.387431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-eeb97967-2fb8-40fd-a088-e29600acdd27 req-29526b82-6405-4043-b47f-3e843acfa615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a263231-bf3c-4b10-a7b8-37853a186b7f", "name": "network-vif-deleted", "tag": "cd8b887a-a1aa-4929-bb9c-4a89a1e075eb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:23.399818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-eeb97967-2fb8-40fd-a088-e29600acdd27 req-29526b82-6405-4043-b47f-3e843acfa615 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:23.400535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-eeb97967-2fb8-40fd-a088-e29600acdd27 req-29526b82-6405-4043-b47f-3e843acfa615 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:23.413995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-eeb97967-2fb8-40fd-a088-e29600acdd27 req-29526b82-6405-4043-b47f-3e843acfa615 service nova] Creating event network-vif-deleted:cd8b887a-a1aa-4929-bb9c-4a89a1e075eb for instance 5a263231-bf3c-4b10-a7b8-37853a186b7f on nch1-master-1 Apr 02 21:17:23.420004 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-eeb97967-2fb8-40fd-a088-e29600acdd27 req-29526b82-6405-4043-b47f-3e843acfa615 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Apr 02 21:17:23.421602 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2629/5571] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:23.477069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:23.485625 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4aa1964-6304-430d-ae2f-083ac12c317f tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1674 microversion: 2.1 time: 0.432619 Apr 02 21:17:23.495452 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2943/5572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:23 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1674 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:23.995324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-93d09cf4-c0fd-4099-968c-80db0914ce25 req-0add488d-d4f7-4e80-a48a-42721ecb0c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3404d76c-428c-4447-94c1-98c5a0283dca", "name": "network-vif-plugged", "status": "completed", "tag": "c626a37a-e921-41cb-8c32-afdbb4e2a5ca"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:24.040893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-93d09cf4-c0fd-4099-968c-80db0914ce25 req-0add488d-d4f7-4e80-a48a-42721ecb0c40 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.042105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-93d09cf4-c0fd-4099-968c-80db0914ce25 req-0add488d-d4f7-4e80-a48a-42721ecb0c40 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.072841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:24.075996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:24.088692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.090936 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-93d09cf4-c0fd-4099-968c-80db0914ce25 req-0add488d-d4f7-4e80-a48a-42721ecb0c40 service nova] Creating event network-vif-plugged:c626a37a-e921-41cb-8c32-afdbb4e2a5ca for instance 3404d76c-428c-4447-94c1-98c5a0283dca on nch2-master-1 Apr 02 21:17:24.101140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.107483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.108796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.131914 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-93d09cf4-c0fd-4099-968c-80db0914ce25 req-0add488d-d4f7-4e80-a48a-42721ecb0c40 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139774 Apr 02 21:17:24.141833 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 5a263231-bf3c-4b10-a7b8-37853a186b7f could not be found. Apr 02 21:17:24.142893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 5a263231-bf3c-4b10-a7b8-37853a186b7f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:24.143724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2630/5573] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:24.144915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-702669f4-e866-4483-b622-9d79d002a1b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 404 len: 111 microversion: 2.1 time: 0.079901 Apr 02 21:17:24.159009 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2944/5574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:24 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:24.391283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:24.392181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:24.397653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1515495297", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "93717f05-9f3d-4b28-ad7c-0deb3583263c"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:24.410507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.411535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.412508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.418133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.481455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] validate_networks() for [('93717f05-9f3d-4b28-ad7c-0deb3583263c', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:17:24.739293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:24.751388 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3e2bf29-8a7f-42b3-9bb5-ecc087c5f1e7 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.364019 Apr 02 21:17:24.752011 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2631/5575] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:24 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:24.764646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:24.765719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:24.776953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.777763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.780746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.781984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.854522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:24.855540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:24.856235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lazy-loading 'fault' on Instance uuid 0a31e29c-ab4b-4383-a315-70c35db9708c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:17:24.934745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f570c67ed24546ac51341ef8ea2439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25481b7efed4632bcd054e2cec3b161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:24.948195 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecd9b878-07df-4481-8f0d-102ce525b825 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 200 len: 1328 microversion: 2.1 time: 0.189888 Apr 02 21:17:24.949694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2632/5576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:24 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:25.418086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:17:25.418590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:17:25.419000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:17:25.419429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:17:25.419854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:17:25.448083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.457255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.458355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.458810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.509048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:17:25.524479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Getting quotas for user 8b84c577baf8418180f894c99c643772 and project 596094c632d2408d8963534a88f04156. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:17:25.547888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:17:25.556482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:17:25.568402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-76aa2db2-6ec5-46f4-adad-11523bc04f30 req-04266c17-eb8f-4c4c-aab3-215cd4d1675e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a31e29c-ab4b-4383-a315-70c35db9708c", "name": "network-vif-deleted", "tag": "3f0f2359-5410-4f6a-bdd8-fbd66f127a5c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:25.591039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-76aa2db2-6ec5-46f4-adad-11523bc04f30 req-04266c17-eb8f-4c4c-aab3-215cd4d1675e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.593259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-76aa2db2-6ec5-46f4-adad-11523bc04f30 req-04266c17-eb8f-4c4c-aab3-215cd4d1675e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.613438 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-76aa2db2-6ec5-46f4-adad-11523bc04f30 req-04266c17-eb8f-4c4c-aab3-215cd4d1675e service nova] Creating event network-vif-deleted:3f0f2359-5410-4f6a-bdd8-fbd66f127a5c for instance 0a31e29c-ab4b-4383-a315-70c35db9708c on nch2-master-1 Apr 02 21:17:25.620010 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-76aa2db2-6ec5-46f4-adad-11523bc04f30 req-04266c17-eb8f-4c4c-aab3-215cd4d1675e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073771 Apr 02 21:17:25.621923 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2633/5577] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:17:25.637737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d76ac91-0beb-45f6-ba1c-7925fc4c0e57 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.244410 Apr 02 21:17:25.641838 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2945/5578] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:17:25.651950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c72cc0a3-a289-40cb-a797-af25f37f8b15 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:25.652708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c72cc0a3-a289-40cb-a797-af25f37f8b15 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:25.759867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c72cc0a3-a289-40cb-a797-af25f37f8b15 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:25.769986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:25.770616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:25.777698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c72cc0a3-a289-40cb-a797-af25f37f8b15 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1209 microversion: 2.1 time: 0.130610 Apr 02 21:17:25.784868 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2634/5579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:25 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:25.789120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.793027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.794090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.794741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.968868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:25.969504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] [instance: 0a31e29c-ab4b-4383-a315-70c35db9708c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:25.976490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.978836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.979805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:25.980347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:25.999587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] HTTP exception thrown: Instance 0a31e29c-ab4b-4383-a315-70c35db9708c could not be found. Apr 02 21:17:26.000664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Returning 404 to user: Instance 0a31e29c-ab4b-4383-a315-70c35db9708c could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:26.002539 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f36c29bb-8878-43cd-904b-3283801ddf8c tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c" status: 404 len: 111 microversion: 2.1 time: 0.039555 Apr 02 21:17:26.003705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2635/5580] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:25 2022] GET /compute/v2.1/servers/0a31e29c-ab4b-4383-a315-70c35db9708c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:17:26.013027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8f494887-7272-4c89-a369-a2b1dcba3184 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] Calling method '.version_select at 0x7f54c780e5e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:26.037969 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8f494887-7272-4c89-a369-a2b1dcba3184 tempest-ServerActionsTestJSON-1721322149 tempest-ServerActionsTestJSON-1721322149-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695385279" status: 202 len: 0 microversion: 2.1 time: 0.028613 Apr 02 21:17:26.039356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2636/5581] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Apr 2 21:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695385279 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:17:26.194231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:26.205715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c513967-01a6-434b-8741-0c8bb02fc46f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1319 microversion: 2.1 time: 0.438698 Apr 02 21:17:26.206373 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2946/5582] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:25 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:26.801370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:26.801984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:26.812784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:26.814102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:26.815073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:26.815763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:26.902497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-992901263", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "c136974e-202a-4a41-89bb-9397f199d26e"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:26.983816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] validate_networks() for [('c136974e-202a-4a41-89bb-9397f199d26e', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:17:27.033500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:27.042447 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7884bc4b-fc73-4c84-bc97-f7c4e60112c0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1205 microversion: 2.1 time: 0.245808 Apr 02 21:17:27.045344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2947/5583] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:26 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1205 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:27.224390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:27.225130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:27.239593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:27.239972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:27.240823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:27.254071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:27.591079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:27.601425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b0dfea16-42a4-4a23-8442-7ecc36e94997 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1509 microversion: 2.1 time: 0.381668 Apr 02 21:17:27.602205 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2948/5584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:27 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:27.618744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c87f93d6-de80-42a3-9d17-3629759f6c8b", "device": "/dev/sdb"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:27.619917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:27.628924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:27.629388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:27.630299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:27.631139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:27.777986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:17:27.778821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:17:27.779520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:17:27.785421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:17:27.786716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:17:27.813846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:27.814669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:27.816297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:27.817003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:27.845892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Getting quotas for project bdd4fc60def4456798130d3fcadb83da. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:17:27.853009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Getting quotas for user 96cae46738834216b9d7cb13be80452e and project bdd4fc60def4456798130d3fcadb83da. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:17:27.879401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:17:27.882249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:17:28.006652 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1131f120-3565-4b84-abde-07b8e5450e27 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349905 Apr 02 21:17:28.007293 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2637/5585] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:17:28.028732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ea874b4-18b4-436e-a247-5281ca52e721 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:28.030145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ea874b4-18b4-436e-a247-5281ca52e721 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:28.083728 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-32192b0c-f5f4-4ef3-b985-16aebf309e04 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "POST /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468767 Apr 02 21:17:28.086875 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2949/5586] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:17:27 2022] POST /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:28.096700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:28.099919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:28.114916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:28.116581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:28.118215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:28.123561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:28.275819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:28.295927 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a1f52f86-5e80-4cf2-a781-c43395120292 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1267 microversion: 2.1 time: 0.207621 Apr 02 21:17:28.296536 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2950/5587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:28 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:28.317034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ea874b4-18b4-436e-a247-5281ca52e721 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:28.329418 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ea874b4-18b4-436e-a247-5281ca52e721 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1213 microversion: 2.1 time: 0.310403 Apr 02 21:17:28.330042 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2638/5588] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:28 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1213 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:29.318201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:29.318840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:29.333996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:29.339126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:29.340066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:29.340561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:29.347267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:29.347904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:29.355852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:29.360852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:29.364331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:29.366336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:29.613075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:29.626768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a74557f5-af55-48cb-88d0-449179b720b7 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1265 microversion: 2.1 time: 0.281313 Apr 02 21:17:29.632424 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2639/5589] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:29 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:29.758906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:29.771684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22797971-7c96-4cf7-8be1-8d61d9677af2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.461692 Apr 02 21:17:29.774657 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2951/5590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:29 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:30.643873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:30.646762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:30.657934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:30.660357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:30.661717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:30.662335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:30.766725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:30.777323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ebfd24a-41ea-4ba3-b537-63ecd3e53e1f tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1271 microversion: 2.1 time: 0.137283 Apr 02 21:17:30.777942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2640/5591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:30 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:30.793676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:30.794369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:30.845761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:30.848433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:30.849301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:30.849787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:31.275907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:31.289256 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b58cbbe8-d95e-4975-836d-c5d523a53452 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.502547 Apr 02 21:17:31.299686 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2952/5592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:30 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:31.798207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:31.798864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:31.819868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:31.820322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:31.827068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-57171c2f-bd6c-4596-9ffd-b7945b9ef5ab req-e4e5949f-2b85-4025-b041-65b82c58a99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b81534-5a19-429b-b131-46c884ac57b7", "tag": "e12f560f-cc44-4639-bc3a-f4fe034a299b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:31.840716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:31.841198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:31.848241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-57171c2f-bd6c-4596-9ffd-b7945b9ef5ab req-e4e5949f-2b85-4025-b041-65b82c58a99f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:31.848678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-57171c2f-bd6c-4596-9ffd-b7945b9ef5ab req-e4e5949f-2b85-4025-b041-65b82c58a99f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:31.887837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-57171c2f-bd6c-4596-9ffd-b7945b9ef5ab req-e4e5949f-2b85-4025-b041-65b82c58a99f service nova] Creating event network-changed:e12f560f-cc44-4639-bc3a-f4fe034a299b for instance 07b81534-5a19-429b-b131-46c884ac57b7 on nch1-master-1 Apr 02 21:17:31.910337 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-57171c2f-bd6c-4596-9ffd-b7945b9ef5ab req-e4e5949f-2b85-4025-b041-65b82c58a99f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087378 Apr 02 21:17:31.910968 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2953/5593] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:17:32.309103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:32.310098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:32.327588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:32.329202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:32.332886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:32.333646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:32.375920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:32.389974 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0887e3ca-a53a-418d-8112-4fdb998aab47 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.593908 Apr 02 21:17:32.402700 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2641/5594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:31 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:32.783097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:32.809012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d102ac83-62f6-4ef6-9796-ed0303e955b6 req-1f46cd9d-ce50-4d91-86dc-c97ceb99851c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e0def33-d08e-43ec-98f8-9ada1c9cdb50", "tag": "a1defcfd-1bc1-4aae-93f2-0256e5764a87"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:32.819777 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ca6d889-8ae4-4d3b-8aa0-501abf3a0503 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.516185 Apr 02 21:17:32.822741 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2954/5595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:32 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:32.846238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d102ac83-62f6-4ef6-9796-ed0303e955b6 req-1f46cd9d-ce50-4d91-86dc-c97ceb99851c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:32.846597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d102ac83-62f6-4ef6-9796-ed0303e955b6 req-1f46cd9d-ce50-4d91-86dc-c97ceb99851c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:32.902667 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d102ac83-62f6-4ef6-9796-ed0303e955b6 req-1f46cd9d-ce50-4d91-86dc-c97ceb99851c service nova] Creating event network-changed:a1defcfd-1bc1-4aae-93f2-0256e5764a87 for instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50 on nch1-master-1 Apr 02 21:17:32.919683 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d102ac83-62f6-4ef6-9796-ed0303e955b6 req-1f46cd9d-ce50-4d91-86dc-c97ceb99851c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113927 Apr 02 21:17:32.921721 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2642/5596] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:33.410292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:33.411634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:33.418704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:33.419475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:33.420558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:33.421067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:33.683628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:33.699837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3298b77e-5554-45b3-a786-1bfe83384d23 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.292650 Apr 02 21:17:33.717483 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2955/5597] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:33 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:33.842449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:33.843183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:33.852149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:33.853479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:33.854478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:33.855138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:34.446982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:34.464495 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd6b6952-d4a6-4fca-a42d-d479ca682a7c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.626756 Apr 02 21:17:34.466480 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2643/5598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:33 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:34.724926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:34.725868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:34.734801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:34.735491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:34.737278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:34.738460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:35.075968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:35.091605 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff166665-f6bf-406c-ba0b-a9beb02209d5 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.371416 Apr 02 21:17:35.097965 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2956/5599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:34 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:35.484158 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:35.485118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:35.496488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:35.497271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:35.499147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:35.500146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:35.780902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:35.789252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38092fe3-7340-4766-bf85-8616376593cc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.309279 Apr 02 21:17:35.789951 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2644/5600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:35 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:36.115243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:36.117005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:36.132246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:36.132886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:36.134496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:36.135530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:36.369370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:36.380967 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4843a71c-d3c6-4a1a-888b-e958fbf62b9d tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.270035 Apr 02 21:17:36.391622 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2957/5601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:36 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:36.808738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:36.809352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:36.825419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:36.826264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:36.828629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:36.830011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:37.145909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:37.170351 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efac125f-ea7a-4a9d-80ee-32b5cd423441 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.366690 Apr 02 21:17:37.172539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2645/5602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:36 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:37.400633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:37.402180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:37.415488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:37.420670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:37.421781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:37.422417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:37.611953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:37.623579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21f76e72-da12-4151-9834-74d8505b2322 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.225830 Apr 02 21:17:37.624820 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2958/5603] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:37 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:38.189434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:38.190053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:38.196881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:38.197346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:38.198133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:38.198685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:38.368985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:38.384517 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e428548b-ca95-4820-87f5-4ed97bc29523 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.199209 Apr 02 21:17:38.389668 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2646/5604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:38 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:38.550900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1621344230", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "24af2d75-b19c-4dc7-9dd0-ca1e9ccafeb2"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:38.605776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] validate_networks() for [('24af2d75-b19c-4dc7-9dd0-ca1e9ccafeb2', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:17:38.641544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:38.641986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:38.648748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:38.649213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:38.650221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:38.650833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:38.922460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:38.933199 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a364b08-0fa7-42b0-b60f-d92c14160d56 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.296413 Apr 02 21:17:38.934150 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2647/5605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:38 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:39.079858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:17:39.080356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:17:39.080884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:17:39.081350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:17:39.081777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:17:39.092496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:39.092960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:39.093819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:39.094268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:39.113914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Getting quotas for project f97a5ac274614973bfd3070db537d0b0. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:17:39.123744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Getting quotas for user df9b3a6417fa482a8d2feb3552fec06d and project f97a5ac274614973bfd3070db537d0b0. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:17:39.141616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:17:39.144328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:17:39.219891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f6d13668-06c0-4735-983f-6ebe221c9fea tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832017 Apr 02 21:17:39.220956 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2959/5606] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:17:39.240167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6d1fa687-569f-4a59-a393-fe7b9d92bb3d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:39.241536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6d1fa687-569f-4a59-a393-fe7b9d92bb3d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:39.354823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6d1fa687-569f-4a59-a393-fe7b9d92bb3d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:39.367974 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6d1fa687-569f-4a59-a393-fe7b9d92bb3d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1216 microversion: 2.1 time: 0.138945 Apr 02 21:17:39.376608 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2648/5607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:39 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:39.402656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:39.403354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:39.412224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:39.416198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:39.417269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:39.421375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:39.653919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:39.661999 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99e8dd51-29d9-4de7-9ae3-c80f7bf515a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.264241 Apr 02 21:17:39.663080 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2960/5608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:39 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:39.951014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:39.951823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:39.959379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:39.959943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:39.961033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:39.961773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:40.200551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:40.207913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9bd054de-c875-4182-ab6a-5fb0a1cf3a25 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.260943 Apr 02 21:17:40.208423 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2649/5609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:39 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:40.391635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:40.392287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:40.398340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:40.399023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:40.399804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:40.400253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:40.467570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:40.477090 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae0462d0-9a5c-4636-b6e3-44067c16bc93 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1268 microversion: 2.1 time: 0.089133 Apr 02 21:17:40.478086 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2961/5610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:40 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1268 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:40.680058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:40.680829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:40.692400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:40.694467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:40.696639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:40.697183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:40.844863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-64350388-67da-4ce9-99eb-aa85dca05527 req-ad57b7af-092f-4642-8a37-7fc34bf9da61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b81534-5a19-429b-b131-46c884ac57b7", "name": "network-vif-plugged", "status": "completed", "tag": "e12f560f-cc44-4639-bc3a-f4fe034a299b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:40.862389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-64350388-67da-4ce9-99eb-aa85dca05527 req-ad57b7af-092f-4642-8a37-7fc34bf9da61 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:40.862522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-64350388-67da-4ce9-99eb-aa85dca05527 req-ad57b7af-092f-4642-8a37-7fc34bf9da61 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:40.931711 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-64350388-67da-4ce9-99eb-aa85dca05527 req-ad57b7af-092f-4642-8a37-7fc34bf9da61 service nova] Creating event network-vif-plugged:e12f560f-cc44-4639-bc3a-f4fe034a299b for instance 07b81534-5a19-429b-b131-46c884ac57b7 on nch1-master-1 Apr 02 21:17:40.942677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-64350388-67da-4ce9-99eb-aa85dca05527 req-ad57b7af-092f-4642-8a37-7fc34bf9da61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101015 Apr 02 21:17:40.944880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2962/5611] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:17:41.075985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:41.093462 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b063cf3b-b54c-4d00-98e0-94f5ee209a82 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.416927 Apr 02 21:17:41.110553 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2650/5612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:40 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:41.230306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:41.231537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:41.241220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:41.242491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:41.243654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:41.245161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:41.495166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:41.495851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:41.502016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:41.502835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:41.503861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:41.504566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:41.584622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:41.596756 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cfe76517-634b-486d-bf79-e4791242e63c tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.375125 Apr 02 21:17:41.607922 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2963/5613] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:41 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:41.613238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:41.621352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cde80b6e-cc39-4b05-8067-83e91e5dafdd tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1274 microversion: 2.1 time: 0.130073 Apr 02 21:17:41.622519 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2651/5614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:41 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:42.116327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:42.117082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:42.124275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.124905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.125717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.126154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.365550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:42.381055 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-304453ad-aed0-4825-a3ce-9c8c839fb5b7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1309 microversion: 2.1 time: 0.268588 Apr 02 21:17:42.382299 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2964/5615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:42 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1309 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:42.486396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b02a3095-21df-4444-9bd6-def129e2e4f7 req-2fa136a3-39f6-49b9-9c49-cda4872a0c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c8f8e5-b999-4078-b783-2ed603ceb9eb", "tag": "d8903482-af01-4f82-9962-cf0f37dfd603"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:42.504651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b02a3095-21df-4444-9bd6-def129e2e4f7 req-2fa136a3-39f6-49b9-9c49-cda4872a0c2e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.505344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b02a3095-21df-4444-9bd6-def129e2e4f7 req-2fa136a3-39f6-49b9-9c49-cda4872a0c2e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.524348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b02a3095-21df-4444-9bd6-def129e2e4f7 req-2fa136a3-39f6-49b9-9c49-cda4872a0c2e service nova] Creating event network-changed:d8903482-af01-4f82-9962-cf0f37dfd603 for instance a3c8f8e5-b999-4078-b783-2ed603ceb9eb on nch2-master-1 Apr 02 21:17:42.531426 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b02a3095-21df-4444-9bd6-def129e2e4f7 req-2fa136a3-39f6-49b9-9c49-cda4872a0c2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053813 Apr 02 21:17:42.533903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2652/5616] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:42.619913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:42.620708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:42.630450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.631203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.632215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.633040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.640047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:42.641080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:42.651564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.655034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.656252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:42.656670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:42.951326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:42.962348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eeeaaddd-db8c-4174-ab8d-deffc4f7d941 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.348114 Apr 02 21:17:42.963548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2965/5617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:42 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:43.011577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c40c7926-746d-4434-b2a4-18aa8441d087 req-9edd286c-2208-43dd-809f-2afc30e95234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0def33-d08e-43ec-98f8-9ada1c9cdb50", "name": "network-vif-plugged", "status": "completed", "tag": "a1defcfd-1bc1-4aae-93f2-0256e5764a87"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:43.022615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c40c7926-746d-4434-b2a4-18aa8441d087 req-9edd286c-2208-43dd-809f-2afc30e95234 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.023071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c40c7926-746d-4434-b2a4-18aa8441d087 req-9edd286c-2208-43dd-809f-2afc30e95234 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.046971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c40c7926-746d-4434-b2a4-18aa8441d087 req-9edd286c-2208-43dd-809f-2afc30e95234 service nova] Creating event network-vif-plugged:a1defcfd-1bc1-4aae-93f2-0256e5764a87 for instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50 on nch1-master-1 Apr 02 21:17:43.059753 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c40c7926-746d-4434-b2a4-18aa8441d087 req-9edd286c-2208-43dd-809f-2afc30e95234 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049124 Apr 02 21:17:43.062662 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2966/5618] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:43.087073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:43.097993 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7c3f20e-1d76-4d13-8f30-2fa6c7478f01 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1316 microversion: 2.1 time: 0.462364 Apr 02 21:17:43.101012 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2653/5619] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:42 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:43.400298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:43.401213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:43.414858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.421374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.422500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.423124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.727747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:43.737208 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51691dce-6c8d-47e5-90f4-c2483ea1bbff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1491 microversion: 2.1 time: 0.342027 Apr 02 21:17:43.748921 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2967/5620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:43 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1491 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:43.753643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1658472336"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:43.754892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:43.761832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.762283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.763061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.763722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.852601 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cac5ee62-aac5-4b3d-97bc-358897b0b4fc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "PUT /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1076 microversion: 2.1 time: 0.102710 Apr 02 21:17:43.854314 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2654/5621] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:17:43 2022] PUT /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1076 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:43.869049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:43.869673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:43.877311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.877769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.878560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.881554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.979500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:43.980193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:43.987080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.987547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:43.988341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:43.988820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.158666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:44.167417 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4bbd4f1-229e-4a25-a38d-7539c7aa8e96 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1502 microversion: 2.1 time: 0.302308 Apr 02 21:17:44.168153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2968/5622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:43 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:44.173733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:44.174473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:44.180885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.181620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.182622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.183132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.272012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:44.281048 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a94b4d9f-5823-4798-8192-c0f8eebffcc3 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1313 microversion: 2.1 time: 0.305199 Apr 02 21:17:44.282056 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2655/5623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:43 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:44.293828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:44.294506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:44.301691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.302153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.303618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.304489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.594388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:44.605363 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b1a5280-762d-4181-87c7-d5f5c21cd299 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1502 microversion: 2.1 time: 0.321460 Apr 02 21:17:44.606240 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2656/5624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:44 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:44.622070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-73c2d31c-296d-4b50-9c57-2eefae4477a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:44.629266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73c2d31c-296d-4b50-9c57-2eefae4477a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.630085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73c2d31c-296d-4b50-9c57-2eefae4477a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.672501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-73c2d31c-296d-4b50-9c57-2eefae4477a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Going to try to stop instance {{(pid=136517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:17:44.773047 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-73c2d31c-296d-4b50-9c57-2eefae4477a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "POST /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7/action" status: 202 len: 0 microversion: 2.1 time: 0.154541 Apr 02 21:17:44.777871 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2657/5625] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:17:44 2022] POST /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:17:44.784226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:44.785347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:44.792212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.793094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.794378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:44.795614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:44.836891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:44.846695 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9ec0ee68-d00f-4538-84f6-7f59b6dd0df7 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1316 microversion: 2.1 time: 0.676939 Apr 02 21:17:44.848935 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2969/5626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:44 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1316 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:45.097970 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:45.105838 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8e2b4f0-32a9-46f1-a06a-08fa209ec654 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.325809 Apr 02 21:17:45.116281 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2658/5627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:44 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:45.301669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:45.302297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:45.310808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:45.311530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:45.312541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:45.313149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:45.849763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:45.860803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9a17e75-7c90-4157-bd65-cd270f1b628e tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1497 microversion: 2.1 time: 0.562819 Apr 02 21:17:45.862604 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2970/5628] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:45 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1497 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:45.865638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:45.866242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:45.880628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:45.881296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:45.882466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:45.883263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:46.124867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:46.125504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:46.137615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:46.138085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:46.141150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:46.141625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:46.273501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:46.283409 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6ddb3191-c3a2-4300-b2fb-b64f7a58845e tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1316 microversion: 2.1 time: 0.421217 Apr 02 21:17:46.293959 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2659/5629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:45 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:46.464183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:46.481249 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-daed3918-fea9-4cfb-9ce2-bad02f5e2ff3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.361994 Apr 02 21:17:46.481855 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2971/5630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:46 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:47.301327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:47.308436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:47.317127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:47.317915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:47.318933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:47.319610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:47.506516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:47.508356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:47.531802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:47.534062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:47.536997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:47.537484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:47.649122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:47.656662 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-da4b9d03-3f0d-4fd8-bf33-5e6eb2b5119c tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1316 microversion: 2.1 time: 0.359440 Apr 02 21:17:47.666049 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2660/5631] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:47 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:47.894542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:47.906865 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b090b17-4cdc-49d8-8396-25b6ed7988fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.406346 Apr 02 21:17:47.906865 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2972/5632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:47 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:48.673890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:48.675311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:48.686861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:48.688642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:48.693153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:48.693829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:48.761021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:48.761482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:48.776885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:48.777722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:48.798786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:48.800638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:48.867872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:49.002674 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4dfa2b5-a0be-49c1-98d1-aa26bdb16ff2 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 204 len: 0 microversion: 2.1 time: 0.244987 Apr 02 21:17:49.003880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2973/5633] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:48 2022] DELETE /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:17:49.021745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:49.022603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:49.033701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:49.035339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:49.042388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:49.043224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:49.445348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:49.453842 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab6fc067-c623-4790-96bf-da5d7c06cbb8 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.448121 Apr 02 21:17:49.457140 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2974/5634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:49 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:49.478615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:49.479615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:49.491202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:49.494670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:49.496923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:49.499792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:49.500374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:49.506793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08ea4dd6-68ea-4989-bb9d-01009b592d8a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1316 microversion: 2.1 time: 0.837749 Apr 02 21:17:49.508172 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2661/5635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:48 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1316 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:49.870581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:49.894369 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33eab14a-3567-47ae-bc01-046af469d592 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1503 microversion: 2.1 time: 0.423809 Apr 02 21:17:49.899940 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2975/5636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:49 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:50.011093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3c09d1a5-7b2b-481e-86f0-fc1dcf570626 req-60fcb74f-b252-4d1c-81ea-1d5f7319fafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c8f8e5-b999-4078-b783-2ed603ceb9eb", "name": "network-vif-plugged", "status": "completed", "tag": "d8903482-af01-4f82-9962-cf0f37dfd603"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:50.030471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3c09d1a5-7b2b-481e-86f0-fc1dcf570626 req-60fcb74f-b252-4d1c-81ea-1d5f7319fafc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:50.030926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3c09d1a5-7b2b-481e-86f0-fc1dcf570626 req-60fcb74f-b252-4d1c-81ea-1d5f7319fafc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:50.043849 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3c09d1a5-7b2b-481e-86f0-fc1dcf570626 req-60fcb74f-b252-4d1c-81ea-1d5f7319fafc service nova] Creating event network-vif-plugged:d8903482-af01-4f82-9962-cf0f37dfd603 for instance a3c8f8e5-b999-4078-b783-2ed603ceb9eb on nch2-master-1 Apr 02 21:17:50.050055 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3c09d1a5-7b2b-481e-86f0-fc1dcf570626 req-60fcb74f-b252-4d1c-81ea-1d5f7319fafc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042315 Apr 02 21:17:50.051018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2662/5637] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:50.473747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:50.474625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:50.494846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:50.498253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:50.499185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:50.500930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:50.524241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:50.525353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:50.539895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:50.541456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:50.544403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:50.545143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:50.871516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:50.881620 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29a6224c-ea27-44a7-b1e1-da7458cc16d6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.411593 Apr 02 21:17:50.882542 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2976/5638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:50 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:50.893280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-407874359", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "62eaf37e-3c45-4ac7-98c2-a8ddcedf7a54"}], "key_name": "tempest-TestSecurityGroupsBasicOps-508642488", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f816b0b7-9b69-4dab-b07b-539b28950094"]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:51.006856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] validate_networks() for [('62eaf37e-3c45-4ac7-98c2-a8ddcedf7a54', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:17:51.149610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:51.173594 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c75d3d68-e460-4cc7-b32a-bc2a33d8859a tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1316 microversion: 2.1 time: 0.645522 Apr 02 21:17:51.176395 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2663/5639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:50 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:51.190634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:51.191270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:51.219239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.219714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:51.220531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.223620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:51.366955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96cae46738834216b9d7cb13be80452e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd4fc60def4456798130d3fcadb83da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:51.382116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a5eb5156-9bf0-423a-8fbd-29f9bf7a8ac6 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 200 len: 1461 microversion: 2.1 time: 0.203641 Apr 02 21:17:51.385850 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2664/5640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:51 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 1461 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:51.499799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d88fa8b7-4edb-4414-8c02-13997baf2b39 req-8b74ac71-6c1d-47a2-a027-941c331a3bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e0def33-d08e-43ec-98f8-9ada1c9cdb50", "name": "network-vif-deleted", "tag": "a1defcfd-1bc1-4aae-93f2-0256e5764a87"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:51.513278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d88fa8b7-4edb-4414-8c02-13997baf2b39 req-8b74ac71-6c1d-47a2-a027-941c331a3bad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.514079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d88fa8b7-4edb-4414-8c02-13997baf2b39 req-8b74ac71-6c1d-47a2-a027-941c331a3bad service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:51.531857 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d88fa8b7-4edb-4414-8c02-13997baf2b39 req-8b74ac71-6c1d-47a2-a027-941c331a3bad service nova] Creating event network-vif-deleted:a1defcfd-1bc1-4aae-93f2-0256e5764a87 for instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50 on nch1-master-1 Apr 02 21:17:51.537793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d88fa8b7-4edb-4414-8c02-13997baf2b39 req-8b74ac71-6c1d-47a2-a027-941c331a3bad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045517 Apr 02 21:17:51.538690 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2665/5641] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:17:51.785662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:17:51.786149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:17:51.786552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:17:51.786968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:17:51.787387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:17:51.797087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.797831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:51.798366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.798807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:51.817182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:17:51.822805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Getting quotas for user 986a98734ff4476e83fcfbbf337274ca and project 73f99ad4a6bf4ec5ad3d7d4045018511. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:17:51.835448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:17:51.837857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:17:51.888398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-428f7450-b46e-4c76-b831-b42936d4a8f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.004644 Apr 02 21:17:51.894267 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2977/5642] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:17:50 2022] POST /compute/v2.1/servers => generated 361 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:17:51.899619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:51.900432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:51.901222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3fd0d55b-da4f-4cb0-b031-aa256af8c120 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:51.909389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.909389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:51.909798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:51.910011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3fd0d55b-da4f-4cb0-b031-aa256af8c120 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:51.910244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.046362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3fd0d55b-da4f-4cb0-b031-aa256af8c120 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:52.059863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3fd0d55b-da4f-4cb0-b031-aa256af8c120 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1240 microversion: 2.1 time: 0.163940 Apr 02 21:17:52.064927 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2666/5643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:51 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1240 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:52.127559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:52.137157 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c827b795-3a64-475c-ac06-3db7098daea1 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.241517 Apr 02 21:17:52.142573 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2978/5644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:51 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:52.192211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:52.192898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:52.205311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.205818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.207129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.207745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.402773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:52.403641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] [instance: 2e0def33-d08e-43ec-98f8-9ada1c9cdb50] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:52.413964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.414514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.415398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.417895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.437611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:52.454953 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d3c3e256-d8bb-4331-941f-dea2a1c4ba7b tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1505 microversion: 2.1 time: 0.265262 Apr 02 21:17:52.454953 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2667/5645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:52 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:52.466018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] HTTP exception thrown: Instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50 could not be found. Apr 02 21:17:52.470058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] Returning 404 to user: Instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:52.470626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:52.471135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:52.471603 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05b5034c-1ea3-474e-8b3e-ea2c0692f280 tempest-VolumesActionsTest-357684092 tempest-VolumesActionsTest-357684092-project] 10.222.0.18 "GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50" status: 404 len: 111 microversion: 2.1 time: 0.072683 Apr 02 21:17:52.473095 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2979/5646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:52 2022] GET /compute/v2.1/servers/2e0def33-d08e-43ec-98f8-9ada1c9cdb50 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:17:52.494702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.495677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.497744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.499833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.664895 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01822973-c16f-4cf3-a057-e31655fd19fa tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.198412 Apr 02 21:17:52.670950 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2668/5647] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Apr 2 21:17:52 2022] DELETE /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb/os-server-password => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:52.676405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:52.677326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:52.686973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.692215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.693795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.694941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.772965 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb184104-5702-4c68-9f44-f400c3165f1d tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.100695 Apr 02 21:17:52.779059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2980/5648] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Apr 2 21:17:52 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb/os-server-password => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:17:52.786210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:52.787026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:52.797161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.798832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.800843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:52.801719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:52.860997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:17:53.033170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c00fdb50-c1ec-42be-954f-293e83508060 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 204 len: 0 microversion: 2.1 time: 0.251268 Apr 02 21:17:53.038432 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2669/5649] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:17:52 2022] DELETE /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:17:53.048381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:53.049030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:53.056892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:53.057360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:53.067990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:53.072386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:53.079577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:53.089276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:53.107331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:53.111469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:53.114356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:53.114942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:53.281104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:53.310500 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae04f3d4-c1d2-4198-8e6a-ae2a129e720a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1292 microversion: 2.1 time: 0.235919 Apr 02 21:17:53.314476 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2670/5650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:53 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1292 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:53.330778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:53.331406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:53.350066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:53.350656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:53.352700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:53.353374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:53.363191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:53.399596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4ce3c50-21db-46ac-958b-a4248661f507 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1511 microversion: 2.1 time: 0.356003 Apr 02 21:17:53.405625 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2981/5651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:53 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1511 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:53.672139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:53.689248 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-855c3794-a08c-4095-886e-3a9191eb755c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.373127 Apr 02 21:17:53.690212 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2671/5652] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:53 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:54.335484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:54.345665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:54.382783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:54.384434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:54.385512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:54.386876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:54.418019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:54.418651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:54.433783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:54.434567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:54.436366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:54.437056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:54.632136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:54.645043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-276273c2-4c6b-4fb9-81ce-0555e2bdb215 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.316996 Apr 02 21:17:54.659383 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2982/5653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:54 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:54.710247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:54.713120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:54.739799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:54.743745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:54.745952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:54.753572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:54.781017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:54.789337 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0e93635-abbc-4a83-bbdd-5aefa382728f tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1511 microversion: 2.1 time: 0.376704 Apr 02 21:17:54.794631 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2672/5654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:54 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1511 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:55.272118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:55.283881 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9530aa9d-7b35-488c-8075-45367621637f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.579594 Apr 02 21:17:55.296580 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2983/5655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:54 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:17:55.357893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8890e169-7bef-4fcd-8a99-9ead36e3dde4 req-a8be8668-a308-4c85-b568-739c98cb0346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c8f8e5-b999-4078-b783-2ed603ceb9eb", "name": "network-vif-deleted", "tag": "d8903482-af01-4f82-9962-cf0f37dfd603"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:55.366538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8890e169-7bef-4fcd-8a99-9ead36e3dde4 req-a8be8668-a308-4c85-b568-739c98cb0346 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:55.367060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8890e169-7bef-4fcd-8a99-9ead36e3dde4 req-a8be8668-a308-4c85-b568-739c98cb0346 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:55.388071 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8890e169-7bef-4fcd-8a99-9ead36e3dde4 req-a8be8668-a308-4c85-b568-739c98cb0346 service nova] Creating event network-vif-deleted:d8903482-af01-4f82-9962-cf0f37dfd603 for instance a3c8f8e5-b999-4078-b783-2ed603ceb9eb on nch2-master-1 Apr 02 21:17:55.394795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8890e169-7bef-4fcd-8a99-9ead36e3dde4 req-a8be8668-a308-4c85-b568-739c98cb0346 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041146 Apr 02 21:17:55.396012 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2673/5656] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:55.664260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:55.666956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:55.683773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:55.684239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:55.685791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:55.686241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:55.812730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:55.814109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:55.853423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:55.854687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:55.856650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:55.857706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:55.904271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:55.905128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:55.905797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lazy-loading 'fault' on Instance uuid a3c8f8e5-b999-4078-b783-2ed603ceb9eb {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:17:56.019516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:56.027569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9b3a6417fa482a8d2feb3552fec06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97a5ac274614973bfd3070db537d0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:56.046118 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13172baa-8f3d-4838-9ba9-df3037f2b9a1 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.385726 Apr 02 21:17:56.046731 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47744532-2fa3-49d6-ade8-29fc6219f834 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 200 len: 1306 microversion: 2.1 time: 0.237018 Apr 02 21:17:56.049255 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2984/5657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:55 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:56.050650 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2674/5658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:55 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 1306 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:56.056537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-47a63344-a7b5-4bc0-b5b4-a8fdd3c41290 req-dc2558e7-b8a9-41c0-b180-62fff314804f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415701ca-01a9-4905-ac67-42bbe08ecb47", "tag": "cef52a56-c4d6-4ff9-803d-208bfc96dbf1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:17:56.068827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-47a63344-a7b5-4bc0-b5b4-a8fdd3c41290 req-dc2558e7-b8a9-41c0-b180-62fff314804f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:56.069591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-47a63344-a7b5-4bc0-b5b4-a8fdd3c41290 req-dc2558e7-b8a9-41c0-b180-62fff314804f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:56.085745 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-47a63344-a7b5-4bc0-b5b4-a8fdd3c41290 req-dc2558e7-b8a9-41c0-b180-62fff314804f service nova] Creating event network-changed:cef52a56-c4d6-4ff9-803d-208bfc96dbf1 for instance 415701ca-01a9-4905-ac67-42bbe08ecb47 on nch2-master-1 Apr 02 21:17:56.099110 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-47a63344-a7b5-4bc0-b5b4-a8fdd3c41290 req-dc2558e7-b8a9-41c0-b180-62fff314804f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046822 Apr 02 21:17:56.100338 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2985/5659] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:17:56.303726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:56.304476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:56.312536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:56.313356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:56.314397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:56.314913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:56.557998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:56.567679 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9331fdec-7086-4528-b2d6-0637e8cf713d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.268496 Apr 02 21:17:56.568649 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2675/5660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:56 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:57.067364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:57.068842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:57.080059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:57.080810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] [instance: a3c8f8e5-b999-4078-b783-2ed603ceb9eb] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:57.083053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:57.085337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:57.087947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:57.088870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:57.092169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:57.092669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:57.093506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:57.093999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:57.113909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] HTTP exception thrown: Instance a3c8f8e5-b999-4078-b783-2ed603ceb9eb could not be found. Apr 02 21:17:57.114524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] Returning 404 to user: Instance a3c8f8e5-b999-4078-b783-2ed603ceb9eb could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:17:57.115380 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99bd506b-d0ec-42a4-8a70-6c682ede7115 tempest-ServerPasswordTestJSON-362706251 tempest-ServerPasswordTestJSON-362706251-project] 10.222.0.18 "GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb" status: 404 len: 111 microversion: 2.1 time: 0.053495 Apr 02 21:17:57.115978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2986/5661] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:57 2022] GET /compute/v2.1/servers/a3c8f8e5-b999-4078-b783-2ed603ceb9eb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:17:57.282328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:57.293083 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7e61f0e-4733-4f40-bec4-2e5226688cdc tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.231407 Apr 02 21:17:57.294605 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2676/5662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:57 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:57.586684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:57.587334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:57.596815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:57.597784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:57.598597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:57.599043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:58.162026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:58.175094 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed600758-0253-4a0e-a4fc-4cd22f88fe27 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.590039 Apr 02 21:17:58.175982 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2987/5663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:57 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:58.312991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:58.314505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:58.322418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:58.323112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:58.323943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:58.324423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:58.504065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:58.511902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-238fc5ae-9274-4ead-9ecd-9297972c1668 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.204022 Apr 02 21:17:58.522562 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2677/5664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:58 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:59.191835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:59.192633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:59.201508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:59.202244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:59.203211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:59.203658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:59.532000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:59.537254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:17:59.539541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:17:59.547985 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3fb0716-05f1-4803-846e-652d5908d3bc tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.359918 Apr 02 21:17:59.550387 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2988/5665] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:59 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:17:59.562469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:59.563140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:59.564191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:17:59.564735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:17:59.678862 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:17:59.695099 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df1ee1de-624c-4dae-995f-2f717e88148a tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.169335 Apr 02 21:17:59.696410 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2678/5666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:17:59 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:00.570882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:00.572146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:00.591990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:00.593342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:00.595096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:00.596356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:00.716751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:00.718067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:00.727889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:00.728732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:00.729793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:00.730616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:00.832705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:00.843406 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b46b0e1-1732-411b-b98f-e81ffaa6a71b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.279406 Apr 02 21:18:00.846818 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2989/5667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:00 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:00.884778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:00.900152 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f9d5b86-0b37-48a8-81ac-4df09c96dce2 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.190360 Apr 02 21:18:00.914736 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2679/5668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:00 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:01.864197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:01.865212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:01.877543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:01.877998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:01.880617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:01.883833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:01.919387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:01.920023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:01.930951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:01.941755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:01.945511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:01.950987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:02.094719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:02.111147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3618ce7-a9f3-4f09-8a71-d311c6ff13a5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.251510 Apr 02 21:18:02.111946 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2990/5669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:01 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:02.124515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:02.134977 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-554fc94f-c603-4911-81d8-1379038681f4 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.219903 Apr 02 21:18:02.137399 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2680/5670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:01 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:02.297075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-543678423", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "b634a668-35fa-424f-8d79-0691a454a52e"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:02.337979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0bfd037b-7a5c-4e96-a99b-d580f34d8ea2 req-fe76813f-6474-42d4-804d-9bcb8471fea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415701ca-01a9-4905-ac67-42bbe08ecb47", "name": "network-vif-plugged", "status": "completed", "tag": "cef52a56-c4d6-4ff9-803d-208bfc96dbf1"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:02.357963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0bfd037b-7a5c-4e96-a99b-d580f34d8ea2 req-fe76813f-6474-42d4-804d-9bcb8471fea1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:02.358423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0bfd037b-7a5c-4e96-a99b-d580f34d8ea2 req-fe76813f-6474-42d4-804d-9bcb8471fea1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:02.367870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] validate_networks() for [('b634a668-35fa-424f-8d79-0691a454a52e', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:18:02.395045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0bfd037b-7a5c-4e96-a99b-d580f34d8ea2 req-fe76813f-6474-42d4-804d-9bcb8471fea1 service nova] Creating event network-vif-plugged:cef52a56-c4d6-4ff9-803d-208bfc96dbf1 for instance 415701ca-01a9-4905-ac67-42bbe08ecb47 on nch2-master-1 Apr 02 21:18:02.412367 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0bfd037b-7a5c-4e96-a99b-d580f34d8ea2 req-fe76813f-6474-42d4-804d-9bcb8471fea1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272711 Apr 02 21:18:02.412730 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2681/5671] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:02.922274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:18:02.923274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:18:02.924920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:18:02.925596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:18:02.926709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:18:02.939521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:02.940404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:02.941556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:02.942406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:02.969598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Getting quotas for project 581bd6e5aa8549e88914f48abe9466c3. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:18:02.976177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Getting quotas for user bf9fca6965154280ba112fb0026d500c and project 581bd6e5aa8549e88914f48abe9466c3. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:18:03.000943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:18:03.004161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:18:03.076983 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4b783fa-f45f-497d-9a8d-50418f3db81c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960355 Apr 02 21:18:03.079736 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2991/5672] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:18:03.094297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9c8fe01d-adee-418e-bea2-6dddc9bdf80b tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:03.096606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9c8fe01d-adee-418e-bea2-6dddc9bdf80b tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:03.130109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:03.130997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:03.138167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:03.138994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:03.140185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:03.141100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:03.181813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9c8fe01d-adee-418e-bea2-6dddc9bdf80b tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:03.192556 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9c8fe01d-adee-418e-bea2-6dddc9bdf80b tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1227 microversion: 2.1 time: 0.106256 Apr 02 21:18:03.209741 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2682/5673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:03 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1227 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:03.225610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:03.226451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:03.242024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:03.242536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:03.243354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:03.244188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:03.480678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:03.491047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fae55365-37be-4d5a-a760-8cc14e08a1e9 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.365002 Apr 02 21:18:03.491916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2992/5674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:03 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:03.585764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:03.594305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89797385-96ae-4582-b840-508f9cf5fdd0 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1298 microversion: 2.1 time: 0.383105 Apr 02 21:18:03.603927 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2683/5675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:03 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1298 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:04.226489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:04.227115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:04.244094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.244583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.245730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.246509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.327543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:04.347378 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3d8db638-e0e7-4878-87c9-746cb301ae0c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1287 microversion: 2.1 time: 0.123257 Apr 02 21:18:04.360496 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2993/5676] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:04 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:04.509226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:04.510078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:04.518645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.519355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.521051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.521745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.612172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:04.613136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:04.620969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.621515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.622377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.623009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.726578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:04.736377 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3266de44-1a23-40b5-867a-d0f0a9b6de6e tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1471 microversion: 2.1 time: 0.127401 Apr 02 21:18:04.737141 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2994/5677] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:04 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1471 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:04.756050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:04.758015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:04.765204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.765804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.767204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.767758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.808327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:04.816334 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9045ded1-944e-4b13-a5d3-802f5ad12fbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.311644 Apr 02 21:18:04.817438 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2684/5678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:04 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:04.878450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:04.897812 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d18b148f-88a2-41cb-8847-dc6608252160 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1471 microversion: 2.1 time: 0.146039 Apr 02 21:18:04.899351 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2995/5679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:04 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:04.915214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:04.916016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:04.924054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.925298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:04.926686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:04.927448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.368190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:05.369032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:05.376794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:05.377581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.378931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:05.379562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.491178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:05.492771 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1062fbec-9bb3-4306-88c2-c37a89e9fde0 tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1622 microversion: 2.1 time: 0.581554 Apr 02 21:18:05.493274 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2685/5680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:04 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1622 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:05.509180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:05.509804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:05.510407 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf43592e-0dce-421d-86be-4bca4a91f542 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1285 microversion: 2.1 time: 0.147144 Apr 02 21:18:05.511316 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2996/5681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:05 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:05.526715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:05.527901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.530641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:05.531101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.836862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:05.837641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:05.845749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:05.846317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.847240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:05.847791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:05.990956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ff67f7e8-9c96-4fa8-ae89-5c7bf66e345f tempest-TestSecurityGroupsBasicOps-551100778 tempest-TestSecurityGroupsBasicOps-551100778-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1914 microversion: 2.1 time: 0.486035 Apr 02 21:18:06.004338 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2686/5682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:05 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1914 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:06.025399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:06.033718 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59cf9ce7-f71c-4b57-8998-b334cd11fb77 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.203685 Apr 02 21:18:06.034278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2997/5683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:05 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:06.215200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:06.216481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:06.226378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:06.226841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:06.228098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:06.229343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:06.269606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:18:06.384880 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b23d7bf4-5bc3-4e54-b19b-e62dee1f0ba7 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "DELETE /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 204 len: 0 microversion: 2.1 time: 0.173318 Apr 02 21:18:06.385823 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2687/5684] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:06 2022] DELETE /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:18:06.396198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:06.397145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:06.409441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:06.410878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:06.412067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:06.412784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:06.530699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:06.533180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:06.541676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:06.543133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:06.544775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:06.545534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:06.619013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:06.634513 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1eb2ffd5-bc78-4e4f-b6f4-47147dd4b8b6 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1477 microversion: 2.1 time: 0.242808 Apr 02 21:18:06.634513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2998/5685] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:06 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:06.814655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:06.823534 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42627cec-8a53-483b-814a-1df7258d6582 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1327 microversion: 2.1 time: 0.299801 Apr 02 21:18:06.836076 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2688/5686] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:06 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1327 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:07.051105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:07.051883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:07.065051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.069944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.073640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.074200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.421635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-61bd63e7-62bb-4c55-ada6-c8c3e25cc6a2 req-e554238d-f33c-4e7d-848a-00fd17de8917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc125c7-b54f-42a2-9392-2bc5399f4e39", "tag": "f301f721-5bf0-47c1-8c91-df80ddd9accf"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:07.431155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-61bd63e7-62bb-4c55-ada6-c8c3e25cc6a2 req-e554238d-f33c-4e7d-848a-00fd17de8917 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.431671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-61bd63e7-62bb-4c55-ada6-c8c3e25cc6a2 req-e554238d-f33c-4e7d-848a-00fd17de8917 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.466041 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-61bd63e7-62bb-4c55-ada6-c8c3e25cc6a2 req-e554238d-f33c-4e7d-848a-00fd17de8917 service nova] Creating event network-changed:f301f721-5bf0-47c1-8c91-df80ddd9accf for instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 on nch1-master-1 Apr 02 21:18:07.471810 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-61bd63e7-62bb-4c55-ada6-c8c3e25cc6a2 req-e554238d-f33c-4e7d-848a-00fd17de8917 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056473 Apr 02 21:18:07.476180 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2689/5687] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:07.506613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:07.523353 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be9d3615-8360-4f00-814a-3681c98bbb5d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.475370 Apr 02 21:18:07.527652 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 2999/5688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:07 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:07.652937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:07.654343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:07.665202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.665991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.667087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.667892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.844405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:07.845556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:07.854540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.855364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.857682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:07.858348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:07.904321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:07.914958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20cc8e00-df56-4d93-b6d7-fe2c9883de50 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1477 microversion: 2.1 time: 0.267639 Apr 02 21:18:07.916480 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2690/5689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:07 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:08.544604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:08.545471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:08.552472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:08.553181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:08.554164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:08.554823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:08.568061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:08.585888 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54360516-1182-47ed-b737-c7c4ecfbdf9c tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1327 microversion: 2.1 time: 0.746810 Apr 02 21:18:08.587472 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3000/5690] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:07 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1327 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:08.906879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f3537b85-d9b3-47ad-9934-ae27547fed3a req-96487824-717c-4a08-b1a6-e3aaebd3e6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415701ca-01a9-4905-ac67-42bbe08ecb47", "name": "network-vif-deleted", "tag": "cef52a56-c4d6-4ff9-803d-208bfc96dbf1"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:08.924638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f3537b85-d9b3-47ad-9934-ae27547fed3a req-96487824-717c-4a08-b1a6-e3aaebd3e6e6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:08.925445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f3537b85-d9b3-47ad-9934-ae27547fed3a req-96487824-717c-4a08-b1a6-e3aaebd3e6e6 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:08.961056 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f3537b85-d9b3-47ad-9934-ae27547fed3a req-96487824-717c-4a08-b1a6-e3aaebd3e6e6 service nova] Creating event network-vif-deleted:cef52a56-c4d6-4ff9-803d-208bfc96dbf1 for instance 415701ca-01a9-4905-ac67-42bbe08ecb47 on nch2-master-1 Apr 02 21:18:08.968622 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f3537b85-d9b3-47ad-9934-ae27547fed3a req-96487824-717c-4a08-b1a6-e3aaebd3e6e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170374 Apr 02 21:18:08.970205 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3001/5691] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:08.977311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:08.978241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:08.987386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:08.988538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:08.990188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:08.990649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:09.031490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:09.032085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:09.032674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lazy-loading 'fault' on Instance uuid 415701ca-01a9-4905-ac67-42bbe08ecb47 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:18:09.078909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:09.086919 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c1a36b6-5c8a-46af-91fe-fe76289891fd tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 200 len: 1330 microversion: 2.1 time: 0.114294 Apr 02 21:18:09.087512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3002/5692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:08 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:09.095293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:09.103611 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-98835f36-ffe1-4d48-8785-89b2b9cf1cff tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.564078 Apr 02 21:18:09.104190 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2691/5693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:08 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:09.603453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:09.604697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:09.612960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:09.613421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:09.614419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:09.614866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:09.824013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:09.831906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4bc17baf-09cc-49a0-9b52-9f09a6999429 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1327 microversion: 2.1 time: 0.232343 Apr 02 21:18:09.832499 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3003/5694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:09 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1327 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:10.105810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:10.107281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: 415701ca-01a9-4905-ac67-42bbe08ecb47] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:10.114264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:10.114838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:10.115692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:10.116279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:10.121283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:10.121966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:10.129594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:10.130007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:10.131103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:10.131355 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] HTTP exception thrown: Instance 415701ca-01a9-4905-ac67-42bbe08ecb47 could not be found. Apr 02 21:18:10.131897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:10.132090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Returning 404 to user: Instance 415701ca-01a9-4905-ac67-42bbe08ecb47 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:10.133076 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b7ed33b-a8cb-473b-9aca-81c41b618080 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47" status: 404 len: 111 microversion: 2.1 time: 0.031470 Apr 02 21:18:10.133725 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2692/5695] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:10 2022] GET /compute/v2.1/servers/415701ca-01a9-4905-ac67-42bbe08ecb47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:18:10.853690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:10.854403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:10.861632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:10.862744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:10.864149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:10.864649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:10.935865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:10.945442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e56c100-b3dd-4fcb-9c7b-2dab3f090471 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1512 microversion: 2.1 time: 0.827622 Apr 02 21:18:10.954511 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3004/5696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:10 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1512 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:11.097275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:11.106834 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f1ae3db-5470-4641-a60a-1b82c54779cb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1327 microversion: 2.1 time: 0.260159 Apr 02 21:18:11.107794 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2693/5697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:10 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1327 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:11.962162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:11.962778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:11.970262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:11.971000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:11.971960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:11.972643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.129019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:12.130514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:12.148213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.149167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.150334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.151644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.224215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:12.234610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba4d2f0b-bb35-4ac2-a73a-fb5b44ebc56a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1489 microversion: 2.1 time: 0.276195 Apr 02 21:18:12.236588 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3005/5698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:11 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1489 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:12.255354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1062145152"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:12.259777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:12.270221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.270984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.271969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.274852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.383450 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5aede495-b6b9-4cef-aacb-5ca2dba40e0d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "PUT /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1062 microversion: 2.1 time: 0.134375 Apr 02 21:18:12.386528 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3006/5699] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:18:12 2022] PUT /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1062 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:12.405896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:12.410838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:12.422306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.422850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.424439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.425203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.510040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:12.521668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-809ded2d-2f23-445b-b488-20b8db4dc6e1 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1327 microversion: 2.1 time: 0.398711 Apr 02 21:18:12.523418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2694/5700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:12 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1327 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:12.706450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:12.715415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49a6ee42-2e70-4afd-b119-0f1fa1d1db07 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1489 microversion: 2.1 time: 0.318026 Apr 02 21:18:12.718424 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3007/5701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:12 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1489 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:12.734228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:12.734998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:12.745801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.746411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:12.747827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:12.760340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.029051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-33289ad3-aea3-4abe-bee7-db03f425e910 req-dcc3ab94-ca04-4fe2-832d-34f5288caeed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc125c7-b54f-42a2-9392-2bc5399f4e39", "name": "network-vif-plugged", "status": "completed", "tag": "f301f721-5bf0-47c1-8c91-df80ddd9accf"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:13.042795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-33289ad3-aea3-4abe-bee7-db03f425e910 req-dcc3ab94-ca04-4fe2-832d-34f5288caeed service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.044625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-33289ad3-aea3-4abe-bee7-db03f425e910 req-dcc3ab94-ca04-4fe2-832d-34f5288caeed service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.073258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-33289ad3-aea3-4abe-bee7-db03f425e910 req-dcc3ab94-ca04-4fe2-832d-34f5288caeed service nova] Creating event network-vif-plugged:f301f721-5bf0-47c1-8c91-df80ddd9accf for instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 on nch1-master-1 Apr 02 21:18:13.081495 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-33289ad3-aea3-4abe-bee7-db03f425e910 req-dcc3ab94-ca04-4fe2-832d-34f5288caeed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057808 Apr 02 21:18:13.082561 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3008/5702] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:18:13.253631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:13.261895 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad2e1e1c-1cd5-491b-b1b9-8e0af4364883 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1489 microversion: 2.1 time: 0.532768 Apr 02 21:18:13.280395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:13.281327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:13.285123 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2695/5703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:12 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1489 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:13.289369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.290046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.291053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.291768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.318820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:18:13.420545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30bcbf45-d363-4ee3-9f9e-f09ca5a381fe tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 204 len: 0 microversion: 2.1 time: 0.144508 Apr 02 21:18:13.421949 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3009/5704] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:13 2022] DELETE /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:18:13.431870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:13.432842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:13.442741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.443214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.444023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.444500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.540818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:13.541433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:13.552750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.553391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.554156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:13.554683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:13.615530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:13.624235 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1215b1c5-cd5d-4b6b-9946-5128096452a3 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1495 microversion: 2.1 time: 0.197361 Apr 02 21:18:13.624932 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2696/5705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:13 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1495 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:13.960499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:13.962700 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-837fb9f1-b9d7-4abb-ad1a-49393edc20e7 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1327 microversion: 2.1 time: 0.427159 Apr 02 21:18:13.972376 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3010/5706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:13 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1327 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:14.642804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:14.643355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:14.661776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:14.662379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:14.663247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:14.663625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:14.952576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:14.962705 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-80e8a239-ab39-4f77-9e0a-65a33ca83e8c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1495 microversion: 2.1 time: 0.325194 Apr 02 21:18:14.963206 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2697/5707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:14 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1495 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:14.979224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:14.979868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:14.987187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:14.987709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:14.988602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:14.989141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:15.408070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:15.417452 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4aa0b81-1ac1-45ae-b8b3-69e317eeffbb tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1528 microversion: 2.1 time: 0.442074 Apr 02 21:18:15.418049 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3011/5708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:14 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:15.435854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:15.436520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:15.454182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:15.454653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:15.455502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:15.455955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:15.984834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:15.986434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:16.030565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.031874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.033756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.034529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.108061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:16.128533 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-405c2d2c-1810-441f-874c-3115e61f9e16 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1528 microversion: 2.1 time: 0.696847 Apr 02 21:18:16.149700 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2698/5709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:15 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1528 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:16.533880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:16.535120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:16.551232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.552233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.553566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.554137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.570863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] HTTP exception thrown: Instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 could not be found. Apr 02 21:18:16.576763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Returning 404 to user: Instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:16.578480 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-330d3b1b-b488-4fdf-9eaf-9e9a681bab99 tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 404 len: 111 microversion: 2.1 time: 0.426837 Apr 02 21:18:16.579342 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2699/5710] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:16 2022] DELETE /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 111 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:16.592151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:16.593495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:16.604491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.614571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.616695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.617509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.795018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:16.807247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8865ff3a-4bee-496e-b462-5e2460d870b2 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 200 len: 1495 microversion: 2.1 time: 0.830425 Apr 02 21:18:16.808130 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3012/5711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:15 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 1495 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:16.810522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:16.823454 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-90bfbb00-9cd4-4a00-b25d-fb8bcbd7d535 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1528 microversion: 2.1 time: 0.235979 Apr 02 21:18:16.829422 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2700/5712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:16 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1528 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:16.849520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Action: 'update', calling method: >, body: {"server": {"name": "fdc125c7-b54f-42a2-9392-2bc5399f4e39_new"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:16.851872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:16.875385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.882936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.885110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.885806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.910353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] HTTP exception thrown: Instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 could not be found. Apr 02 21:18:16.910985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] Returning 404 to user: Instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:16.912018 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f3d7999-5949-4501-afbb-47a52046c10b tempest-ServersNegativeTestMultiTenantJSON-1171378976 tempest-ServersNegativeTestMultiTenantJSON-1171378976-project] 10.222.0.18 "PUT /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 404 len: 111 microversion: 2.1 time: 0.070120 Apr 02 21:18:16.913994 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2701/5713] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:18:16 2022] PUT /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:16.931638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:16.932233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:16.940132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.941360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.943024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:16.944104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:16.985975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:18:17.027860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-878d1463-8aa7-4c7e-bf80-650c09ce67d6 req-37391341-dcdc-432f-9543-9cf84aa74d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b81534-5a19-429b-b131-46c884ac57b7", "name": "network-vif-deleted", "tag": "e12f560f-cc44-4639-bc3a-f4fe034a299b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:17.089586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-878d1463-8aa7-4c7e-bf80-650c09ce67d6 req-37391341-dcdc-432f-9543-9cf84aa74d02 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.090713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-878d1463-8aa7-4c7e-bf80-650c09ce67d6 req-37391341-dcdc-432f-9543-9cf84aa74d02 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.134169 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-878d1463-8aa7-4c7e-bf80-650c09ce67d6 req-37391341-dcdc-432f-9543-9cf84aa74d02 service nova] Creating event network-vif-deleted:e12f560f-cc44-4639-bc3a-f4fe034a299b for instance 07b81534-5a19-429b-b131-46c884ac57b7 on nch1-master-1 Apr 02 21:18:17.151263 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-878d1463-8aa7-4c7e-bf80-650c09ce67d6 req-37391341-dcdc-432f-9543-9cf84aa74d02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.338711 Apr 02 21:18:17.155392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3013/5714] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:17.212510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6cb1dfed-d4c4-46e1-8e00-f587e01a0e17 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 204 len: 0 microversion: 2.1 time: 0.290321 Apr 02 21:18:17.213602 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2702/5715] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:16 2022] DELETE /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:18:17.222961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:17.223684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:17.233052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.236609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.237774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.241181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.643049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:17.662747 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a229052-9337-466e-8e17-395d41b60d13 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1534 microversion: 2.1 time: 0.444019 Apr 02 21:18:17.663981 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3014/5716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:17 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1534 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:17.826742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:17.828376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:17.835651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.836470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.837533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.838204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.858418 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 07b81534-5a19-429b-b131-46c884ac57b7 could not be found. Apr 02 21:18:17.864992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 07b81534-5a19-429b-b131-46c884ac57b7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:17.868252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0687d0e9-5199-4316-bfdf-3ab6a98f19e4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 404 len: 111 microversion: 2.1 time: 0.046405 Apr 02 21:18:17.873102 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2703/5717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:17 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:17.883546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:17.884540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:17.892366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.893186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.894287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.894927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.912142 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 07b81534-5a19-429b-b131-46c884ac57b7 could not be found. Apr 02 21:18:17.913136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 07b81534-5a19-429b-b131-46c884ac57b7 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:17.914400 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f637ece-ff27-4d7f-95c5-1127a18de53b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 404 len: 111 microversion: 2.1 time: 0.034718 Apr 02 21:18:17.915564 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3015/5718] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:17 2022] DELETE /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:17.924396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:17.925402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 07b81534-5a19-429b-b131-46c884ac57b7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:17.932113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.932886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.934678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.935396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.952843 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 07b81534-5a19-429b-b131-46c884ac57b7 could not be found. Apr 02 21:18:17.953347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 07b81534-5a19-429b-b131-46c884ac57b7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:17.955195 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e189b073-3ae1-4e5a-9490-987215a920f5 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7" status: 404 len: 111 microversion: 2.1 time: 0.035164 Apr 02 21:18:17.955770 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2704/5719] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:17 2022] GET /compute/v2.1/servers/07b81534-5a19-429b-b131-46c884ac57b7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:17.965475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:17.966321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:17.973357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.973903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.975032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:17.975677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:17.999438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 5a263231-bf3c-4b10-a7b8-37853a186b7f could not be found. Apr 02 21:18:18.000092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 5a263231-bf3c-4b10-a7b8-37853a186b7f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.001062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aca991f9-f1e1-47f3-99bb-2941ea0478a6 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 404 len: 111 microversion: 2.1 time: 0.040803 Apr 02 21:18:18.003692 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3016/5720] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:17 2022] DELETE /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.010547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.011511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 5a263231-bf3c-4b10-a7b8-37853a186b7f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.022052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.022871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.024056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.026498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.048921 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 5a263231-bf3c-4b10-a7b8-37853a186b7f could not be found. Apr 02 21:18:18.049807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 5a263231-bf3c-4b10-a7b8-37853a186b7f could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.050670 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be79dbf0-b4e9-4d85-9728-cb7cff89669c tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f" status: 404 len: 111 microversion: 2.1 time: 0.044622 Apr 02 21:18:18.051500 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2705/5721] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/5a263231-bf3c-4b10-a7b8-37853a186b7f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:18:18.060484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.060998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.068333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.068832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.069759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.070203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.088629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 could not be found. Apr 02 21:18:18.089465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.091918 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28cca41a-3a2c-48dc-8dfb-6c145f5de88a tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 404 len: 111 microversion: 2.1 time: 0.036295 Apr 02 21:18:18.096647 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3017/5722] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.102310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.103144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 0b096d4a-2acb-43b8-a508-f3c6516021a7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.112711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.114414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.119297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.120768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.153095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 could not be found. Apr 02 21:18:18.154113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 0b096d4a-2acb-43b8-a508-f3c6516021a7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.155235 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3610a911-1dcc-4203-81ce-a737207e2c56 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7" status: 404 len: 111 microversion: 2.1 time: 0.057347 Apr 02 21:18:18.159209 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2706/5723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/0b096d4a-2acb-43b8-a508-f3c6516021a7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.167856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.169066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.178168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.180238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.181180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.182333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.220185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 4e4747f8-3526-4b56-b80a-4b130933a54d could not be found. Apr 02 21:18:18.222649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 4e4747f8-3526-4b56-b80a-4b130933a54d could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.225012 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c04ae8db-8cf4-413f-8651-318eeb18dbbb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 404 len: 111 microversion: 2.1 time: 0.064750 Apr 02 21:18:18.226248 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3018/5724] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.234473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.235129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 4e4747f8-3526-4b56-b80a-4b130933a54d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.255664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.256164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.256975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.265312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.266483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.266993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.277282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.278465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.279308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.280320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.303703 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 4e4747f8-3526-4b56-b80a-4b130933a54d could not be found. Apr 02 21:18:18.305679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 4e4747f8-3526-4b56-b80a-4b130933a54d could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.309045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a704c1e5-9de6-4c78-bf9f-81166904f1fd tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d" status: 404 len: 111 microversion: 2.1 time: 0.077207 Apr 02 21:18:18.312471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:18:18.316057 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2707/5725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/4e4747f8-3526-4b56-b80a-4b130933a54d => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.323464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3e9f2eec-14bb-4189-85d8-210b6aedc247 req-80c9cd1d-6837-48f5-8f1c-3bc1ea85dd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f816b0b7-9b69-4dab-b07b-539b28950094", "tag": "9721df02-c2e2-4957-a3be-57a586573989"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:18.345245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3e9f2eec-14bb-4189-85d8-210b6aedc247 req-80c9cd1d-6837-48f5-8f1c-3bc1ea85dd00 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.345629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3e9f2eec-14bb-4189-85d8-210b6aedc247 req-80c9cd1d-6837-48f5-8f1c-3bc1ea85dd00 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.391421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3e9f2eec-14bb-4189-85d8-210b6aedc247 req-80c9cd1d-6837-48f5-8f1c-3bc1ea85dd00 service nova] Creating event network-changed:9721df02-c2e2-4957-a3be-57a586573989 for instance f816b0b7-9b69-4dab-b07b-539b28950094 on nch1-master-1 Apr 02 21:18:18.405054 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3e9f2eec-14bb-4189-85d8-210b6aedc247 req-80c9cd1d-6837-48f5-8f1c-3bc1ea85dd00 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080466 Apr 02 21:18:18.407452 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2708/5726] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:18.421744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.423383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.438409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.438884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.439695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.440149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.458780 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e8428d2-902e-4c86-bfc8-c749f9b31985 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 204 len: 0 microversion: 2.1 time: 0.195426 Apr 02 21:18:18.459670 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3019/5727] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:18:18.474104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.477464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.485674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.486621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.488379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.489812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.500489 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance aeae56db-b55b-4c39-8c34-6e06ac357c58 could not be found. Apr 02 21:18:18.501466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance aeae56db-b55b-4c39-8c34-6e06ac357c58 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.502577 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b836eeb-2b46-41cd-b58e-132a4a77f7f7 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 404 len: 111 microversion: 2.1 time: 0.093831 Apr 02 21:18:18.503501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2709/5728] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.515788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.517003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: aeae56db-b55b-4c39-8c34-6e06ac357c58] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.526516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.527129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.528106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.528606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.553079 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance aeae56db-b55b-4c39-8c34-6e06ac357c58 could not be found. Apr 02 21:18:18.553774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance aeae56db-b55b-4c39-8c34-6e06ac357c58 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.554713 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-758c83ec-53ff-450d-b736-34a6bc4efa2f tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58" status: 404 len: 111 microversion: 2.1 time: 0.043864 Apr 02 21:18:18.572517 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2710/5729] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/aeae56db-b55b-4c39-8c34-6e06ac357c58 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.585205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.587200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.613148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.613635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.614463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.614921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.645377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 23eec316-b113-4eb9-9745-5ce00e697e7e could not be found. Apr 02 21:18:18.645377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 23eec316-b113-4eb9-9745-5ce00e697e7e could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.645987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62f8701f-08e5-4b5c-9f00-0a951eb91395 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 404 len: 111 microversion: 2.1 time: 0.072379 Apr 02 21:18:18.646567 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2711/5730] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.655888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.663742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 23eec316-b113-4eb9-9745-5ce00e697e7e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.672626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.673095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.675396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.680702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.703070 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 23eec316-b113-4eb9-9745-5ce00e697e7e could not be found. Apr 02 21:18:18.706616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 23eec316-b113-4eb9-9745-5ce00e697e7e could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.707421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-04761e0d-0d99-4c10-9329-ec8978c513c4 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e" status: 404 len: 111 microversion: 2.1 time: 0.056687 Apr 02 21:18:18.712714 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2712/5731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/23eec316-b113-4eb9-9745-5ce00e697e7e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.723579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.724210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.741464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.741674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.742605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.743057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.798972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:18.821206 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1c899c6-be6d-42ee-9662-a59c5b1bdf67 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1769 microversion: 2.1 time: 0.356310 Apr 02 21:18:18.823199 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3020/5732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1769 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:18.836423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c429d55-37f5-4872-ae90-b9396c0f5bdb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.839280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c429d55-37f5-4872-ae90-b9396c0f5bdb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.850853 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-9c429d55-37f5-4872-ae90-b9396c0f5bdb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 could not be found. Apr 02 21:18:18.853680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c429d55-37f5-4872-ae90-b9396c0f5bdb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.855256 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c429d55-37f5-4872-ae90-b9396c0f5bdb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1" status: 404 len: 111 microversion: 2.1 time: 0.030215 Apr 02 21:18:18.862676 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3021/5733] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.875240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-988948f9-9565-453b-894a-785ccb16c47d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.875909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-988948f9-9565-453b-894a-785ccb16c47d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: f6cdda13-34f2-4cca-8da5-501a07eb34f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.892744 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-988948f9-9565-453b-894a-785ccb16c47d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 could not be found. Apr 02 21:18:18.900807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-988948f9-9565-453b-894a-785ccb16c47d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance f6cdda13-34f2-4cca-8da5-501a07eb34f1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:18.902033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-988948f9-9565-453b-894a-785ccb16c47d tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1" status: 404 len: 111 microversion: 2.1 time: 0.037370 Apr 02 21:18:18.903281 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3022/5734] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/f6cdda13-34f2-4cca-8da5-501a07eb34f1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:18.921865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:18.922468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:18.939451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.942524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.944331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:18.951380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:18.982271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:18:19.103113 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f61a6f3-6ad1-4ba0-a991-01a111572ab0 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "DELETE /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 204 len: 0 microversion: 2.1 time: 0.185647 Apr 02 21:18:19.104323 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3023/5735] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:18:18 2022] DELETE /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:18:19.117161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:19.118206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:19.127947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:19.135227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:19.136251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:19.137378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:19.419528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9fca6965154280ba112fb0026d500c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581bd6e5aa8549e88914f48abe9466c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:19.428703 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f32e9e4-311e-4b69-b9cf-b80477820ea6 tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 200 len: 1534 microversion: 2.1 time: 0.714611 Apr 02 21:18:19.435979 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2713/5736] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:18 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 1534 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:19.756292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:19.768126 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7644323b-0528-49d4-8263-b046fc2359fb tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1480 microversion: 2.1 time: 0.658686 Apr 02 21:18:19.771989 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3024/5737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:19 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1480 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:19.843449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:19.844250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:19.851302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:19.851763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:19.852579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:19.853212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:20.297224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:20.318413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e85c11c5-6e77-4e3d-9e8c-a2b0775e5de5 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1769 microversion: 2.1 time: 0.478835 Apr 02 21:18:20.319014 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2714/5738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:19 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1769 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:20.433419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-da35450e-0cbc-4e91-a4e4-7e0d9d93d82d req-7b386b4c-11fb-41f5-b588-530d3695c128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc125c7-b54f-42a2-9392-2bc5399f4e39", "name": "network-vif-deleted", "tag": "f301f721-5bf0-47c1-8c91-df80ddd9accf"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:20.455498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:20.456383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] [instance: fdc125c7-b54f-42a2-9392-2bc5399f4e39] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:20.467738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-da35450e-0cbc-4e91-a4e4-7e0d9d93d82d req-7b386b4c-11fb-41f5-b588-530d3695c128 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:20.468284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-da35450e-0cbc-4e91-a4e4-7e0d9d93d82d req-7b386b4c-11fb-41f5-b588-530d3695c128 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:20.470832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:20.471291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:20.475532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:20.481554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:20.513088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-da35450e-0cbc-4e91-a4e4-7e0d9d93d82d req-7b386b4c-11fb-41f5-b588-530d3695c128 service nova] Creating event network-vif-deleted:f301f721-5bf0-47c1-8c91-df80ddd9accf for instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 on nch1-master-1 Apr 02 21:18:20.519772 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-da35450e-0cbc-4e91-a4e4-7e0d9d93d82d req-7b386b4c-11fb-41f5-b588-530d3695c128 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093469 Apr 02 21:18:20.520748 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] HTTP exception thrown: Instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 could not be found. Apr 02 21:18:20.521455 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3025/5739] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:20.521778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] Returning 404 to user: Instance fdc125c7-b54f-42a2-9392-2bc5399f4e39 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:20.522882 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47c62e85-0442-4c48-8a52-7567fd5881ec tempest-ServersNegativeTestMultiTenantJSON-811396550 tempest-ServersNegativeTestMultiTenantJSON-811396550-project] 10.222.0.18 "GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39" status: 404 len: 111 microversion: 2.1 time: 0.074365 Apr 02 21:18:20.524653 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2715/5740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:20 2022] GET /compute/v2.1/servers/fdc125c7-b54f-42a2-9392-2bc5399f4e39 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:20.788012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:20.789089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:20.796722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:20.797509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:20.798509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:20.799248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:21.336373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:21.337167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:21.349170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:21.350716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:21.352048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:21.352529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:21.464280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986a98734ff4476e83fcfbbf337274ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f99ad4a6bf4ec5ad3d7d4045018511', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:21.474793 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ff86ae48-112a-47d3-83b1-c83dcd235242 tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 200 len: 1530 microversion: 2.1 time: 0.142545 Apr 02 21:18:21.477864 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2716/5741] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:21 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 1530 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:18:21.925973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:21.933785 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c2ea7590-6337-415c-a38c-c389b2566026 tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1480 microversion: 2.1 time: 1.149950 Apr 02 21:18:21.934282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3026/5742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:20 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1480 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:22.494734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:22.495367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] [instance: f816b0b7-9b69-4dab-b07b-539b28950094] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:22.509947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:22.510786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:22.512408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:22.514991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:22.545980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a72ef074-9fe4-4276-beb4-94ae398af519 req-bd59649e-70ec-4689-93be-a94550e2bed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816b0b7-9b69-4dab-b07b-539b28950094", "name": "network-vif-deleted", "tag": "9721df02-c2e2-4957-a3be-57a586573989"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:22.574788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] HTTP exception thrown: Instance f816b0b7-9b69-4dab-b07b-539b28950094 could not be found. Apr 02 21:18:22.575876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a72ef074-9fe4-4276-beb4-94ae398af519 req-bd59649e-70ec-4689-93be-a94550e2bed0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:22.576349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a72ef074-9fe4-4276-beb4-94ae398af519 req-bd59649e-70ec-4689-93be-a94550e2bed0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:22.581024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Returning 404 to user: Instance f816b0b7-9b69-4dab-b07b-539b28950094 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:22.582029 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df3821d8-0ad8-470b-bedc-6a778f1f29ec tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094" status: 404 len: 111 microversion: 2.1 time: 0.091362 Apr 02 21:18:22.590015 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2717/5743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:22 2022] GET /compute/v2.1/servers/f816b0b7-9b69-4dab-b07b-539b28950094 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:22.607418 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a72ef074-9fe4-4276-beb4-94ae398af519 req-bd59649e-70ec-4689-93be-a94550e2bed0 service nova] Creating event network-vif-deleted:9721df02-c2e2-4957-a3be-57a586573989 for instance f816b0b7-9b69-4dab-b07b-539b28950094 on nch1-master-1 Apr 02 21:18:22.615163 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a72ef074-9fe4-4276-beb4-94ae398af519 req-bd59649e-70ec-4689-93be-a94550e2bed0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072727 Apr 02 21:18:22.616330 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3027/5744] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:22.959491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:22.960718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:22.968757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:22.969540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:22.970677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:22.971364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:23.042025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:23.042492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:23.043507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lazy-loading 'fault' on Instance uuid 508fbb35-494f-4d1c-9e93-4796909dbdfd {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:18:23.146344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b84c577baf8418180f894c99c643772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596094c632d2408d8963534a88f04156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:18:23.169664 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1027164d-1218-4013-9c8a-ca5930b1ad0b tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 200 len: 1283 microversion: 2.1 time: 0.222153 Apr 02 21:18:23.176242 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2718/5745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:22 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 1283 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:24.196649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:24.197845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] [instance: 508fbb35-494f-4d1c-9e93-4796909dbdfd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:18:24.207169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:24.207677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:24.208858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:24.211302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:24.237049 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] HTTP exception thrown: Instance 508fbb35-494f-4d1c-9e93-4796909dbdfd could not be found. Apr 02 21:18:24.237961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Returning 404 to user: Instance 508fbb35-494f-4d1c-9e93-4796909dbdfd could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:18:24.239271 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd" status: 404 len: 111 microversion: 2.1 time: 0.051653 Apr 02 21:18:24.239790 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3028/5746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:18:24 2022] GET /compute/v2.1/servers/508fbb35-494f-4d1c-9e93-4796909dbdfd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:18:24.764422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ed9fde36-e586-45ee-947b-d1784eaab106 req-d6fc5005-906a-4b82-8a90-76261276fe8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "508fbb35-494f-4d1c-9e93-4796909dbdfd", "name": "network-vif-deleted", "tag": "8f191590-0383-4d7c-87db-54e9c472575b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:18:24.789413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ed9fde36-e586-45ee-947b-d1784eaab106 req-d6fc5005-906a-4b82-8a90-76261276fe8c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:24.790172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ed9fde36-e586-45ee-947b-d1784eaab106 req-d6fc5005-906a-4b82-8a90-76261276fe8c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:24.807578 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ed9fde36-e586-45ee-947b-d1784eaab106 req-d6fc5005-906a-4b82-8a90-76261276fe8c service nova] Creating event network-vif-deleted:8f191590-0383-4d7c-87db-54e9c472575b for instance 508fbb35-494f-4d1c-9e93-4796909dbdfd on nch2-master-1 Apr 02 21:18:24.814505 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ed9fde36-e586-45ee-947b-d1784eaab106 req-d6fc5005-906a-4b82-8a90-76261276fe8c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058727 Apr 02 21:18:24.815807 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2719/5747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:27.121777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:27.122850 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2b378586-7067-49bc-836c-6f91953f49ef tempest-ServersTestJSON-2031852076 tempest-ServersTestJSON-2031852076-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001992 Apr 02 21:18:27.123451 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3029/5748] 10.222.0.18 () {56 vars in 885 bytes} [Sat Apr 2 21:18:27 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 02 21:18:30.316802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e657560-2d96-4611-b45c-f2878bc999cb tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] Calling method '.version_select at 0x7f54c7f0c040>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:30.357279 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e657560-2d96-4611-b45c-f2878bc999cb tempest-TestSecurityGroupsBasicOps-2033121144 tempest-TestSecurityGroupsBasicOps-2033121144-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-508642488" status: 202 len: 0 microversion: 2.1 time: 0.046532 Apr 02 21:18:30.357902 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2720/5749] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-508642488 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:18:32.310270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fc5ab822-661b-4537-8af1-0e21686b9ac8 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54c7891a60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:32.421690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fc5ab822-661b-4537-8af1-0e21686b9ac8 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bc1306bb-c753-40f0-8c31-125995c8dbef" status: 200 len: 343 microversion: 2.1 time: 0.115887 Apr 02 21:18:32.422640 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3030/5750] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:18:32 2022] GET /compute/v2.1/os-volumes/bc1306bb-c753-40f0-8c31-125995c8dbef => generated 343 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:34.031974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b53be1e-117a-4689-a767-70e355a0262c tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54d4061ee0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:34.142112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6b53be1e-117a-4689-a767-70e355a0262c tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/21625544-2ad1-4dad-b3ef-5d1b49c86fc8" status: 200 len: 343 microversion: 2.1 time: 0.121890 Apr 02 21:18:34.149486 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2721/5751] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:18:34 2022] GET /compute/v2.1/os-volumes/21625544-2ad1-4dad-b3ef-5d1b49c86fc8 => generated 343 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:36.858797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f64cf484-54f0-4150-ac38-3db14172c7d0 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54c77b79d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:36.946515 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f64cf484-54f0-4150-ac38-3db14172c7d0 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/45f1cc1d-7fab-4246-9d6c-969ad517b3f0" status: 200 len: 344 microversion: 2.1 time: 0.093065 Apr 02 21:18:36.947095 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3031/5752] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Apr 2 21:18:36 2022] GET /compute/v2.1/os-volumes/45f1cc1d-7fab-4246-9d6c-969ad517b3f0 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:36.958223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-636feda7-d23e-4c94-abe5-ee64d62fbef9 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54d42e5700>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:37.118482 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-636feda7-d23e-4c94-abe5-ee64d62fbef9 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.163938 Apr 02 21:18:37.120525 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2722/5753] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 21:18:36 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:37.132095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a4411b3-8b4e-476b-a598-e28b16867176 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54c78313a0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:37.252799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a4411b3-8b4e-476b-a598-e28b16867176 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.124747 Apr 02 21:18:37.253758 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3032/5754] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Apr 2 21:18:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:37.277428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df302d42-1077-4348-8747-c49611de5a81 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54d4da3e50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:37.458352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df302d42-1077-4348-8747-c49611de5a81 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.189617 Apr 02 21:18:37.465675 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2723/5755] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Apr 2 21:18:37 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:37.471342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ab9059c-f30d-4ff6-99e4-235c383bbb07 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54c77845e0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:37.705005 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ab9059c-f30d-4ff6-99e4-235c383bbb07 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.237284 Apr 02 21:18:37.705855 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3033/5756] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Apr 2 21:18:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:18:37.717683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5b86486-809d-4047-b0db-f9eb02696ae7 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54d49a49d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:37.900351 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5b86486-809d-4047-b0db-f9eb02696ae7 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.186719 Apr 02 21:18:37.900970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2724/5757] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Apr 2 21:18:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:18:37.914749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-177b1088-9584-49ff-bc61-82f6246b66a1 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54c780cf70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:38.095479 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-177b1088-9584-49ff-bc61-82f6246b66a1 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.183919 Apr 02 21:18:38.096141 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3034/5758] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 21:18:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:38.111987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-716ae542-a53c-4a65-90d9-0a2cd2005825 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54d42ca820>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:38.347714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-716ae542-a53c-4a65-90d9-0a2cd2005825 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.241675 Apr 02 21:18:38.348736 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2725/5759] 10.222.0.18 () {58 vars in 1187 bytes} [Sat Apr 2 21:18:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:38.366739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76fb007d-460c-4f31-8d2d-3394462efa88 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] Calling method '.version_select at 0x7f54c7784160>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:38.581713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76fb007d-460c-4f31-8d2d-3394462efa88 tempest-VolumesTestJSON-841549220 tempest-VolumesTestJSON-841549220-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.224758 Apr 02 21:18:38.582603 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3035/5760] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 21:18:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:18:59.571157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b411431a-0626-43fc-9c62-6b717bc7067e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:18:59.572430 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:18:59.572430 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:18:59.574764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b411431a-0626-43fc-9c62-6b717bc7067e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:59.575362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b411431a-0626-43fc-9c62-6b717bc7067e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:59.576415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b411431a-0626-43fc-9c62-6b717bc7067e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:18:59.579280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b411431a-0626-43fc-9c62-6b717bc7067e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:18:59.658414 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b411431a-0626-43fc-9c62-6b717bc7067e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.381604 Apr 02 21:18:59.675777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2726/5761] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Apr 2 21:18:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:18:59.880606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1050353891", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "e0b4c4bc-de45-4f73-9c94-e836543f4a58"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:00.016783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] validate_networks() for [('e0b4c4bc-de45-4f73-9c94-e836543f4a58', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:19:00.981029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:19:00.981622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:19:00.981940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:19:00.982362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:19:00.982786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:19:01.003383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:01.004066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:01.004746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:01.005200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:01.043588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Getting quotas for project 08287b395fcf45c38195909db7f53878. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:19:01.062854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Getting quotas for user f21abe9d0e7647b08690bc957f3960b1 and project 08287b395fcf45c38195909db7f53878. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:19:01.083382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:19:01.085927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:19:01.189337 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3db9bb9e-89a6-4e21-9491-5e0f097fd6ee tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.313425 Apr 02 21:19:01.201735 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3036/5762] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:18:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:19:01.207427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efb46159-b2fa-4306-9ba3-2c2cd818e153 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:01.209598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efb46159-b2fa-4306-9ba3-2c2cd818e153 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:01.328486 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efb46159-b2fa-4306-9ba3-2c2cd818e153 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1329 microversion: 2.1 time: 0.124918 Apr 02 21:19:01.332706 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2727/5763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:01 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1329 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:02.346568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:02.347164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:02.378498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:02.378969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:02.379787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:02.380241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:02.587942 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1595fb2d-f8a5-49c3-9f02-ebd3b16fa4f2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1346 microversion: 2.1 time: 0.246027 Apr 02 21:19:02.600730 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3037/5764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:02 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1346 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:03.608321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:03.610193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:03.630826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:03.631284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:03.632100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:03.632595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:03.848209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f78a9d0-b3c8-447f-87cd-40dfe4d57ebb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1424 microversion: 2.1 time: 0.243982 Apr 02 21:19:03.862384 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2728/5765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:03 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1424 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:04.871123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:04.872736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:04.891896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:04.892187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:04.895394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:04.901602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:05.118906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b619a9ab-ee57-4cb7-aebf-27744197b15a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1422 microversion: 2.1 time: 0.252992 Apr 02 21:19:05.121923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3038/5766] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:04 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1422 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:06.137773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:06.142114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:06.159051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:06.160473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:06.163440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:06.168393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:06.578555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-70455146-4809-4c27-a995-13d12a778c7c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 0.445586 Apr 02 21:19:06.592651 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2729/5767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:06 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:07.568220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-ea2d10bf-4625-4b10-bc88-56e01e53ba57 req-991cd407-91e6-4aaf-b2b1-410ee2d06434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfe501e-f741-4dda-8b82-a575b154f763", "tag": "e25a5d29-4daf-4089-9f45-da3193cc630a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:07.604017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:07.605131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:07.620904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ea2d10bf-4625-4b10-bc88-56e01e53ba57 req-991cd407-91e6-4aaf-b2b1-410ee2d06434 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:07.621481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-ea2d10bf-4625-4b10-bc88-56e01e53ba57 req-991cd407-91e6-4aaf-b2b1-410ee2d06434 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:07.624876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:07.627027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:07.628590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:07.629339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:07.653444 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-ea2d10bf-4625-4b10-bc88-56e01e53ba57 req-991cd407-91e6-4aaf-b2b1-410ee2d06434 service nova] Creating event network-changed:e25a5d29-4daf-4089-9f45-da3193cc630a for instance acfe501e-f741-4dda-8b82-a575b154f763 on nch2-master-1 Apr 02 21:19:07.669182 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-ea2d10bf-4625-4b10-bc88-56e01e53ba57 req-991cd407-91e6-4aaf-b2b1-410ee2d06434 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106753 Apr 02 21:19:07.670101 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3039/5768] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:08.040214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:08.040856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:08.061562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:08.062288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:08.063559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:08.064532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:08.376125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lazy-loading 'services' on Instance uuid 3404d76c-428c-4447-94c1-98c5a0283dca {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:19:08.562299 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5ec849a-0c1c-4691-9bc9-42544524387f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca/os-volume_attachments/c87f93d6-de80-42a3-9d17-3629759f6c8b" status: 202 len: 0 microversion: 2.1 time: 0.526817 Apr 02 21:19:08.567402 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3040/5769] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:19:08 2022] DELETE /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca/os-volume_attachments/c87f93d6-de80-42a3-9d17-3629759f6c8b => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:19:08.952260 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5ccce249-75dd-45ed-bded-63d44e2bcc3e tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 1.358268 Apr 02 21:19:08.954645 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2730/5770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:07 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:09.824872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:09.826682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:09.836226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:09.837022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:09.837858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:09.838349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:09.878205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:19:09.972810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:09.974701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:09.995218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:09.997814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:10.001676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:10.003007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:10.068427 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03778ec9-e99f-4f52-9f97-4e6e2fa9826f tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 204 len: 0 microversion: 2.1 time: 0.249534 Apr 02 21:19:10.082529 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3041/5771] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:19:09 2022] DELETE /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:19:10.101036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:10.102126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:10.110626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:10.111346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:10.113168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:10.114033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:10.412809 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d74f392f-012d-40a4-a760-b89467cb40ff tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 0.446656 Apr 02 21:19:10.430991 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2731/5772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:09 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:10.907893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:19:10.920287 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1016f14d-ee08-46dc-9bd7-19d03743c5a9 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1515 microversion: 2.1 time: 0.830815 Apr 02 21:19:10.924183 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3042/5773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:10 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1515 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:11.436266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:11.436927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:11.446238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:11.446708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:11.453843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:11.461241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:11.943454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:11.944771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:11.965893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:11.969810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:11.970847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:11.972105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:12.059558 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-73bf524b-f1f6-4539-86a5-815f961dac2c tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 0.630294 Apr 02 21:19:12.060159 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2732/5774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:11 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:12.635958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:19:12.646773 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0528a59a-793d-4f74-b3d3-d3f770c2c8c4 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1515 microversion: 2.1 time: 0.707233 Apr 02 21:19:12.648586 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3043/5775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:11 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1515 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:19:13.077966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:13.078895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:13.095365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:13.096179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:13.097175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:13.097815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:13.607690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-026a2273-fa43-477d-957e-b6dbe1f11417 req-ffaf61d4-21f8-4106-96a7-2faa56c6b27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3404d76c-428c-4447-94c1-98c5a0283dca", "name": "network-vif-deleted", "tag": "c626a37a-e921-41cb-8c32-afdbb4e2a5ca"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:13.630346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-026a2273-fa43-477d-957e-b6dbe1f11417 req-ffaf61d4-21f8-4106-96a7-2faa56c6b27e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:13.630908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-026a2273-fa43-477d-957e-b6dbe1f11417 req-ffaf61d4-21f8-4106-96a7-2faa56c6b27e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:13.690548 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-026a2273-fa43-477d-957e-b6dbe1f11417 req-ffaf61d4-21f8-4106-96a7-2faa56c6b27e service nova] Creating event network-vif-deleted:c626a37a-e921-41cb-8c32-afdbb4e2a5ca for instance 3404d76c-428c-4447-94c1-98c5a0283dca on nch2-master-1 Apr 02 21:19:13.703365 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-026a2273-fa43-477d-957e-b6dbe1f11417 req-ffaf61d4-21f8-4106-96a7-2faa56c6b27e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101036 Apr 02 21:19:13.703998 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3044/5776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:19:13.724761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:13.731114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:13.751645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:13.752060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:13.753056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:13.753451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:13.880402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:13.885488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:13.885981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lazy-loading 'fault' on Instance uuid 3404d76c-428c-4447-94c1-98c5a0283dca {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:19:13.944889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aca3700d594a349789d5f3847894dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5fe471f4a924fd98ef24aa24abb736c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:19:13.961086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-655e7202-01a1-4fbd-9628-f6ee2c6d162d tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 200 len: 1309 microversion: 2.1 time: 0.251243 Apr 02 21:19:13.961696 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3045/5777] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:13 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:14.124401 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55f71404-670d-485f-a8d8-c6370d4f13dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 1.049505 Apr 02 21:19:14.133828 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2733/5778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:13 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:14.979193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:14.979937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] [instance: 3404d76c-428c-4447-94c1-98c5a0283dca] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:14.998988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:15.002474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:15.004741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:15.005341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:15.038409 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] HTTP exception thrown: Instance 3404d76c-428c-4447-94c1-98c5a0283dca could not be found. Apr 02 21:19:15.045383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] Returning 404 to user: Instance 3404d76c-428c-4447-94c1-98c5a0283dca could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:19:15.047803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7cdfbce5-2779-4132-876e-013aeb70dcb6 tempest-VolumesSnapshotTestJSON-244026219 tempest-VolumesSnapshotTestJSON-244026219-project] 10.222.0.18 "GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca" status: 404 len: 111 microversion: 2.1 time: 0.073290 Apr 02 21:19:15.053209 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3046/5779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:14 2022] GET /compute/v2.1/servers/3404d76c-428c-4447-94c1-98c5a0283dca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:15.142476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:15.143698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:15.154469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:15.155550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:15.158436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:15.160000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:16.553908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a5d1530-ed24-410b-ad77-c5744a6ea647 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 1.415274 Apr 02 21:19:16.572200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2734/5780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:15 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:17.590524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:17.592062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:17.617145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:17.617639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:17.618453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:17.618994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:18.981869 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-60383a22-6d65-47f9-b21b-643f8c0a87e4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 1.381046 Apr 02 21:19:18.983404 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3047/5781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:17 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:19.999622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:20.000237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:20.014221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:20.014902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:20.015805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:20.027173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:20.339976 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-523f0d70-e38a-402d-80ef-914a75caed87 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1464 microversion: 2.1 time: 0.344900 Apr 02 21:19:20.348296 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2735/5782] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:19 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:20.354187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-4c413e91-152c-4b29-aed4-011cc9974fa6 req-67079c60-f579-48d6-92b0-ed23827aa1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe501e-f741-4dda-8b82-a575b154f763", "name": "network-vif-plugged", "status": "completed", "tag": "e25a5d29-4daf-4089-9f45-da3193cc630a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:20.379309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4c413e91-152c-4b29-aed4-011cc9974fa6 req-67079c60-f579-48d6-92b0-ed23827aa1f2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:20.379946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-4c413e91-152c-4b29-aed4-011cc9974fa6 req-67079c60-f579-48d6-92b0-ed23827aa1f2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:20.391326 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-4c413e91-152c-4b29-aed4-011cc9974fa6 req-67079c60-f579-48d6-92b0-ed23827aa1f2 service nova] Creating event network-vif-plugged:e25a5d29-4daf-4089-9f45-da3193cc630a for instance acfe501e-f741-4dda-8b82-a575b154f763 on nch2-master-1 Apr 02 21:19:20.395881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-94b0a82f-e018-4b70-b377-219834f4658e tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1059854830", "availability_zone": "foo_zone"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:20.397735 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-4c413e91-152c-4b29-aed4-011cc9974fa6 req-67079c60-f579-48d6-92b0-ed23827aa1f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047665 Apr 02 21:19:20.398533 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2736/5783] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:20.419671 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:20.419671 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:19:20.421301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.aggregate [None req-94b0a82f-e018-4b70-b377-219834f4658e tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Generated uuid 7f3fed96-4306-4eca-b993-4231d7e5f312 for aggregate {{(pid=136518) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 02 21:19:20.454161 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-94b0a82f-e018-4b70-b377-219834f4658e tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.362107 Apr 02 21:19:20.459834 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3048/5784] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Apr 2 21:19:20 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:19:20.466120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fd4e2e3a-94a0-48ec-ad62-96a73da1a35e tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:20.467524 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:20.467524 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:19:20.522503 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fd4e2e3a-94a0-48ec-ad62-96a73da1a35e tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.060920 Apr 02 21:19:20.531175 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2737/5785] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 21:19:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:20.535716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9360aca5-1180-4758-a73d-5973f5ebc09c tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:20.537023 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:20.537023 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:19:20.538475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9360aca5-1180-4758-a73d-5973f5ebc09c tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:20.538942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9360aca5-1180-4758-a73d-5973f5ebc09c tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:20.541106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9360aca5-1180-4758-a73d-5973f5ebc09c tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:20.544081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9360aca5-1180-4758-a73d-5973f5ebc09c tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:20.595239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9360aca5-1180-4758-a73d-5973f5ebc09c tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064437 Apr 02 21:19:20.596087 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3049/5786] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Apr 2 21:19:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:19:20.607971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1af2d06-0a98-4e7d-9b7a-eef6e79ed307 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:20.609368 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:20.609368 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:19:20.638815 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1af2d06-0a98-4e7d-9b7a-eef6e79ed307 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.035583 Apr 02 21:19:20.643707 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2738/5787] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Apr 2 21:19:20 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:20.653620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f88645ac-ea08-45d2-9a91-1d987714d5fe tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:20.664871 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:20.664871 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:19:20.680603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f88645ac-ea08-45d2-9a91-1d987714d5fe tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:20.682224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f88645ac-ea08-45d2-9a91-1d987714d5fe tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:21.366233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:21.367838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:21.398174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:21.398682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:21.407003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:21.416977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:21.449536 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f88645ac-ea08-45d2-9a91-1d987714d5fe tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.801240 Apr 02 21:19:21.468230 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3050/5788] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 21:19:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:21.483650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-253fd96c-d4b1-4a16-8a0b-2ad9fd3c828a tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:21.487585 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:21.487585 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:19:21.514775 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-253fd96c-d4b1-4a16-8a0b-2ad9fd3c828a tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.041524 Apr 02 21:19:21.521556 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3051/5789] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:19:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:21.532529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e6fe18e-2bb0-459f-80be-f2a90d04f9e2 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-690544876", "availability_zone": "foo_zone"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:21.707306 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:21.707306 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:19:21.831512 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-934e765a-9229-46b3-9f2d-31ac6f50c8d6 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1468 microversion: 2.1 time: 0.470540 Apr 02 21:19:21.832443 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2739/5790] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:21 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1468 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:19:21.855736 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e6fe18e-2bb0-459f-80be-f2a90d04f9e2 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.331610 Apr 02 21:19:21.856363 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3052/5791] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Apr 2 21:19:21 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:21.888127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46d07a0c-ff04-4a8c-9652-4fdba89b38bc tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:21.893320 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:21.893320 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:19:21.973252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46d07a0c-ff04-4a8c-9652-4fdba89b38bc tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.106358 Apr 02 21:19:21.980988 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2740/5792] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 21:19:21 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:21.991098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49f059a5-b3b0-4865-ab95-c856ea781ed8 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:21.992155 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:21.992155 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:19:22.007731 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49f059a5-b3b0-4865-ab95-c856ea781ed8 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.020295 Apr 02 21:19:22.008336 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3053/5793] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Apr 2 21:19:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:22.027207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a6c784a-d016-4697-83b5-10fb53642445 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:22.037848 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:22.037848 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:19:22.067429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a6c784a-d016-4697-83b5-10fb53642445 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:22.067899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a6c784a-d016-4697-83b5-10fb53642445 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:22.850067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:22.852527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:22.877539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:22.886527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:22.890836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:22.891869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:22.899932 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a6c784a-d016-4697-83b5-10fb53642445 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.884801 Apr 02 21:19:22.904584 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2741/5794] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Apr 2 21:19:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:22.926402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32c6f02d-d1a8-463c-8dfc-377870ed68e9 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:22.932594 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:19:22.932594 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:19:22.987316 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32c6f02d-d1a8-463c-8dfc-377870ed68e9 tempest-TestAggregatesBasicOps-776803675 tempest-TestAggregatesBasicOps-776803675-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.074991 Apr 02 21:19:22.990354 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2742/5795] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Apr 2 21:19:22 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 02 21:19:23.631806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebb5f897-1d23-43a8-9409-8f14cdcab363 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1649 microversion: 2.1 time: 0.783457 Apr 02 21:19:23.636282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3054/5796] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:22 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1649 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:23.660318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:23.660985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:23.674372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:23.676559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:23.676559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:23.676559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:23.988668 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e7a7f34-85ef-444b-9e88-63e1495dac06 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1649 microversion: 2.1 time: 0.338898 Apr 02 21:19:23.990286 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2743/5797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:23 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1649 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:24.006250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:24.006944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:24.014991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:24.015830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:24.016907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:24.017656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:24.657010 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-247e1d67-1144-4d14-915c-164401215794 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1649 microversion: 2.1 time: 0.653673 Apr 02 21:19:24.681568 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3055/5798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:24 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1649 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:24.952278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1777184929", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "e0b4c4bc-de45-4f73-9c94-e836543f4a58"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:25.092277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] validate_networks() for [('e0b4c4bc-de45-4f73-9c94-e836543f4a58', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:19:27.100585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:19:27.101126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:19:27.101411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:19:27.104209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:19:27.104692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:19:27.155324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:27.158416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:27.159880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:27.161011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:27.239090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Getting quotas for project 08287b395fcf45c38195909db7f53878. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:19:27.273730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Getting quotas for user f21abe9d0e7647b08690bc957f3960b1 and project 08287b395fcf45c38195909db7f53878. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:19:27.324265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:19:27.331253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:19:27.415660 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13745ee8-2cbf-41b6-b7c0-8d581efae182 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474905 Apr 02 21:19:27.417277 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2744/5799] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:19:27.427859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef6a23d5-ca0c-4aad-b768-732ddfe8c34a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:27.428627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef6a23d5-ca0c-4aad-b768-732ddfe8c34a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:27.548250 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef6a23d5-ca0c-4aad-b768-732ddfe8c34a tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1329 microversion: 2.1 time: 0.124282 Apr 02 21:19:27.548993 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3056/5800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:27 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:28.570783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:28.572755 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:28.597668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:28.598453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:28.600874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:28.603695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:28.843587 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0ca4273-4461-468a-a60b-eee4460096dc tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1416 microversion: 2.1 time: 0.279348 Apr 02 21:19:28.847483 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2745/5801] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:28 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1416 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:29.871708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:29.875935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:29.892166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:29.896152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:29.901200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:29.902199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:30.077240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b958be6-0f05-4488-8767-dc37bdb756bb tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1422 microversion: 2.1 time: 0.208295 Apr 02 21:19:30.078417 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3057/5802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:29 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1422 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:31.096851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:31.097500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:31.112379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:31.112873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:31.113668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:31.114115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:31.500712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e937aec7-7f2a-484d-bbf5-3a4e35656414 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.408443 Apr 02 21:19:31.501659 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2746/5803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:31 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:32.522701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:32.523479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:32.534541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:32.535097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:32.535790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:32.540812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:33.346007 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dad1808e-e990-4cf7-9962-67bb142fadd4 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.828410 Apr 02 21:19:33.357487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3058/5804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:32 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:33.499265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d86e10ac-da64-4c26-baa0-02662de21191 req-7a5212f6-1d73-48af-866a-b41935f9ca78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d21ada0f-22f7-424d-8cdc-3f00669463f2", "tag": "6d1cda12-c7db-4210-a85a-12139a962a8f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:33.521252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d86e10ac-da64-4c26-baa0-02662de21191 req-7a5212f6-1d73-48af-866a-b41935f9ca78 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:33.522204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d86e10ac-da64-4c26-baa0-02662de21191 req-7a5212f6-1d73-48af-866a-b41935f9ca78 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:33.545782 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d86e10ac-da64-4c26-baa0-02662de21191 req-7a5212f6-1d73-48af-866a-b41935f9ca78 service nova] Creating event network-changed:6d1cda12-c7db-4210-a85a-12139a962a8f for instance d21ada0f-22f7-424d-8cdc-3f00669463f2 on nch1-master-1 Apr 02 21:19:33.552716 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d86e10ac-da64-4c26-baa0-02662de21191 req-7a5212f6-1d73-48af-866a-b41935f9ca78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057591 Apr 02 21:19:33.554165 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2747/5805] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:34.364610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:34.365120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:34.376634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:34.379074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:34.379936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:34.380402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:34.876789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4d67b8f0-4dc6-41a1-9446-94961a0b9827 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.516344 Apr 02 21:19:34.877689 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3059/5806] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:34 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:35.894858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:35.895998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:35.910025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:35.910830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:35.912105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:35.912771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:36.334273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12efc83b-2b68-4c04-933a-de522bd6e3b9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.441763 Apr 02 21:19:36.345499 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2748/5807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:35 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:37.352059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:37.354239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:37.375241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:37.377909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:37.380797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:37.382051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:37.932044 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1644543a-8825-4326-8c8c-a7c033eae658 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.584280 Apr 02 21:19:37.937222 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3060/5808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:37 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:38.953935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:38.954567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:38.967254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:38.967981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:38.968926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:38.969813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:39.340996 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fedaad3c-89e5-4b8e-b56f-e6bcae7aa3e2 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.390408 Apr 02 21:19:39.343197 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2749/5809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:38 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:40.109964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-6f9147e0-23e4-48fa-9cbf-a5d39e731cd3 req-768b9f5f-4d7a-4268-854c-f59fc8146114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21ada0f-22f7-424d-8cdc-3f00669463f2", "name": "network-vif-plugged", "status": "completed", "tag": "6d1cda12-c7db-4210-a85a-12139a962a8f"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:40.126750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6f9147e0-23e4-48fa-9cbf-a5d39e731cd3 req-768b9f5f-4d7a-4268-854c-f59fc8146114 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:40.127355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-6f9147e0-23e4-48fa-9cbf-a5d39e731cd3 req-768b9f5f-4d7a-4268-854c-f59fc8146114 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:40.144037 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-6f9147e0-23e4-48fa-9cbf-a5d39e731cd3 req-768b9f5f-4d7a-4268-854c-f59fc8146114 service nova] Creating event network-vif-plugged:6d1cda12-c7db-4210-a85a-12139a962a8f for instance d21ada0f-22f7-424d-8cdc-3f00669463f2 on nch1-master-1 Apr 02 21:19:40.153097 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-6f9147e0-23e4-48fa-9cbf-a5d39e731cd3 req-768b9f5f-4d7a-4268-854c-f59fc8146114 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047871 Apr 02 21:19:40.154279 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3061/5810] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:19:40.363989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:40.366985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:40.382406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:40.384232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:40.385323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:40.414328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:40.820709 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24af00ec-c6c7-4e5d-ba85-f56d1d1d0a03 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.462867 Apr 02 21:19:40.833835 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2750/5811] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:40 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:41.844999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:41.846319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:41.876767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:41.878129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:41.898430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:41.902027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:42.467224 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6160fcd4-08ef-4a16-8d2a-db9cbb7a0e90 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1464 microversion: 2.1 time: 0.629679 Apr 02 21:19:42.467849 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3062/5812] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:41 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1464 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:43.489267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:43.490037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:43.500189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:43.501278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:43.502153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:43.502672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:43.908302 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-daface36-330d-42cd-8bac-e0e03fdbefe0 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1650 microversion: 2.1 time: 0.427364 Apr 02 21:19:43.910732 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2751/5813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:43 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1650 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:43.928170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:43.929256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:43.939391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:43.940051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:43.941318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:43.942502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:44.206590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87e7d1f2-3ec6-40cb-8ccc-c9d2802852a5 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1650 microversion: 2.1 time: 0.281809 Apr 02 21:19:44.220704 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3063/5814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:43 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1650 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:44.232883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:44.234167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:44.243893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:44.245428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:44.246565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:44.247234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:44.896671 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5fb2087-1a76-4069-b72a-c0f0dc469b62 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1650 microversion: 2.1 time: 0.670436 Apr 02 21:19:44.908999 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2752/5815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:44 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1650 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:44.913641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:44.914155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:44.922294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:44.923374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:44.926286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:44.927441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:44.970275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:19:45.088799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-63d4aa1f-e922-4c4e-8dc0-ca9fe3712b11 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 204 len: 0 microversion: 2.1 time: 0.178358 Apr 02 21:19:45.090001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3064/5816] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:19:44 2022] DELETE /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:19:45.099959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:45.104724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:45.129331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:45.130279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:45.133804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:45.136102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:45.751948 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-90f98b20-58ac-4e77-905a-b98064437f1b tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1656 microversion: 2.1 time: 0.657027 Apr 02 21:19:45.753917 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2753/5817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:45 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1656 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:46.618011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f357a122-be5d-4562-8304-ee7dc9d90acc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: .version_select at 0x7f54c7af73a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1677310611"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:46.652903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f357a122-be5d-4562-8304-ee7dc9d90acc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:19:46.659573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f357a122-be5d-4562-8304-ee7dc9d90acc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:19:46.770524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:46.771140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:46.784141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:46.784887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:46.789144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:46.790215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:47.048727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f357a122-be5d-4562-8304-ee7dc9d90acc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:19:47.059645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f357a122-be5d-4562-8304-ee7dc9d90acc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:19:47.107735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f357a122-be5d-4562-8304-ee7dc9d90acc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.845626 Apr 02 21:19:47.112480 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3065/5818] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:19:46 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:47.138733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a254d142-d7e0-4faa-886d-b2b0c0f2989f tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1656 microversion: 2.1 time: 0.371802 Apr 02 21:19:47.149923 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2754/5819] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:46 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1656 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:19:48.169760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:48.170533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:48.210691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:48.211630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:48.216912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:48.217400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:48.247359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-26566ff0-72c3-415a-9955-ee22c226eb0e req-a759ba77-6403-4d88-8fc5-0688d46956c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d21ada0f-22f7-424d-8cdc-3f00669463f2", "name": "network-vif-deleted", "tag": "6d1cda12-c7db-4210-a85a-12139a962a8f"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:48.266005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-26566ff0-72c3-415a-9955-ee22c226eb0e req-a759ba77-6403-4d88-8fc5-0688d46956c7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:48.266460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-26566ff0-72c3-415a-9955-ee22c226eb0e req-a759ba77-6403-4d88-8fc5-0688d46956c7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:48.292276 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-26566ff0-72c3-415a-9955-ee22c226eb0e req-a759ba77-6403-4d88-8fc5-0688d46956c7 service nova] Creating event network-vif-deleted:6d1cda12-c7db-4210-a85a-12139a962a8f for instance d21ada0f-22f7-424d-8cdc-3f00669463f2 on nch1-master-1 Apr 02 21:19:48.310892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-26566ff0-72c3-415a-9955-ee22c226eb0e req-a759ba77-6403-4d88-8fc5-0688d46956c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069986 Apr 02 21:19:48.315421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2755/5820] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:19:48.621499 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2ef04ac5-cabe-46a0-800b-e6e70dcc1f82 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 200 len: 1614 microversion: 2.1 time: 0.457078 Apr 02 21:19:48.632618 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3066/5821] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:48 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 1614 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:49.645764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:49.647365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: d21ada0f-22f7-424d-8cdc-3f00669463f2] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:49.655887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:49.656653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:49.657746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:49.658386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:49.674120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] HTTP exception thrown: Instance d21ada0f-22f7-424d-8cdc-3f00669463f2 could not be found. Apr 02 21:19:49.675059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Returning 404 to user: Instance d21ada0f-22f7-424d-8cdc-3f00669463f2 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:19:49.676116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ddcc70f-be5a-46ff-bcab-80839356c5a7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2" status: 404 len: 111 microversion: 2.1 time: 0.036742 Apr 02 21:19:49.677412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2756/5822] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:49 2022] GET /compute/v2.1/servers/d21ada0f-22f7-424d-8cdc-3f00669463f2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:19:49.692835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:49.695452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:49.707456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:49.708149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:49.710132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:49.710819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:49.759898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:19:49.970258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a26c8da-c559-4edb-856c-9c0029f84c58 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 204 len: 0 microversion: 2.1 time: 0.287772 Apr 02 21:19:49.971477 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3067/5823] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:19:49 2022] DELETE /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:19:49.983751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:49.984903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:50.002480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:50.005184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:50.007653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:50.010482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:50.756823 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b0c1165-6f8d-4b74-a77e-243d8a613915 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1655 microversion: 2.1 time: 0.780811 Apr 02 21:19:50.759742 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2757/5824] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:49 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1655 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:51.778491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:51.780301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:51.789519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:51.791467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:51.792595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:51.793444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:52.275223 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae868acb-9397-4e24-965e-f374540141f7 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1655 microversion: 2.1 time: 0.502135 Apr 02 21:19:52.281059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3068/5825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:51 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1655 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:53.294096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:53.297154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:53.306520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:53.307066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:53.308139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:53.308786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:53.441332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0ec8d4b2-b85d-40e8-8864-eb7cb591bae3 req-baf1d30d-6415-4fed-9597-f48f1a69659c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfe501e-f741-4dda-8b82-a575b154f763", "name": "network-vif-deleted", "tag": "e25a5d29-4daf-4089-9f45-da3193cc630a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:19:53.458277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0ec8d4b2-b85d-40e8-8864-eb7cb591bae3 req-baf1d30d-6415-4fed-9597-f48f1a69659c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:53.464825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0ec8d4b2-b85d-40e8-8864-eb7cb591bae3 req-baf1d30d-6415-4fed-9597-f48f1a69659c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:53.491613 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f1f3285-7c8e-4851-b407-e151ba169261 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 200 len: 1613 microversion: 2.1 time: 0.202968 Apr 02 21:19:53.502970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2758/5826] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:53 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 1613 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:19:53.519235 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0ec8d4b2-b85d-40e8-8864-eb7cb591bae3 req-baf1d30d-6415-4fed-9597-f48f1a69659c service nova] Creating event network-vif-deleted:e25a5d29-4daf-4089-9f45-da3193cc630a for instance acfe501e-f741-4dda-8b82-a575b154f763 on nch2-master-1 Apr 02 21:19:53.540972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0ec8d4b2-b85d-40e8-8864-eb7cb591bae3 req-baf1d30d-6415-4fed-9597-f48f1a69659c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100202 Apr 02 21:19:53.544593 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3069/5827] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:19:54.509910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:19:54.510530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] [instance: acfe501e-f741-4dda-8b82-a575b154f763] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:19:54.517935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:54.518569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:54.519511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:19:54.520105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:19:54.541352 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] HTTP exception thrown: Instance acfe501e-f741-4dda-8b82-a575b154f763 could not be found. Apr 02 21:19:54.542331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] Returning 404 to user: Instance acfe501e-f741-4dda-8b82-a575b154f763 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:19:54.543383 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32183536-c628-4001-b0f8-a70562b7ffe9 tempest-TestServerMultinode-2000723078 tempest-TestServerMultinode-2000723078-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763" status: 404 len: 111 microversion: 2.1 time: 0.037826 Apr 02 21:19:54.544818 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2759/5828] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:19:54 2022] GET /compute/v2.1/servers/acfe501e-f741-4dda-8b82-a575b154f763 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:20:04.478893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1762532865", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "e56d11ac-91eb-4afd-ae1e-5651177c7d97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1677310611", "security_groups": [{"name": "tempest-secgroup-smoke-1398142420"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:04.883904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] validate_networks() for [('e56d11ac-91eb-4afd-ae1e-5651177c7d97', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:20:07.626054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:20:07.626666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:20:07.627111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:20:07.627633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:20:07.628157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:20:07.644516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:07.644982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:07.647270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:07.648691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:07.697893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:20:07.712046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:20:07.747039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:20:07.747039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:20:07.897353 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-34f45fd3-c2f0-482e-9b9a-a6bf9c3365ee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.417472 Apr 02 21:20:07.898512 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3070/5829] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:20:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 3427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:20:07.910669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ea08552-eb3b-45ef-95bf-c92bdf20b1dd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:07.911897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ea08552-eb3b-45ef-95bf-c92bdf20b1dd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:08.018058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff8f3cfb-8daf-4350-9859-05f01d2087c5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'create', calling method: .version_select at 0x7f54c7891040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1137115326"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:08.051795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ff8f3cfb-8daf-4350-9859-05f01d2087c5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:20:08.066445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ff8f3cfb-8daf-4350-9859-05f01d2087c5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:20:08.562935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8ea08552-eb3b-45ef-95bf-c92bdf20b1dd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:08.589542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ea08552-eb3b-45ef-95bf-c92bdf20b1dd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1267 microversion: 2.1 time: 0.684549 Apr 02 21:20:08.590527 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2760/5830] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:07 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1267 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:08.670860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ff8f3cfb-8daf-4350-9859-05f01d2087c5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:20:08.694166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ff8f3cfb-8daf-4350-9859-05f01d2087c5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:20:08.732253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff8f3cfb-8daf-4350-9859-05f01d2087c5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.720320 Apr 02 21:20:08.734225 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3071/5831] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:20:08 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:09.611777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:09.612509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:09.635471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:09.635471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:09.635471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:09.635841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:09.784875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:09.809067 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89ed3c31-de9e-4441-b404-68726b465708 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1327 microversion: 2.1 time: 0.200130 Apr 02 21:20:09.809806 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2761/5832] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:09 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1327 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:10.828484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:10.829095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:10.846019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:10.846485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:10.847284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:10.850102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:11.158433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:11.169889 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1dac70ca-4269-4fdd-bab8-464d78690ed9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1325 microversion: 2.1 time: 0.346569 Apr 02 21:20:11.171249 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3072/5833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:10 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:12.188600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:12.189225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:12.205177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:12.206092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:12.207547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:12.208267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:13.272350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:13.283161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d8fc628-5ec2-4121-8902-49a578da11d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 1.099492 Apr 02 21:20:13.295090 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2762/5834] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:12 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:14.151724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1825483170", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "c1bcf83f-0c29-45e5-aa75-aadd0b03809c"}], "key_name": "tempest-TestNetworkBasicOps-1137115326", "security_groups": [{"name": "tempest-secgroup-smoke-41054063"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:14.302114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:14.302694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:14.314311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:14.315168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:14.316038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:14.316586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:14.431052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] validate_networks() for [('c1bcf83f-0c29-45e5-aa75-aadd0b03809c', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:20:14.717938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:14.731296 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4643bb31-d0a8-4682-abf1-8a6e1f73c84c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.433026 Apr 02 21:20:14.732177 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2763/5835] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:14 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:15.227529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0f1a0903-1218-462a-91ff-a247e31d432b req-5b6078d7-ecd6-43c2-8047-4032d0d1c69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:15.254275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f1a0903-1218-462a-91ff-a247e31d432b req-5b6078d7-ecd6-43c2-8047-4032d0d1c69a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:15.265271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f1a0903-1218-462a-91ff-a247e31d432b req-5b6078d7-ecd6-43c2-8047-4032d0d1c69a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:15.290550 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0f1a0903-1218-462a-91ff-a247e31d432b req-5b6078d7-ecd6-43c2-8047-4032d0d1c69a service nova] Creating event network-changed:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch1-master-1 Apr 02 21:20:15.303599 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0f1a0903-1218-462a-91ff-a247e31d432b req-5b6078d7-ecd6-43c2-8047-4032d0d1c69a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081462 Apr 02 21:20:15.308924 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2764/5836] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:20:15.751059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:15.752681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:15.761580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:15.762187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:15.763595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:15.764223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:15.959095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:20:15.959598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:20:15.961122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:20:15.962337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:20:15.962972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:20:15.973641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:15.977911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:15.979154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:15.979837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:15.999056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:20:16.005162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:20:16.028979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:20:16.040788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:20:16.085903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:16.107007 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5eeb20e2-f1f0-4ac8-94e4-a70a1f7f7fb2 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.964281 Apr 02 21:20:16.119169 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d2eee0ae-de31-467f-9e24-b75dc6046da9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.370428 Apr 02 21:20:16.120850 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3073/5837] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:20:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:20:16.126830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0139a457-c08b-47d6-9455-109c93437142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:16.128130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0139a457-c08b-47d6-9455-109c93437142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:16.132394 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2765/5838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:15 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:16.256333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0139a457-c08b-47d6-9455-109c93437142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:16.269725 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0139a457-c08b-47d6-9455-109c93437142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1249 microversion: 2.1 time: 0.147487 Apr 02 21:20:16.273153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3074/5839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:16 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1249 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:17.137731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:17.139199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:17.148422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:17.149399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:17.150521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:17.151234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:17.291259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:17.292139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:17.300631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:17.301159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:17.302203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:17.302830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:17.410259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:17.424172 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06e6b4ad-cd18-42d7-947d-3c10d021947b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1301 microversion: 2.1 time: 0.137540 Apr 02 21:20:17.425061 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3075/5840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:17 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:17.595285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:17.603563 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa73bd2d-7e9f-48e4-a003-f255875f3ca4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.470588 Apr 02 21:20:17.615593 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2766/5841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:17 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:18.446394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:18.447040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:18.462616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:18.463164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:18.468287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:18.469333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:18.624189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:18.624853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:18.635817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:18.638041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:18.640277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:18.641379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:18.643644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:18.648820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7373ec33-93b7-4bca-b3de-1db87c191e48 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1307 microversion: 2.1 time: 0.210346 Apr 02 21:20:18.652398 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3076/5842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:18 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:19.080246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:19.096735 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a99a3a4-88e6-44d2-9a9f-e77e2314ab42 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.473621 Apr 02 21:20:19.097752 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2767/5843] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:18 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:19.675083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:19.676481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:19.694188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:19.695722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:19.696918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:19.697577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:20.115737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:20.116402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:20.158137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:20.158634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:20.159431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:20.159915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:20.250709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:20.285448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2b688266-0b6a-4bbd-942b-a26512c8c2d7 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.619099 Apr 02 21:20:20.286574 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3077/5844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:19 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:20.827984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:20.842983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d38392b-0d3d-44fc-ab79-584a3b26262f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.731793 Apr 02 21:20:20.863094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2768/5845] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:20 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:21.303792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:21.304465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:21.317464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:21.318003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:21.318791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:21.319867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:21.861997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:21.863363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:21.892255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:21.892992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:21.893797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:21.894244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:22.290366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:22.309148 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c51f588-a953-4c0f-8605-73e5ccee57d4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 1.009451 Apr 02 21:20:22.313034 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3078/5846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:21 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:22.337797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:22.341573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-bdb38fe0-8b29-49eb-baa4-fb2be38eb052 req-ca40e148-0820-4b58-8478-e90a00cc7590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "name": "network-vif-plugged", "status": "completed", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:22.345882 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e6646ac-8a73-4b25-ba14-542c03395aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.488354 Apr 02 21:20:22.346473 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2769/5847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:21 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:22.362226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-216e555e-eec6-41b1-beab-c95c7ad124cf req-e1bbc52d-7ee6-43f9-9281-0c6b8ac4a5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf269a74-e067-459f-a8ce-93eec45d406b", "tag": "e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:22.375390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bdb38fe0-8b29-49eb-baa4-fb2be38eb052 req-ca40e148-0820-4b58-8478-e90a00cc7590 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:22.375586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bdb38fe0-8b29-49eb-baa4-fb2be38eb052 req-ca40e148-0820-4b58-8478-e90a00cc7590 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:22.390330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-216e555e-eec6-41b1-beab-c95c7ad124cf req-e1bbc52d-7ee6-43f9-9281-0c6b8ac4a5eb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:22.390782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-216e555e-eec6-41b1-beab-c95c7ad124cf req-e1bbc52d-7ee6-43f9-9281-0c6b8ac4a5eb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:22.420113 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-bdb38fe0-8b29-49eb-baa4-fb2be38eb052 req-ca40e148-0820-4b58-8478-e90a00cc7590 service nova] Creating event network-vif-plugged:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch1-master-1 Apr 02 21:20:22.433155 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-bdb38fe0-8b29-49eb-baa4-fb2be38eb052 req-ca40e148-0820-4b58-8478-e90a00cc7590 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117789 Apr 02 21:20:22.434730 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3079/5848] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:20:22.437958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-216e555e-eec6-41b1-beab-c95c7ad124cf req-e1bbc52d-7ee6-43f9-9281-0c6b8ac4a5eb service nova] Creating event network-changed:e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb for instance bf269a74-e067-459f-a8ce-93eec45d406b on nch2-master-1 Apr 02 21:20:22.451317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-216e555e-eec6-41b1-beab-c95c7ad124cf req-e1bbc52d-7ee6-43f9-9281-0c6b8ac4a5eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096929 Apr 02 21:20:22.452155 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2770/5849] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:20:23.332631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:23.334446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:23.343241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:23.343903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:23.350883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:23.362689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:23.365518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:23.366390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:23.372789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:23.374117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:23.375721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:23.376413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:23.562110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:23.572117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88993e98-a455-4cee-8d1c-b9b1ad619415 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1393 microversion: 2.1 time: 0.212752 Apr 02 21:20:23.573404 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2771/5850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:23 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:24.043735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:24.066836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a9e2271c-e96b-431b-89aa-3fd571954e52 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.738270 Apr 02 21:20:24.079278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3080/5851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:23 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:24.602761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:24.609580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:24.653359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:24.656026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:24.659721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:24.662563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:25.026630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:25.036895 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-315ed773-2236-4079-818b-0d4b907263a1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1566 microversion: 2.1 time: 0.448797 Apr 02 21:20:25.043737 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2772/5852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:24 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1566 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:25.058159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:25.059319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:25.078645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:25.079165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:25.083100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:25.083969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:25.086441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:25.086918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:25.090423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:25.091134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:25.092131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:25.092679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:25.300295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:25.317328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b31450c6-aca5-43e6-b993-304537a25e55 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.239003 Apr 02 21:20:25.318114 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2773/5853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:25 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:25.944577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:25.953659 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-55959220-d174-4316-92bd-f294258c277c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1566 microversion: 2.1 time: 0.904779 Apr 02 21:20:25.954821 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3081/5854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:25 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1566 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:26.335368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:26.336827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:26.344942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:26.345874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:26.347010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:26.347371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:26.776384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:26.784963 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41201314-60be-4fe3-8c82-dc8a014b8a74 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.453934 Apr 02 21:20:26.786099 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2774/5855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:26 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:27.802326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:27.802947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:27.811707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:27.812407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:27.813631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:27.814279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:28.172473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:28.193363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd722a82-ff1d-4bec-b68a-6b983363a5da tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.395098 Apr 02 21:20:28.196818 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3082/5856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:27 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:29.216443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:29.217782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:29.224796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:29.225154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:29.225954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:29.226404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:29.280694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e8cb6285-743f-4077-bbd3-141f78bf46db req-9d61493f-f29f-4c9b-bceb-a7a5e91dcf14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf269a74-e067-459f-a8ce-93eec45d406b", "name": "network-vif-plugged", "status": "completed", "tag": "e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:29.301007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8cb6285-743f-4077-bbd3-141f78bf46db req-9d61493f-f29f-4c9b-bceb-a7a5e91dcf14 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:29.301815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8cb6285-743f-4077-bbd3-141f78bf46db req-9d61493f-f29f-4c9b-bceb-a7a5e91dcf14 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:29.325121 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e8cb6285-743f-4077-bbd3-141f78bf46db req-9d61493f-f29f-4c9b-bceb-a7a5e91dcf14 service nova] Creating event network-vif-plugged:e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb for instance bf269a74-e067-459f-a8ce-93eec45d406b on nch2-master-1 Apr 02 21:20:29.331165 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e8cb6285-743f-4077-bbd3-141f78bf46db req-9d61493f-f29f-4c9b-bceb-a7a5e91dcf14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061462 Apr 02 21:20:29.332494 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3083/5857] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:20:29.829668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:29.840161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3601fa34-38cf-43d1-90a8-fdf3df439cd9 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.627596 Apr 02 21:20:29.843242 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2775/5858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:29 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:29.907958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:29.909076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:29.920434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:29.938098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-459bffd9-e6aa-4ba6-b9d5-f10aae3a8258 req-4444fa96-5141-4dce-9081-a1d58e0c1b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:29.945548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:29.947085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:29.947732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:29.962814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-459bffd9-e6aa-4ba6-b9d5-f10aae3a8258 req-4444fa96-5141-4dce-9081-a1d58e0c1b01 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:29.964923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-459bffd9-e6aa-4ba6-b9d5-f10aae3a8258 req-4444fa96-5141-4dce-9081-a1d58e0c1b01 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:30.016483 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-459bffd9-e6aa-4ba6-b9d5-f10aae3a8258 req-4444fa96-5141-4dce-9081-a1d58e0c1b01 service nova] Creating event network-changed:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch1-master-1 Apr 02 21:20:30.032547 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-459bffd9-e6aa-4ba6-b9d5-f10aae3a8258 req-4444fa96-5141-4dce-9081-a1d58e0c1b01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101095 Apr 02 21:20:30.035931 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2776/5859] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:20:30.408202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:30.418710 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-227eda74-f773-40ec-bf1e-2fefc9eb08b1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1566 microversion: 2.1 time: 0.514989 Apr 02 21:20:30.420151 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3084/5860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:29 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1566 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:30.866842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:30.867761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:30.875432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:30.876566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:30.877651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:30.878493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:31.101744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:31.111935 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4cbd5e7-664f-43ec-ad19-1801c3369948 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1373 microversion: 2.1 time: 0.253820 Apr 02 21:20:31.117071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2777/5861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:30 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1373 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:32.133711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:32.134203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:32.156448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:32.157170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:32.158817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:32.162771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:32.437652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:32.447803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0273b41e-07ad-488e-94c6-72bceac11328 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1544 microversion: 2.1 time: 0.318493 Apr 02 21:20:32.468504 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3085/5862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:32 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1544 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:32.469174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:32.469174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:32.477533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:32.478170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:32.479350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:32.479841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:32.949904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1592287252", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "207a1a74-0523-4611-9193-370f0cb275b2"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:33.013758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] validate_networks() for [('207a1a74-0523-4611-9193-370f0cb275b2', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:20:33.026490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:33.037006 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7eba6c4a-b649-408a-94b4-fb293159ef4e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1544 microversion: 2.1 time: 0.575988 Apr 02 21:20:33.039792 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2778/5863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:32 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1544 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:33.851019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:20:33.852072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:20:33.852617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:20:33.853042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:20:33.858237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:20:33.867373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:33.867993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:33.868847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:33.869300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:33.888057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Getting quotas for project 2e8bc61a3e3149c3bb79c449929eb875. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:20:33.893830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Getting quotas for user c46cec44517a4a3a9aa20a1789097ce5 and project 2e8bc61a3e3149c3bb79c449929eb875. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:20:33.906726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:20:33.909075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:20:33.953709 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ded0159f-1ea0-4862-8d44-87dba2112721 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141287 Apr 02 21:20:33.954546 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3086/5864] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:20:33.965092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76cd2cbe-85e1-493f-996c-41db1ccd1a8e tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:33.965709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-76cd2cbe-85e1-493f-996c-41db1ccd1a8e tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:34.055750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-76cd2cbe-85e1-493f-996c-41db1ccd1a8e tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:34.063041 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76cd2cbe-85e1-493f-996c-41db1ccd1a8e tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1215 microversion: 2.1 time: 0.101952 Apr 02 21:20:34.063969 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2779/5865] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:33 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:35.082580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:35.083837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:35.092771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:35.093503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:35.094570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:35.095340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:35.236885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:35.245816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13878622-efe6-4d75-884b-e7d17c6a0f30 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1267 microversion: 2.1 time: 0.168532 Apr 02 21:20:35.246977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3087/5866] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:35 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:36.264935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:36.266015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:36.275265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:36.275894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:36.276921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:36.277530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:36.713375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:36.721829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f8bddc14-7e4b-4920-ba3f-2f09ae5edb12 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1315 microversion: 2.1 time: 0.462487 Apr 02 21:20:36.722811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2780/5867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:36 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:36.906562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9a8f249b-e3de-4c62-85af-f78dc6be6d7b req-92c88697-ea49-4504-b092-cfe010ec587a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c", "tag": "321956b4-e20f-4643-9278-f10e9108f1a6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:36.924964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9a8f249b-e3de-4c62-85af-f78dc6be6d7b req-92c88697-ea49-4504-b092-cfe010ec587a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:36.925719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9a8f249b-e3de-4c62-85af-f78dc6be6d7b req-92c88697-ea49-4504-b092-cfe010ec587a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:36.938197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9a8f249b-e3de-4c62-85af-f78dc6be6d7b req-92c88697-ea49-4504-b092-cfe010ec587a service nova] Creating event network-changed:321956b4-e20f-4643-9278-f10e9108f1a6 for instance be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c on nch1-master-1 Apr 02 21:20:36.945471 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9a8f249b-e3de-4c62-85af-f78dc6be6d7b req-92c88697-ea49-4504-b092-cfe010ec587a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051046 Apr 02 21:20:36.947125 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3088/5868] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:20:37.098481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-db330e7e-d708-460f-a0d1-c14038c3fa2c req-9c8e669f-55e5-4398-86c6-a25ed4d51c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf269a74-e067-459f-a8ce-93eec45d406b", "tag": "e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:37.107388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-db330e7e-d708-460f-a0d1-c14038c3fa2c req-9c8e669f-55e5-4398-86c6-a25ed4d51c60 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:37.108098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-db330e7e-d708-460f-a0d1-c14038c3fa2c req-9c8e669f-55e5-4398-86c6-a25ed4d51c60 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:37.120294 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-db330e7e-d708-460f-a0d1-c14038c3fa2c req-9c8e669f-55e5-4398-86c6-a25ed4d51c60 service nova] Creating event network-changed:e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb for instance bf269a74-e067-459f-a8ce-93eec45d406b on nch2-master-1 Apr 02 21:20:37.127354 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-db330e7e-d708-460f-a0d1-c14038c3fa2c req-9c8e669f-55e5-4398-86c6-a25ed4d51c60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032556 Apr 02 21:20:37.128819 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2781/5869] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:20:37.742403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:37.743494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:37.753736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:37.754508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:37.755573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:37.773070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:38.297546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:38.311145 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d60f0f2-9e70-4993-8991-4d79b0fa4e4b tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1315 microversion: 2.1 time: 0.575091 Apr 02 21:20:38.311926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3089/5870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:37 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:39.330068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:39.330782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:39.337482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:39.337944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:39.338736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:39.339182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:39.612122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:39.624948 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-76f2fdae-9df1-4352-8636-a5cadca8795f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1315 microversion: 2.1 time: 0.299862 Apr 02 21:20:39.626244 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2782/5871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:39 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:40.641784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:40.642412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:40.652556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:40.653249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:40.654249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:40.654844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:40.837237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:40.844719 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e247672a-5013-4fbf-a3cf-9ac6f961e031 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1315 microversion: 2.1 time: 0.206808 Apr 02 21:20:40.845317 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3090/5872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:40 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:41.662301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-dc0d0a1e-9480-40df-9394-423275609b38 req-3d7fa643-d21a-4d1a-91c8-e30fba3c10b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c", "name": "network-vif-plugged", "status": "completed", "tag": "321956b4-e20f-4643-9278-f10e9108f1a6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:41.673933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dc0d0a1e-9480-40df-9394-423275609b38 req-3d7fa643-d21a-4d1a-91c8-e30fba3c10b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:41.674348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dc0d0a1e-9480-40df-9394-423275609b38 req-3d7fa643-d21a-4d1a-91c8-e30fba3c10b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:41.690378 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-dc0d0a1e-9480-40df-9394-423275609b38 req-3d7fa643-d21a-4d1a-91c8-e30fba3c10b2 service nova] Creating event network-vif-plugged:321956b4-e20f-4643-9278-f10e9108f1a6 for instance be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c on nch1-master-1 Apr 02 21:20:41.696140 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-dc0d0a1e-9480-40df-9394-423275609b38 req-3d7fa643-d21a-4d1a-91c8-e30fba3c10b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Apr 02 21:20:41.696825 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2783/5873] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:20:41.867589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:41.871612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:41.879291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:41.879806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:41.881197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:41.881655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:42.031500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:42.039901 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c99d0e89-7e26-460f-9eba-7123ae2626d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1315 microversion: 2.1 time: 0.181528 Apr 02 21:20:42.040529 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3091/5874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:41 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:43.059294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:43.060682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:43.066913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:43.067384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:43.068845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:43.069467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:43.249509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:43.257639 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f7422da5-7a64-405e-b61d-b0b7e25c5464 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1315 microversion: 2.1 time: 0.203600 Apr 02 21:20:43.258239 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2784/5875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:43 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:44.276189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:44.276985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:44.283917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.284519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.285366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.286058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.442266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:44.457617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7df17e88-9e4c-4e14-b131-6d46d1ceba0d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1501 microversion: 2.1 time: 0.185796 Apr 02 21:20:44.458252 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3092/5876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:44 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:44.480242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:44.483161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:44.490921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.491615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.493180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.493630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.787522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:44.795991 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ebebd35f-0ee5-4d3a-9861-74959df70074 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1501 microversion: 2.1 time: 0.323268 Apr 02 21:20:44.797132 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2785/5877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:44 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:44.813986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:44.814927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:44.821898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.822362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.823292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.823747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.848071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lazy-loading 'flavor' on Instance uuid be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:20:44.924990 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dc5b8bbd-0c42-433f-aa62-c2b6f64aba29 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action" status: 202 len: 0 microversion: 2.1 time: 0.115386 Apr 02 21:20:44.929096 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3093/5878] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:20:44 2022] POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:20:44.935681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:44.936343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:44.945409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.946624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:44.948164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:44.948893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:45.093116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:45.100779 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23bcf896-55a7-4e32-9e13-29105569ae06 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1509 microversion: 2.1 time: 0.169081 Apr 02 21:20:45.101364 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2786/5879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:44 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:46.120241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:46.121137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:46.127659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:46.128496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:46.129461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:46.129919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:46.353496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:46.361308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59d3380a-0714-4c17-8f46-9f8a821f1ebe tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1492 microversion: 2.1 time: 0.246823 Apr 02 21:20:46.361880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3094/5880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:46 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1492 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:46.378512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:46.379084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:46.386391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:46.386856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:46.387632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:46.388082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:46.459522 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-193a7133-7888-4eb4-b09d-010f49a6976f tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action" status: 202 len: 0 microversion: 2.1 time: 0.084604 Apr 02 21:20:46.460306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2787/5881] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:20:46 2022] POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:20:46.470688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:46.471433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:46.479021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:46.479591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:46.480694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:46.481214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:46.714778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:46.722537 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-569a442c-e524-4672-88c2-6dbf9b776476 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1498 microversion: 2.1 time: 0.256747 Apr 02 21:20:46.732824 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3095/5882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:46 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1498 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:47.740928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:47.741935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:47.756995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:47.757483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:47.758610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:47.759059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:47.905833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:47.921698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-911d997e-aa80-4b64-9b59-822a4333e5d9 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1498 microversion: 2.1 time: 0.185109 Apr 02 21:20:47.922891 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2788/5883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:47 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1498 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:48.946484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:48.947434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:48.956204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:48.956835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:48.957800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:48.958357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:49.119841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:49.127660 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0de2d6b0-702f-4c43-9da9-6f06b5566633 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1501 microversion: 2.1 time: 0.190842 Apr 02 21:20:49.132928 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3096/5884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:48 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:49.145428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:49.146642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:49.153495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:49.154043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:49.154912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:49.155445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:49.179100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lazy-loading 'flavor' on Instance uuid be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:20:49.256833 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c2760b6c-6bec-4a8f-ad87-ca9b2ecc8a1d tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action" status: 202 len: 0 microversion: 2.1 time: 0.114890 Apr 02 21:20:49.257814 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2789/5885] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:20:49 2022] POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:20:49.268187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:49.269298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:49.278501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:49.279028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:49.281718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:49.282265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:49.428444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:49.436618 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-70f68533-84a1-4913-bb8f-39a0197f4fc2 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1509 microversion: 2.1 time: 0.172135 Apr 02 21:20:49.437201 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3097/5886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:49 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:50.455785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:50.456855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:50.469439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:50.469986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:50.471256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:50.471850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:51.012657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:51.020487 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-97bcaa67-71a0-44d8-a894-ea91a7abd1c6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1492 microversion: 2.1 time: 0.570279 Apr 02 21:20:51.021737 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2790/5887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:50 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1492 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:51.037493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:51.038628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:51.045966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:51.046411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:51.047393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:51.047987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:51.132881 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d60a74f6-ee05-4183-9e6f-2174cd90c7d6 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action" status: 202 len: 0 microversion: 2.1 time: 0.099026 Apr 02 21:20:51.134718 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3098/5888] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:20:51 2022] POST /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:20:51.144648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:51.145520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:51.153559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:51.154289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:51.155352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:51.155957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:51.573174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:51.583553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36a5cd4a-e852-4701-a3ad-bf2ecd36070a tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1498 microversion: 2.1 time: 0.444077 Apr 02 21:20:51.586489 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2791/5889] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:51 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1498 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:20:52.606844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:52.607411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:52.620496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:52.620962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:52.621766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:52.622199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:52.940001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:52.949257 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a694aa32-9731-4407-919d-c11f155f4fea tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1498 microversion: 2.1 time: 0.350034 Apr 02 21:20:52.951941 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3099/5890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:52 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1498 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:53.971240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:53.972038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:53.984417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:53.985160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:53.986170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:53.986785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:54.162860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:54.173644 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-daddabdd-f771-4a06-bad6-836ecc1bf6dd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1501 microversion: 2.1 time: 0.206874 Apr 02 21:20:54.185921 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2792/5891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:53 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:54.190756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:54.191811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:54.200344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:54.201131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:54.202115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:54.202805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:54.228684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:20:54.330296 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-860b357c-6920-4ef3-8b63-abec85e6f393 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "DELETE /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 204 len: 0 microversion: 2.1 time: 0.143093 Apr 02 21:20:54.331822 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3100/5892] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:20:54 2022] DELETE /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:20:54.340875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:54.341544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:54.348400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:54.349741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:54.350858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:54.351355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:54.586089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:54.600195 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1bc3aab4-6591-4fb6-a62e-0fe78405a1fc tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1507 microversion: 2.1 time: 0.262654 Apr 02 21:20:54.601566 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2793/5893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:54 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:55.620422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:55.624367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:55.637330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:55.637875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:55.638904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:55.639427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:55.862389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:55.870663 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-49b15c7e-ef51-407f-8b2c-4b181637e8cd tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1507 microversion: 2.1 time: 0.255218 Apr 02 21:20:55.871248 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3101/5894] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:55 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:56.892236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:56.894857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:56.915104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:56.916843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:56.918574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:56.919336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:57.211924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d7e47123-7c9a-4677-be5b-92524f6f0028 req-96d8d6b0-533a-4b31-b166-43434d4c7582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c", "name": "network-vif-deleted", "tag": "321956b4-e20f-4643-9278-f10e9108f1a6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:57.233868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d7e47123-7c9a-4677-be5b-92524f6f0028 req-96d8d6b0-533a-4b31-b166-43434d4c7582 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:57.237224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d7e47123-7c9a-4677-be5b-92524f6f0028 req-96d8d6b0-533a-4b31-b166-43434d4c7582 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:57.237835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46cec44517a4a3a9aa20a1789097ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e8bc61a3e3149c3bb79c449929eb875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:20:57.252791 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d7e47123-7c9a-4677-be5b-92524f6f0028 req-96d8d6b0-533a-4b31-b166-43434d4c7582 service nova] Creating event network-vif-deleted:321956b4-e20f-4643-9278-f10e9108f1a6 for instance be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c on nch1-master-1 Apr 02 21:20:57.261538 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d7e47123-7c9a-4677-be5b-92524f6f0028 req-96d8d6b0-533a-4b31-b166-43434d4c7582 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054094 Apr 02 21:20:57.266006 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3102/5895] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:20:57.275957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c07ebf6b-969b-4628-b9fb-4de1dab80444 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 200 len: 1507 microversion: 2.1 time: 0.392152 Apr 02 21:20:57.278147 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2794/5896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:56 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:20:57.578749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:20:57.579803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:57.586915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:57.587571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:57.588359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:57.588853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:57.647644 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-989d2f4b-9f03-4873-af12-a7181d08e5f0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b/action" status: 200 len: 24567 microversion: 2.1 time: 0.072702 Apr 02 21:20:57.668231 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3103/5897] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:20:57 2022] POST /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b/action => generated 24567 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:20:58.295078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:20:58.295669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] [instance: be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:20:58.304872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:58.305487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:58.306293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:20:58.307144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:20:58.323957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] HTTP exception thrown: Instance be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c could not be found. Apr 02 21:20:58.324619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] Returning 404 to user: Instance be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:20:58.325631 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a14fba9-044b-4c9a-b9c1-498a8774e834 tempest-TestServerAdvancedOps-102484317 tempest-TestServerAdvancedOps-102484317-project] 10.222.0.18 "GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c" status: 404 len: 111 microversion: 2.1 time: 0.034761 Apr 02 21:20:58.326184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2795/5898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:20:58 2022] GET /compute/v2.1/servers/be270f8f-bae1-4bf9-8c4e-37ca1ae9e02c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:21:01.995487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:01.997396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:02.008212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:02.008712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:02.009516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:02.009954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:02.073615 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9423eb60-f222-4c9e-a8ad-72cff44cf660 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action" status: 200 len: 24570 microversion: 2.1 time: 0.081989 Apr 02 21:21:02.074975 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3104/5899] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:21:01 2022] POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action => generated 24570 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:21:13.277973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2c1adf75-f7a5-47bc-b886-34dd193d3249 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'create', calling method: .version_select at 0x7f54c7f48dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1300412668"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:13.293155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2c1adf75-f7a5-47bc-b886-34dd193d3249 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:21:13.299178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2c1adf75-f7a5-47bc-b886-34dd193d3249 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:21:13.463156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2c1adf75-f7a5-47bc-b886-34dd193d3249 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:21:13.468557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2c1adf75-f7a5-47bc-b886-34dd193d3249 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:21:13.491939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2c1adf75-f7a5-47bc-b886-34dd193d3249 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.217691 Apr 02 21:21:13.492827 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2796/5900] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:21:13 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:15.153951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-696309695", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "e2f5ded3-67dc-4b7d-8c89-cef6f962111a"}], "key_name": "tempest-TestNetworkBasicOps-1300412668", "security_groups": [{"name": "tempest-secgroup-smoke-111032244"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:15.315229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] validate_networks() for [('e2f5ded3-67dc-4b7d-8c89-cef6f962111a', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:21:15.926763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:21:15.928223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:21:15.928877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:21:15.929404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:21:15.929934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:21:15.942533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:15.943613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:15.945069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:15.945813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:15.970989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:21:15.978882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:21:15.996166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:21:15.999312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:21:16.057167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e26c07e3-27d1-4052-9dc9-3c7bf1a859de tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.907548 Apr 02 21:21:16.058036 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3105/5901] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:21:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:21:16.070906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d5db33f6-64c7-473e-8e74-a2babeb6c285 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:16.070906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d5db33f6-64c7-473e-8e74-a2babeb6c285 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:16.178176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d5db33f6-64c7-473e-8e74-a2babeb6c285 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:16.187897 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d5db33f6-64c7-473e-8e74-a2babeb6c285 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1248 microversion: 2.1 time: 0.123554 Apr 02 21:21:16.196864 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2797/5902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:16 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1248 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:17.221782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:17.223587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:17.230141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:17.230801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:17.231792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:17.232242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:17.325916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:17.334812 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c1cc84f-5045-4e60-be69-20e1cfb839d0 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1318 microversion: 2.1 time: 0.117632 Apr 02 21:21:17.335519 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3106/5903] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:17 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1318 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:18.352343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:18.353725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:18.360966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:18.361670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:18.362672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:18.363151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:18.665195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:18.675788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a778b2e3-42db-48aa-8d6d-6133023d042b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1373 microversion: 2.1 time: 0.327924 Apr 02 21:21:18.676822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2798/5904] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:18 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1373 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:19.137198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-75e1d836-57de-4d4c-ada0-a48cb0b5c96d req-9929bf12-29e4-496e-89aa-9cc910e30d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465227af-e6f2-4b57-b55e-b326f76514f1", "tag": "369a7247-39b0-46c8-98d4-4f2deb2ef1b7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:19.160030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-75e1d836-57de-4d4c-ada0-a48cb0b5c96d req-9929bf12-29e4-496e-89aa-9cc910e30d06 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:19.160515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-75e1d836-57de-4d4c-ada0-a48cb0b5c96d req-9929bf12-29e4-496e-89aa-9cc910e30d06 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:19.181415 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-75e1d836-57de-4d4c-ada0-a48cb0b5c96d req-9929bf12-29e4-496e-89aa-9cc910e30d06 service nova] Creating event network-changed:369a7247-39b0-46c8-98d4-4f2deb2ef1b7 for instance 465227af-e6f2-4b57-b55e-b326f76514f1 on nch1-master-1 Apr 02 21:21:19.187827 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-75e1d836-57de-4d4c-ada0-a48cb0b5c96d req-9929bf12-29e4-496e-89aa-9cc910e30d06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054755 Apr 02 21:21:19.188976 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3107/5905] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:21:19.693182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:19.693801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:19.704446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:19.706114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:19.711233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:19.711633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:19.985990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:19.994243 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ba83e9d4-8b89-4805-bb6f-8fd9ddde1429 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1373 microversion: 2.1 time: 0.304877 Apr 02 21:21:19.994933 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2799/5906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:19 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:21.013991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:21.014889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:21.021872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:21.022405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:21.023384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:21.024003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:21.187368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:21.195818 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e82cbe32-e734-4c81-97c3-f10311d2b220 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1373 microversion: 2.1 time: 0.187066 Apr 02 21:21:21.196442 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3108/5907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:21 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:21:22.212446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:22.213790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:22.224878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:22.225348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:22.226143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:22.226596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:22.833433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:22.840983 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-78c2780f-23e4-4455-b304-48055a0920bc tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1373 microversion: 2.1 time: 0.633101 Apr 02 21:21:22.841646 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2800/5908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:22 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1373 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:23.857942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:23.858766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:23.866746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:23.867491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:23.868646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:23.869911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:23.897017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-02cc2fe0-65cf-40d6-83ce-75fc5a92cae4 req-6ee8ee6c-d95b-4c6a-99be-82873d954482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465227af-e6f2-4b57-b55e-b326f76514f1", "name": "network-vif-plugged", "status": "completed", "tag": "369a7247-39b0-46c8-98d4-4f2deb2ef1b7"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:23.908304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-02cc2fe0-65cf-40d6-83ce-75fc5a92cae4 req-6ee8ee6c-d95b-4c6a-99be-82873d954482 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:23.909097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-02cc2fe0-65cf-40d6-83ce-75fc5a92cae4 req-6ee8ee6c-d95b-4c6a-99be-82873d954482 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:23.923579 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-02cc2fe0-65cf-40d6-83ce-75fc5a92cae4 req-6ee8ee6c-d95b-4c6a-99be-82873d954482 service nova] Creating event network-vif-plugged:369a7247-39b0-46c8-98d4-4f2deb2ef1b7 for instance 465227af-e6f2-4b57-b55e-b326f76514f1 on nch1-master-1 Apr 02 21:21:23.929911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-02cc2fe0-65cf-40d6-83ce-75fc5a92cae4 req-6ee8ee6c-d95b-4c6a-99be-82873d954482 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038257 Apr 02 21:21:23.930508 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2801/5909] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:21:24.131652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:24.139212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3c743c5f-31d1-4731-b450-199f4dc29006 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1373 microversion: 2.1 time: 0.285298 Apr 02 21:21:24.139872 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3109/5910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:23 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:25.157269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:25.158696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:25.168214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:25.168717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:25.169822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:25.170269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:25.328115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:25.335882 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fe86ec59-c986-4b35-bab0-dd753082e6a8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1373 microversion: 2.1 time: 0.184042 Apr 02 21:21:25.336686 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2802/5911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:25 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:26.353356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:26.361574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:26.374789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:26.375261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:26.376056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:26.376530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:27.050020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:27.059077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e134b93-0b08-4e33-b55c-0344b5ce32eb tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1546 microversion: 2.1 time: 0.709557 Apr 02 21:21:27.059774 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3110/5912] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:26 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1546 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:27.075704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:27.077032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:27.083752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:27.084263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:27.085207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:27.085909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:27.264383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:27.273246 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-852eec75-b1ce-4129-b603-e5f8e19d9747 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1546 microversion: 2.1 time: 0.201724 Apr 02 21:21:27.274002 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2803/5913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:27 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1546 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:32.512819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:32.514115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:32.523467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:32.524243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:32.527057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:32.527726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.098048 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6da96ff-7464-4f76-abe6-86fac2cb1a68 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1836 microversion: 2.1 time: 0.590747 Apr 02 21:21:33.104953 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3111/5914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:32 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1836 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:21:33.127013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:33.128332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:33.147714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:33.149156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.150813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:33.151476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.429672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:33.439209 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0242db6f-1c8b-471a-8cc5-9fdcf7963e39 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1685 microversion: 2.1 time: 0.325410 Apr 02 21:21:33.451466 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2804/5915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:33 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1685 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:33.591526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:33.593217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:33.605580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:33.606340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.607145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:33.607658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.674792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-477e6c28-6fdf-4841-92d5-cf27e06cdbe0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action" status: 200 len: 32647 microversion: 2.1 time: 0.087811 Apr 02 21:21:33.688500 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3112/5916] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:21:33 2022] POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action => generated 32647 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:21:33.837975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:33.838812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:33.846301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:33.846767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.847563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:33.848009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:33.901591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f4699b061734ae6b846fbb238a45b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69b144575d48ca9fdf5f7a55a2f43a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:33.902290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: aa047aff-276d-4e5c-99e9-885361a57225] flavor_id is None. Assuming migration. {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 02 21:21:33.903289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:21:34.157154 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:21:34.159065 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action (ip 10.222.0.18) !!! Apr 02 21:21:34.242718 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc6f7c6a-cbc6-4c15-8e31-5dbe0fce614f tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action" status: 202 len: 0 microversion: 2.1 time: 0.408877 Apr 02 21:21:34.243985 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2805/5917] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:21:33 2022] POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:21:34.253162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:34.253886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:34.261664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:34.262130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:34.262924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:34.263366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:34.556160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:34.584546 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-182cd2ad-adf9-4f07-8c7d-2172715315bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1694 microversion: 2.1 time: 0.332954 Apr 02 21:21:34.585309 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3113/5918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:34 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1694 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:35.603300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:35.604026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:35.619506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:35.620229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:35.621347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:35.621875 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:35.881888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:35.889462 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-708e28e1-338e-496c-b5d6-2428dd4365ff tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1694 microversion: 2.1 time: 0.290941 Apr 02 21:21:35.890052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2806/5919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:35 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:36.907703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:36.908349 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:36.917070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:36.917534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:36.918328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:36.919046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:37.058672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:37.066466 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2c0a39cd-cf16-4bc4-b2c1-0253dcab0391 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1694 microversion: 2.1 time: 0.162702 Apr 02 21:21:37.067044 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3114/5920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:36 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:38.084163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:38.084838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:38.096334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:38.096993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:38.097799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:38.099472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:38.458064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:38.466857 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64e9948f-eeea-45d1-b7bb-22d6d5b348f7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.386583 Apr 02 21:21:38.467799 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2807/5921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:38 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:39.485537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:39.486144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:39.494840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:39.495528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:39.496727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:39.497169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:39.685285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:39.693410 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f3cdcc7-ec39-4719-9ffa-97e257575251 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.211738 Apr 02 21:21:39.693995 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3115/5922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:39 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:40.711049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:40.713596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:40.721485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:40.721953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:40.722940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:40.723922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:40.875469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:40.883464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1d1ee1ee-5811-4483-aeae-ecb2a65939e8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.176613 Apr 02 21:21:40.884082 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2808/5923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:40 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:41.900276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:41.900933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:41.908033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:41.908535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:41.909328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:41.909784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:42.134452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:42.142327 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73e0fcff-b14d-434c-8cb7-3f44c01d164d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.245961 Apr 02 21:21:42.143000 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3116/5924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:41 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:43.159198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:43.159898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:43.167604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:43.168145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:43.169282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:43.169791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:43.782769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:43.790270 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc21a08a-a1da-445b-8776-ec311a655f95 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.635011 Apr 02 21:21:43.790899 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2809/5925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:43 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:44.807123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:44.807794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:44.820930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:44.821677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:44.822559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:44.823056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:45.174431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:45.182355 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd922985-7475-4d79-8e25-898a6aa241b0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.379142 Apr 02 21:21:45.183523 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3117/5926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:44 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:46.200873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:46.201512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:46.208990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:46.209454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:46.210248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:46.210702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:46.424572 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:46.432759 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1911f449-2f22-49b7-8594-d306c539974f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.235847 Apr 02 21:21:46.433340 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2810/5927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:46 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:47.450528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:47.451056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:47.458735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:47.459188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:47.459969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:47.460404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:47.602794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:47.614835 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fadc3f2d-efef-4020-8e22-e0947edacbe6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.167467 Apr 02 21:21:47.615380 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3118/5928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:47 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:48.632309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:48.633295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:48.640784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:48.641258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:48.642059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:48.642513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:48.919525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:48.930885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b90aa39-8279-4181-beeb-d2d6709e7e5c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.303169 Apr 02 21:21:48.933089 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2811/5929] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:48 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:49.951386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:49.952008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:49.959119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:49.959577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:49.960497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:49.960837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:50.099271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:50.106689 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-91674151-8c44-41bb-95e2-1878cf565a91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.159417 Apr 02 21:21:50.107261 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3119/5930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:49 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:51.124577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:51.125264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:51.133614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:51.134356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:51.135146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:51.135785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:51.581161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:51.588860 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2880d568-5119-49d3-9975-e8b536f87fe1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.468131 Apr 02 21:21:51.589444 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2812/5931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:51 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:52.606099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:52.606898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:52.614367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:52.614904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:52.615749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:52.616280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:52.819692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:52.827721 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-47b6e86f-61b3-43d0-9b4f-f88f3e4d22bc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.225627 Apr 02 21:21:52.828297 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3120/5932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:52 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:53.845362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:53.846109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:53.853777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:53.854246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:53.855042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:53.855494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:54.110211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:54.118069 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0ebd149d-adad-465d-a814-a553fdfb4dfd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1699 microversion: 2.1 time: 0.276864 Apr 02 21:21:54.118669 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2813/5933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:53 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1699 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:55.065722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1cf063d2-2e56-44b8-9b6f-d69f5bdc1b27 req-9a5e156b-f35c-484d-a815-1aabc88f338b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "name": "network-vif-unplugged", "status": "completed", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:55.078547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1cf063d2-2e56-44b8-9b6f-d69f5bdc1b27 req-9a5e156b-f35c-484d-a815-1aabc88f338b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:55.079199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1cf063d2-2e56-44b8-9b6f-d69f5bdc1b27 req-9a5e156b-f35c-484d-a815-1aabc88f338b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:55.092083 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1cf063d2-2e56-44b8-9b6f-d69f5bdc1b27 req-9a5e156b-f35c-484d-a815-1aabc88f338b service nova] Creating event network-vif-unplugged:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch2-master-1 Apr 02 21:21:55.098510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-1cf063d2-2e56-44b8-9b6f-d69f5bdc1b27 req-9a5e156b-f35c-484d-a815-1aabc88f338b service nova] Instance aa047aff-276d-4e5c-99e9-885361a57225 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:21:55.109501 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1cf063d2-2e56-44b8-9b6f-d69f5bdc1b27 req-9a5e156b-f35c-484d-a815-1aabc88f338b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047491 Apr 02 21:21:55.110426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3121/5934] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:21:55.136437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:55.137160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:55.144161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:55.145281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:55.146248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:55.146702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:55.334957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:55.344150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7055b2e-2d68-4cda-8527-d8fa826c4aac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1698 microversion: 2.1 time: 0.211626 Apr 02 21:21:55.345358 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2814/5935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:55 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1698 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:56.367801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:56.368440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:56.375392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:56.375877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:56.376696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:56.377168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:56.523112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:56.531227 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7db126b6-d373-4704-8391-263f9a0db3c7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1696 microversion: 2.1 time: 0.169503 Apr 02 21:21:56.532136 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3122/5936] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:56 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:57.124658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-493d02cc-1877-41a2-9842-49f9892e34a7 req-5141b710-1816-4c16-b994-2f00d0e7c5ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:57.133789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-493d02cc-1877-41a2-9842-49f9892e34a7 req-5141b710-1816-4c16-b994-2f00d0e7c5ec service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:57.134237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-493d02cc-1877-41a2-9842-49f9892e34a7 req-5141b710-1816-4c16-b994-2f00d0e7c5ec service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:57.145870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-493d02cc-1877-41a2-9842-49f9892e34a7 req-5141b710-1816-4c16-b994-2f00d0e7c5ec service nova] Creating event network-changed:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch2-master-1 Apr 02 21:21:57.151133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-493d02cc-1877-41a2-9842-49f9892e34a7 req-5141b710-1816-4c16-b994-2f00d0e7c5ec service nova] Instance aa047aff-276d-4e5c-99e9-885361a57225 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:21:57.163360 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-493d02cc-1877-41a2-9842-49f9892e34a7 req-5141b710-1816-4c16-b994-2f00d0e7c5ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041947 Apr 02 21:21:57.163952 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2815/5937] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:21:57.549820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:57.551355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:57.558391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:57.559126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:57.560238 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:57.561608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:57.819072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:57.827247 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2d215e41-2b48-4316-862d-f7631075e6d8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1696 microversion: 2.1 time: 0.281403 Apr 02 21:21:57.827875 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3123/5938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:57 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1696 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:58.845410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:58.846423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:58.853885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:58.854349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:58.855130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:58.855580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:58.996417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:59.005713 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49437cb1-b6e0-41f4-8cd8-c3b5e7dab33a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1693 microversion: 2.1 time: 0.164877 Apr 02 21:21:59.006295 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2816/5939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:58 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:21:59.022139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:21:59.022729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:59.029438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:59.029896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:59.030761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:59.031213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:59.089430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac6b5ccf-d0be-4cc6-a02f-4882067f5b7e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action" status: 204 len: 0 microversion: 2.1 time: 0.070390 Apr 02 21:21:59.093159 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3124/5940] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:21:59 2022] POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:21:59.098349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:21:59.098980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:21:59.105777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:59.106299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:59.107088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:21:59.107544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:21:59.499429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:21:59.510102 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ae4e5bb6-a0f6-4eff-884d-503a17ef327c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1693 microversion: 2.1 time: 0.415646 Apr 02 21:21:59.510914 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2817/5941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:21:59 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1693 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:00.529342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:00.530986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:00.544717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:00.545388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:00.546699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:00.547148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:00.785530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:00.799790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02af5142-b672-492f-babc-c946a9a7876e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1693 microversion: 2.1 time: 0.275316 Apr 02 21:22:00.800746 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3125/5942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:00 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:01.731394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ae15a57e-7881-4f7c-b96e-7af7364d327a req-79e69ae6-5975-4ae0-b9ec-2a8042d4a76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "name": "network-vif-plugged", "status": "completed", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:01.751122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ae15a57e-7881-4f7c-b96e-7af7364d327a req-79e69ae6-5975-4ae0-b9ec-2a8042d4a76d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:01.751563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ae15a57e-7881-4f7c-b96e-7af7364d327a req-79e69ae6-5975-4ae0-b9ec-2a8042d4a76d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:01.766763 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ae15a57e-7881-4f7c-b96e-7af7364d327a req-79e69ae6-5975-4ae0-b9ec-2a8042d4a76d service nova] Creating event network-vif-plugged:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch2-master-1 Apr 02 21:22:01.773053 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ae15a57e-7881-4f7c-b96e-7af7364d327a req-79e69ae6-5975-4ae0-b9ec-2a8042d4a76d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048755 Apr 02 21:22:01.774601 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2818/5943] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:01.819918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:01.820631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:01.829338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:01.830409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:01.831625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:01.832335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:02.059778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:02.069338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10d6c597-6541-4591-acbf-91e6de1b16a6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1685 microversion: 2.1 time: 0.255419 Apr 02 21:22:02.081039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3126/5944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:01 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1685 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:03.481986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:03.482582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:03.490218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:03.490679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:03.491455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:03.491904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:03.522382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:22:03.613404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-701c7ab7-719e-46a9-a724-9c54d104069b tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "DELETE /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 204 len: 0 microversion: 2.1 time: 0.135296 Apr 02 21:22:03.614367 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2819/5945] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:22:03 2022] DELETE /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:22:03.625240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:03.625928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:03.636398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:03.637092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:03.638013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:03.638553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:03.889651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:03.900683 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac3d28cc-7661-4cfb-a7bf-3059d60d02dd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1552 microversion: 2.1 time: 0.281871 Apr 02 21:22:03.901554 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3127/5946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:03 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1552 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:04.922396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:04.923163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:04.930087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:04.930630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:04.931415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:04.932121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:05.086742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:05.095200 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b614e0ca-f71c-40a4-8ad4-35023daff1d3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1552 microversion: 2.1 time: 0.177382 Apr 02 21:22:05.095799 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2820/5947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:04 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:05.850667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-adab571e-93d0-4eff-88dd-05841c10cd84 req-de386fc2-5bb5-4191-ba79-1bdace0c4d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465227af-e6f2-4b57-b55e-b326f76514f1", "name": "network-vif-deleted", "tag": "369a7247-39b0-46c8-98d4-4f2deb2ef1b7"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:05.865678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-adab571e-93d0-4eff-88dd-05841c10cd84 req-de386fc2-5bb5-4191-ba79-1bdace0c4d9f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:05.866351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-adab571e-93d0-4eff-88dd-05841c10cd84 req-de386fc2-5bb5-4191-ba79-1bdace0c4d9f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:05.884283 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-adab571e-93d0-4eff-88dd-05841c10cd84 req-de386fc2-5bb5-4191-ba79-1bdace0c4d9f service nova] Creating event network-vif-deleted:369a7247-39b0-46c8-98d4-4f2deb2ef1b7 for instance 465227af-e6f2-4b57-b55e-b326f76514f1 on nch1-master-1 Apr 02 21:22:05.889834 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-adab571e-93d0-4eff-88dd-05841c10cd84 req-de386fc2-5bb5-4191-ba79-1bdace0c4d9f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042946 Apr 02 21:22:05.890498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3128/5948] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:06.113944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:06.114606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:06.121976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:06.122443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:06.123242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:06.123695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:06.161676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:06.162432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:06.163057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lazy-loading 'fault' on Instance uuid 465227af-e6f2-4b57-b55e-b326f76514f1 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:22:06.247554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:06.274785 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0228d947-8816-4c0f-9671-1a8bc1c08f0e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 200 len: 1338 microversion: 2.1 time: 0.165017 Apr 02 21:22:06.278448 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2821/5949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:06 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 1338 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:07.296356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:07.297575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 465227af-e6f2-4b57-b55e-b326f76514f1] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:07.306527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:07.307256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:07.308067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:07.308740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:07.333151 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] HTTP exception thrown: Instance 465227af-e6f2-4b57-b55e-b326f76514f1 could not be found. Apr 02 21:22:07.333926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Returning 404 to user: Instance 465227af-e6f2-4b57-b55e-b326f76514f1 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:22:07.334997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae5a8200-bd39-42fb-b8f7-25d63db385f4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1" status: 404 len: 111 microversion: 2.1 time: 0.044365 Apr 02 21:22:07.335623 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3129/5950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:07 2022] GET /compute/v2.1/servers/465227af-e6f2-4b57-b55e-b326f76514f1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:22:07.503289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-22d6e4c8-79a6-49fc-8922-d0222e02dba4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '.version_select at 0x7f54d5052670>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:07.523426 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-22d6e4c8-79a6-49fc-8922-d0222e02dba4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1300412668" status: 202 len: 0 microversion: 2.1 time: 0.025317 Apr 02 21:22:07.524024 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2822/5951] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1300412668 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:22:10.191675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:10.191675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:10.198289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:10.199277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:10.204964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5aaa584b-3d39-4037-a272-97bc0ed30ad8 req-d750d822-8626-42a8-83dc-252d3b5e5ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf269a74-e067-459f-a8ce-93eec45d406b", "tag": "e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:10.216933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:10.217406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:10.225594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5aaa584b-3d39-4037-a272-97bc0ed30ad8 req-d750d822-8626-42a8-83dc-252d3b5e5ab7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:10.226044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5aaa584b-3d39-4037-a272-97bc0ed30ad8 req-d750d822-8626-42a8-83dc-252d3b5e5ab7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:10.242034 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5aaa584b-3d39-4037-a272-97bc0ed30ad8 req-d750d822-8626-42a8-83dc-252d3b5e5ab7 service nova] Creating event network-changed:e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb for instance bf269a74-e067-459f-a8ce-93eec45d406b on nch2-master-1 Apr 02 21:22:10.262171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:22:10.272001 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5aaa584b-3d39-4037-a272-97bc0ed30ad8 req-d750d822-8626-42a8-83dc-252d3b5e5ab7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070469 Apr 02 21:22:10.279085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2823/5952] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:10.414703 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d67d5b4-efc6-407d-aef2-2896765c8ace tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 204 len: 0 microversion: 2.1 time: 0.227380 Apr 02 21:22:10.415425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3130/5953] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:22:10 2022] DELETE /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:22:10.426458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:10.427232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:10.448215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:10.448847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:10.458016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:10.458489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:10.655699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:10.666651 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a3ce1550-b7b3-4f95-9bb6-d2b28ba617d1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1668 microversion: 2.1 time: 0.246053 Apr 02 21:22:10.668315 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2824/5954] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:10 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1668 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:11.686405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:11.687122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:11.694235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:11.694694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:11.695471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:11.695915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:11.853802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:11.862430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc96dfd7-20fe-478a-a1fc-04fea982c005 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1550 microversion: 2.1 time: 0.180272 Apr 02 21:22:11.871910 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3131/5955] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:11 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:12.466171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f4c52fd0-bf18-4129-b095-b4895d7e223b req-036fdc0a-ef61-4f0b-b5d0-ff23c9f13d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf269a74-e067-459f-a8ce-93eec45d406b", "name": "network-vif-deleted", "tag": "e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:12.482896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f4c52fd0-bf18-4129-b095-b4895d7e223b req-036fdc0a-ef61-4f0b-b5d0-ff23c9f13d78 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:12.483397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f4c52fd0-bf18-4129-b095-b4895d7e223b req-036fdc0a-ef61-4f0b-b5d0-ff23c9f13d78 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:12.495675 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f4c52fd0-bf18-4129-b095-b4895d7e223b req-036fdc0a-ef61-4f0b-b5d0-ff23c9f13d78 service nova] Creating event network-vif-deleted:e5aef963-ef9d-4d80-83c3-afe9dcfa4fbb for instance bf269a74-e067-459f-a8ce-93eec45d406b on nch2-master-1 Apr 02 21:22:12.500975 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f4c52fd0-bf18-4129-b095-b4895d7e223b req-036fdc0a-ef61-4f0b-b5d0-ff23c9f13d78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041654 Apr 02 21:22:12.501588 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2825/5956] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:12.882249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:12.885473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:12.894828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:12.895593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:12.896697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:12.897528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:12.970390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:12.977095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:12.978953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lazy-loading 'fault' on Instance uuid bf269a74-e067-459f-a8ce-93eec45d406b {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:22:13.035228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:13.042258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce5d3b7b-46de-4df4-8a1e-8455cbc7bc7f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 200 len: 1339 microversion: 2.1 time: 0.165728 Apr 02 21:22:13.043112 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3132/5957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:12 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:14.061759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:14.062475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: bf269a74-e067-459f-a8ce-93eec45d406b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:14.069631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:14.070105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:14.070895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:14.071349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:14.084916 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] HTTP exception thrown: Instance bf269a74-e067-459f-a8ce-93eec45d406b could not be found. Apr 02 21:22:14.085532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Returning 404 to user: Instance bf269a74-e067-459f-a8ce-93eec45d406b could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:22:14.086392 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0284890f-b2b6-4b21-9913-326ce5088cbf tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b" status: 404 len: 111 microversion: 2.1 time: 0.029888 Apr 02 21:22:14.086957 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2826/5958] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:14 2022] GET /compute/v2.1/servers/bf269a74-e067-459f-a8ce-93eec45d406b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:22:14.369004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1b288df-3665-4af8-b1db-fa131ef3497e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '.version_select at 0x7f54d48f3940>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:14.392915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1b288df-3665-4af8-b1db-fa131ef3497e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1137115326" status: 202 len: 0 microversion: 2.1 time: 0.027847 Apr 02 21:22:14.393915 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3133/5959] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1137115326 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:22:24.295045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:24.296834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:24.305987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:24.306814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:24.308416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:24.309123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:24.401573 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0532e54d-4077-44f3-8467-f05e81f49e22 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action" status: 200 len: 24577 microversion: 2.1 time: 0.111197 Apr 02 21:22:24.404356 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2827/5960] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:22:24 2022] POST /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225/action => generated 24577 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:22:25.570219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dcf2742f-3748-4e41-8d18-a90545fb3111 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'create', calling method: .version_select at 0x7f54c7d28c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1047807567"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:25.588192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dcf2742f-3748-4e41-8d18-a90545fb3111 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:22:25.594173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dcf2742f-3748-4e41-8d18-a90545fb3111 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:22:25.733543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dcf2742f-3748-4e41-8d18-a90545fb3111 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:22:25.741228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-dcf2742f-3748-4e41-8d18-a90545fb3111 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:22:25.757185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dcf2742f-3748-4e41-8d18-a90545fb3111 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.190715 Apr 02 21:22:25.758016 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3134/5961] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:22:25 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:27.293646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-443766159", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "de133907-2e5a-4a41-a35e-372465d341cd"}], "key_name": "tempest-TestNetworkBasicOps-1047807567", "security_groups": [{"name": "tempest-secgroup-smoke-578980615"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:27.498141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] validate_networks() for [('de133907-2e5a-4a41-a35e-372465d341cd', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:22:28.306489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:22:28.307791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:22:28.308914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:22:28.310495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:22:28.311373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:22:28.329641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:28.330185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:28.331757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:28.332619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:28.360671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:22:28.366666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Getting quotas for user fb1ba274f1104befa1bd14c95525c3ab and project 7c63afebe86f46e8b16647d8eda2cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:22:28.382278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:22:28.385787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:22:28.449526 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-196f7a2f-7667-4d18-b8df-4304adde88a3 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.160589 Apr 02 21:22:28.450900 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2828/5962] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:22:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:22:28.462615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35ad9c41-3061-4ed4-b3b0-cb3889eddc1f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:28.463523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35ad9c41-3061-4ed4-b3b0-cb3889eddc1f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:28.885164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35ad9c41-3061-4ed4-b3b0-cb3889eddc1f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:28.891925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35ad9c41-3061-4ed4-b3b0-cb3889eddc1f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1248 microversion: 2.1 time: 0.434460 Apr 02 21:22:28.892532 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3135/5963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:28 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1248 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:22:29.913131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:29.913902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:29.920871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:29.921527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:29.922552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:29.923071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:30.000283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:30.009100 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-897d214c-7a67-46c3-b40f-05ebc5845eff tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1318 microversion: 2.1 time: 0.103332 Apr 02 21:22:30.009677 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2829/5964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:29 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:30.840297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:30.841097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:30.849393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:30.850174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:30.851175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:30.851803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:31.026706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:31.028047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:31.040925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:31.043916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:31.047235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:31.047951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:31.128160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6653f8dc-5b13-49b9-b39d-396892376991 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1836 microversion: 2.1 time: 0.292516 Apr 02 21:22:31.129322 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3136/5965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:30 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1836 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:31.338599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:31.346634 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60091e87-1982-427f-b5c9-6053adfb1142 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.324139 Apr 02 21:22:31.347592 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2830/5966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:31 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:32.052366 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2603b8af-26a4-4074-80a5-35341c04ebcd req-c648d5f7-c970-47e7-b033-dbb646d4dfea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a015dc-1320-42b4-ba9a-074efa9bb974", "tag": "2de2e38f-cea5-4a34-ab3d-af26d621abf5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:32.087600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2603b8af-26a4-4074-80a5-35341c04ebcd req-c648d5f7-c970-47e7-b033-dbb646d4dfea service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:32.092108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2603b8af-26a4-4074-80a5-35341c04ebcd req-c648d5f7-c970-47e7-b033-dbb646d4dfea service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:32.123567 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2603b8af-26a4-4074-80a5-35341c04ebcd req-c648d5f7-c970-47e7-b033-dbb646d4dfea service nova] Creating event network-changed:2de2e38f-cea5-4a34-ab3d-af26d621abf5 for instance 18a015dc-1320-42b4-ba9a-074efa9bb974 on nch2-master-1 Apr 02 21:22:32.132571 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2603b8af-26a4-4074-80a5-35341c04ebcd req-c648d5f7-c970-47e7-b033-dbb646d4dfea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088112 Apr 02 21:22:32.133613 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3137/5967] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:32.364121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:32.364711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:32.373892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:32.374587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:32.375380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:32.376220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:32.534556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:32.543267 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4cd7e637-01cd-435c-afea-274663fe8cf5 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.183894 Apr 02 21:22:32.552515 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2831/5968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:32 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:33.349933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:33.351770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:33.359286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:33.366048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:33.367668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:33.368200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:33.400469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:22:33.516102 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cfc89a9f-6753-4d62-8ce6-8d349c0932b4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 204 len: 0 microversion: 2.1 time: 0.175187 Apr 02 21:22:33.517560 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3138/5969] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:22:33 2022] DELETE /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:22:33.529011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:33.530185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:33.538751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:33.539436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:33.540393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:33.541035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:33.562075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:33.562784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:33.578225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:33.578709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:33.579518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:33.579959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:33.714833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:33.723177 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4f074f45-5f98-4c94-9785-bd44ec99d6ba tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1691 microversion: 2.1 time: 0.199993 Apr 02 21:22:33.723768 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2832/5970] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:33 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:33.898656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:33.906617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab4a2692-93cf-4a43-8619-fc02eedc150e tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.349275 Apr 02 21:22:33.907315 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3139/5971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:33 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:22:34.162577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-64a21963-45ff-4ddb-aff9-3960a2c14f09 req-474222ec-6f6b-486d-bd77-0788c33afaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:34.171634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-64a21963-45ff-4ddb-aff9-3960a2c14f09 req-474222ec-6f6b-486d-bd77-0788c33afaa3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:34.172380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-64a21963-45ff-4ddb-aff9-3960a2c14f09 req-474222ec-6f6b-486d-bd77-0788c33afaa3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:34.192501 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-64a21963-45ff-4ddb-aff9-3960a2c14f09 req-474222ec-6f6b-486d-bd77-0788c33afaa3 service nova] Creating event network-changed:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch2-master-1 Apr 02 21:22:34.198007 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-64a21963-45ff-4ddb-aff9-3960a2c14f09 req-474222ec-6f6b-486d-bd77-0788c33afaa3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039117 Apr 02 21:22:34.198797 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2833/5972] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:34.741338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:34.743699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:34.751021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:34.751853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:34.753435 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:34.754048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:34.926061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:34.927322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:34.934711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:34.935383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:34.936591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:34.937197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:34.968752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:34.979013 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3297b842-a6be-40d9-9552-83bdd5516db1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 200 len: 1691 microversion: 2.1 time: 0.243024 Apr 02 21:22:34.989835 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3140/5973] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:34 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:35.177366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:35.185988 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-535257eb-b0b4-4189-8ac4-fb9c1aca1a39 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.265780 Apr 02 21:22:35.186633 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2834/5974] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:34 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:35.998990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:36.000400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: aa047aff-276d-4e5c-99e9-885361a57225] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:36.010062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:36.010990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:36.012673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:36.013291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:36.030641 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] HTTP exception thrown: Instance aa047aff-276d-4e5c-99e9-885361a57225 could not be found. Apr 02 21:22:36.031527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Returning 404 to user: Instance aa047aff-276d-4e5c-99e9-885361a57225 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:22:36.032670 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cba58ffe-8c7a-4ad7-911e-1e96593c8092 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225" status: 404 len: 111 microversion: 2.1 time: 0.038961 Apr 02 21:22:36.037877 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3141/5975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:35 2022] GET /compute/v2.1/servers/aa047aff-276d-4e5c-99e9-885361a57225 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:22:36.203163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:36.203883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:36.211677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:36.212534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:36.213507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:36.214133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:36.224419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-420693af-f9c2-4787-b6d3-fea35247ea62 req-fad35261-5126-400c-b0a5-55c1b156a377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa047aff-276d-4e5c-99e9-885361a57225", "name": "network-vif-deleted", "tag": "b1bae5f8-326c-475b-ad9e-32535077b85a"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:36.239718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-420693af-f9c2-4787-b6d3-fea35247ea62 req-fad35261-5126-400c-b0a5-55c1b156a377 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:36.240182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-420693af-f9c2-4787-b6d3-fea35247ea62 req-fad35261-5126-400c-b0a5-55c1b156a377 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:36.267432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-420693af-f9c2-4787-b6d3-fea35247ea62 req-fad35261-5126-400c-b0a5-55c1b156a377 service nova] Creating event network-vif-deleted:b1bae5f8-326c-475b-ad9e-32535077b85a for instance aa047aff-276d-4e5c-99e9-885361a57225 on nch2-master-1 Apr 02 21:22:36.275413 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-420693af-f9c2-4787-b6d3-fea35247ea62 req-fad35261-5126-400c-b0a5-55c1b156a377 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054639 Apr 02 21:22:36.276463 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3142/5976] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:22:36.522498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:36.530502 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f01ccd4-63d6-491e-9738-ad5c0f2ae7e8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.331135 Apr 02 21:22:36.531318 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2835/5977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:36 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:37.548415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:37.549326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:37.563937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:37.565854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:37.566683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:37.567145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:37.832006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:37.844112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a6e864a-9264-4dcd-b2c4-c4320e9ae4c8 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.299750 Apr 02 21:22:37.855604 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3143/5978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:37 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:37.872731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-949dc5b4-5094-4f84-9d9c-1d9cbe2456d5 req-76abbd11-9934-4abb-b3ac-ae4e47fc4352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a015dc-1320-42b4-ba9a-074efa9bb974", "name": "network-vif-plugged", "status": "completed", "tag": "2de2e38f-cea5-4a34-ab3d-af26d621abf5"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:37.882969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-949dc5b4-5094-4f84-9d9c-1d9cbe2456d5 req-76abbd11-9934-4abb-b3ac-ae4e47fc4352 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:37.883744 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-949dc5b4-5094-4f84-9d9c-1d9cbe2456d5 req-76abbd11-9934-4abb-b3ac-ae4e47fc4352 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:37.896416 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-949dc5b4-5094-4f84-9d9c-1d9cbe2456d5 req-76abbd11-9934-4abb-b3ac-ae4e47fc4352 service nova] Creating event network-vif-plugged:2de2e38f-cea5-4a34-ab3d-af26d621abf5 for instance 18a015dc-1320-42b4-ba9a-074efa9bb974 on nch2-master-1 Apr 02 21:22:37.901986 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-949dc5b4-5094-4f84-9d9c-1d9cbe2456d5 req-76abbd11-9934-4abb-b3ac-ae4e47fc4352 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032771 Apr 02 21:22:37.902724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2836/5979] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:38.862941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:38.863736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:38.874942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:38.875857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:38.876895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:38.877579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:39.137486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:39.147337 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80394403-3db3-44f6-87f2-5cea5e10b87f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1373 microversion: 2.1 time: 0.289642 Apr 02 21:22:39.147934 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3144/5980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:38 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1373 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:40.172738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:40.174905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:40.190979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:40.191607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:40.192810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:40.193697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:40.362463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:40.374303 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bdeb9a5-309b-4c40-93bc-448c1756fffd tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1546 microversion: 2.1 time: 0.213590 Apr 02 21:22:40.375638 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2837/5981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:40 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:40.391363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:40.391977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:40.398955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:40.399411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:40.400198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:40.400700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:40.634580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4fbec581-8a04-4c65-8d80-0dacf3fdb0cd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '.version_select at 0x7f54c7f0c3a0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:40.655411 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4fbec581-8a04-4c65-8d80-0dacf3fdb0cd tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1677310611" status: 202 len: 0 microversion: 2.1 time: 0.027769 Apr 02 21:22:40.661214 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2838/5982] 10.222.0.18 () {58 vars in 1283 bytes} [Sat Apr 2 21:22:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1677310611 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:22:40.688605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a15721e6-7382-4e06-8d4c-ded03c8f9a9c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: .version_select at 0x7f54d49f3310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1347032415"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:40.706433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a15721e6-7382-4e06-8d4c-ded03c8f9a9c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:22:40.712244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:40.713777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a15721e6-7382-4e06-8d4c-ded03c8f9a9c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:22:40.720069 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f808feb-b211-4659-86a6-93b44c91b4b4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1546 microversion: 2.1 time: 0.332503 Apr 02 21:22:40.721268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3145/5983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:40 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1546 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:41.095535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a15721e6-7382-4e06-8d4c-ded03c8f9a9c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:22:41.110278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a15721e6-7382-4e06-8d4c-ded03c8f9a9c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:22:41.126336 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a15721e6-7382-4e06-8d4c-ded03c8f9a9c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.443048 Apr 02 21:22:41.127760 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2839/5984] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:22:40 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:22:43.781225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7d040232-5405-409c-b94d-eaf085ed0ff4 req-20c3f7df-ea1a-4db7-8079-77d5a3c71731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a015dc-1320-42b4-ba9a-074efa9bb974", "tag": "2de2e38f-cea5-4a34-ab3d-af26d621abf5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:43.800567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7d040232-5405-409c-b94d-eaf085ed0ff4 req-20c3f7df-ea1a-4db7-8079-77d5a3c71731 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:43.801310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7d040232-5405-409c-b94d-eaf085ed0ff4 req-20c3f7df-ea1a-4db7-8079-77d5a3c71731 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:43.816673 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7d040232-5405-409c-b94d-eaf085ed0ff4 req-20c3f7df-ea1a-4db7-8079-77d5a3c71731 service nova] Creating event network-changed:2de2e38f-cea5-4a34-ab3d-af26d621abf5 for instance 18a015dc-1320-42b4-ba9a-074efa9bb974 on nch2-master-1 Apr 02 21:22:43.822481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7d040232-5405-409c-b94d-eaf085ed0ff4 req-20c3f7df-ea1a-4db7-8079-77d5a3c71731 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050124 Apr 02 21:22:43.824676 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3146/5985] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:48.765659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-831213317", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "7dcc999a-5e6b-45e7-950d-b3cf3766042e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1347032415", "security_groups": [{"name": "tempest-secgroup-smoke-1163726398"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:48.925836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] validate_networks() for [('7dcc999a-5e6b-45e7-950d-b3cf3766042e', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:22:49.409322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:22:49.409871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:22:49.410580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:22:49.411165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:22:49.411646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:22:49.423669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:49.432074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:49.433163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:49.433625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:49.462949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:22:49.470393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:22:49.490934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:22:49.493382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:22:49.555744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb2121d7-2d85-4069-84f4-52f24e29c0fa tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.795135 Apr 02 21:22:49.556807 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2840/5986] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:22:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:22:49.568351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfa8f287-207f-406a-82eb-84f9900894bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:49.569879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfa8f287-207f-406a-82eb-84f9900894bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:49.642034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfa8f287-207f-406a-82eb-84f9900894bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:49.656251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfa8f287-207f-406a-82eb-84f9900894bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1266 microversion: 2.1 time: 0.093033 Apr 02 21:22:49.667924 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3147/5987] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:49 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:22:50.675004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:50.675563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:50.686100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:50.686575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:50.687380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:50.687829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:50.812219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:50.821902 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-be667b48-d315-4126-af00-e22c4e60dc75 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1326 microversion: 2.1 time: 0.152456 Apr 02 21:22:50.835811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2841/5988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:50 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:51.843251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:51.843792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:51.866989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:51.867465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:51.868254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:51.869918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:51.957516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:51.966678 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee9cf406-0c06-4683-9488-49717a0b2409 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1324 microversion: 2.1 time: 0.126859 Apr 02 21:22:51.967359 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3148/5989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:51 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1324 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:52.983795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:52.984774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:52.996530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:52.998382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:53.001787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:53.003160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:53.179384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5a5375c1-8c46-4c4e-a293-e595cdef5c8e req-57525e47-d6c6-436d-9322-696eb5e13063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:53.198642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5a5375c1-8c46-4c4e-a293-e595cdef5c8e req-57525e47-d6c6-436d-9322-696eb5e13063 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:53.201113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5a5375c1-8c46-4c4e-a293-e595cdef5c8e req-57525e47-d6c6-436d-9322-696eb5e13063 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:53.235345 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5a5375c1-8c46-4c4e-a293-e595cdef5c8e req-57525e47-d6c6-436d-9322-696eb5e13063 service nova] Creating event network-changed:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:22:53.241353 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5a5375c1-8c46-4c4e-a293-e595cdef5c8e req-57525e47-d6c6-436d-9322-696eb5e13063 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068871 Apr 02 21:22:53.242290 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3149/5990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:22:53.303123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:53.311222 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4eb2fb0-2428-4ac2-b33a-3540926f7b0e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1392 microversion: 2.1 time: 0.331832 Apr 02 21:22:53.311905 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2842/5991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:52 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1392 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:54.330859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:54.331724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:54.338595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:54.339061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:54.339851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:54.340295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:54.494789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:54.502347 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b2c83be-c601-41a7-a451-3e51b8d7284e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1392 microversion: 2.1 time: 0.177156 Apr 02 21:22:54.502852 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3150/5992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:54 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:55.519091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:55.519705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:55.526859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:55.527328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:55.528092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:55.528561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:55.693450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:55.704488 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b87fe805-6a48-4ee2-94cc-3657623e081f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1392 microversion: 2.1 time: 0.189139 Apr 02 21:22:55.705110 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2843/5993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:55 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:56.721624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:56.722532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:56.729753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:56.730213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:56.730998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:56.731441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:56.923750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:56.931481 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3a11f41-04d9-4b00-b00b-6b42365b47f2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1392 microversion: 2.1 time: 0.214458 Apr 02 21:22:56.932068 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3151/5994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:56 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:57.753363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c2965f5b-5ee5-481d-a60b-e915093a91a5 req-34d429cc-f300-4253-88a8-2c1a3634c9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "name": "network-vif-plugged", "status": "completed", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:22:57.765585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c2965f5b-5ee5-481d-a60b-e915093a91a5 req-34d429cc-f300-4253-88a8-2c1a3634c9de service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:57.766578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c2965f5b-5ee5-481d-a60b-e915093a91a5 req-34d429cc-f300-4253-88a8-2c1a3634c9de service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:57.779761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c2965f5b-5ee5-481d-a60b-e915093a91a5 req-34d429cc-f300-4253-88a8-2c1a3634c9de service nova] Creating event network-vif-plugged:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:22:57.785301 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c2965f5b-5ee5-481d-a60b-e915093a91a5 req-34d429cc-f300-4253-88a8-2c1a3634c9de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036431 Apr 02 21:22:57.786223 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2844/5995] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:22:57.950321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:57.951130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:57.958845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:57.959438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:57.960667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:57.961337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:58.105571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:58.114088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e2ef2cc-f381-4ca0-9ac8-102a9d6f2e52 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1392 microversion: 2.1 time: 0.167947 Apr 02 21:22:58.114915 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3152/5996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:57 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:22:59.133409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:22:59.134120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:22:59.140619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:59.141244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:59.142841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:22:59.143577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:22:59.316009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:22:59.326169 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35441e5a-14b1-425d-b3cf-273ba3492bcc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1392 microversion: 2.1 time: 0.198307 Apr 02 21:22:59.326756 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2845/5997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:22:59 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:23:00.342985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:00.343731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:00.351503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:00.352025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:00.352830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:00.353271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:00.489783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:00.497386 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eef73ff9-9e6c-4b7e-99fd-ea96bc146931 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1564 microversion: 2.1 time: 0.158312 Apr 02 21:23:00.498161 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3153/5998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:00 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:00.514295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:00.514919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:00.524856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:00.525335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:00.526128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:00.526578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:00.667877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:00.675633 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ebebd3f-80bb-4046-9d03-c8b65dd53f37 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1564 microversion: 2.1 time: 0.165325 Apr 02 21:23:00.676384 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2846/5999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:00 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:02.559888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:02.561387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:02.562184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-251b6dec-0fbb-4cae-a5be-df953cb65301 req-a97c1832-5ec0-4ec6-90a9-37d22f8ce3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:02.570668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:02.571126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:02.572143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:02.572845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:02.576099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-251b6dec-0fbb-4cae-a5be-df953cb65301 req-a97c1832-5ec0-4ec6-90a9-37d22f8ce3cc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:02.576671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-251b6dec-0fbb-4cae-a5be-df953cb65301 req-a97c1832-5ec0-4ec6-90a9-37d22f8ce3cc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:02.589957 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-251b6dec-0fbb-4cae-a5be-df953cb65301 req-a97c1832-5ec0-4ec6-90a9-37d22f8ce3cc service nova] Creating event network-changed:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:23:02.595944 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-251b6dec-0fbb-4cae-a5be-df953cb65301 req-a97c1832-5ec0-4ec6-90a9-37d22f8ce3cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038240 Apr 02 21:23:02.597332 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2847/6000] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:23:02.857181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:02.875529 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28565f65-689e-4ece-8cf0-af2813d3fbc4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1564 microversion: 2.1 time: 0.318924 Apr 02 21:23:02.889829 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3154/6001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:02 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1564 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:06.161926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:06.162971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:06.169683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:06.170153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:06.170941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:06.171391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:06.228069 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-33c0b0a7-34d3-46de-a569-8b1de8cd7574 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974/action" status: 200 len: 24570 microversion: 2.1 time: 0.071693 Apr 02 21:23:06.229705 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2848/6002] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:23:06 2022] POST /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:23:17.224339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:17.225337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:17.232517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:17.232977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:17.233759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:17.234201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:17.286836 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7b66e6c-2d00-459b-9f41-e32669d2c497 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "POST /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974/action" status: 200 len: 32645 microversion: 2.1 time: 0.066561 Apr 02 21:23:17.287522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3155/6003] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:23:17 2022] POST /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974/action => generated 32645 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:23:18.391525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:18.392838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:18.401912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:18.402370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:18.403996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:18.404886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:18.432965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:23:18.542238 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-17aae094-6d21-413f-9446-89ff97385426 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 204 len: 0 microversion: 2.1 time: 0.155165 Apr 02 21:23:18.542840 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2849/6004] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:23:18 2022] DELETE /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 21:23:18.553356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:18.554192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:18.564118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:18.565078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:18.566057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:18.566833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:18.611772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-30f273f9-c3de-47cb-a399-dc7716d15b2d req-3db1eb81-33db-480e-b43d-65ab0702eab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a015dc-1320-42b4-ba9a-074efa9bb974", "tag": "2de2e38f-cea5-4a34-ab3d-af26d621abf5"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:18.621995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-30f273f9-c3de-47cb-a399-dc7716d15b2d req-3db1eb81-33db-480e-b43d-65ab0702eab5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:18.622540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-30f273f9-c3de-47cb-a399-dc7716d15b2d req-3db1eb81-33db-480e-b43d-65ab0702eab5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:18.635095 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-30f273f9-c3de-47cb-a399-dc7716d15b2d req-3db1eb81-33db-480e-b43d-65ab0702eab5 service nova] Creating event network-changed:2de2e38f-cea5-4a34-ab3d-af26d621abf5 for instance 18a015dc-1320-42b4-ba9a-074efa9bb974 on nch2-master-1 Apr 02 21:23:18.640804 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-30f273f9-c3de-47cb-a399-dc7716d15b2d req-3db1eb81-33db-480e-b43d-65ab0702eab5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250086 Apr 02 21:23:18.641678 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3156/6005] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:23:18.739672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:18.747794 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2eedcc3d-c3d4-42ab-bc1f-10e4a42bf4e4 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1671 microversion: 2.1 time: 0.199498 Apr 02 21:23:18.748385 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2850/6006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:18 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:19.767446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:19.768110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:19.776686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:19.776686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:19.776686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:19.776934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:19.919254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:19.927052 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f997f05f-2f9a-4ff5-aa01-6369a4b775e1 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1552 microversion: 2.1 time: 0.165180 Apr 02 21:23:19.927828 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3157/6007] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:19 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:20.662185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-47156009-4602-4a09-bc8c-4b549fd1ac79 req-267c76ba-27db-4f16-9222-6c3749a3cb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a015dc-1320-42b4-ba9a-074efa9bb974", "name": "network-vif-deleted", "tag": "2de2e38f-cea5-4a34-ab3d-af26d621abf5"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:20.672920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-47156009-4602-4a09-bc8c-4b549fd1ac79 req-267c76ba-27db-4f16-9222-6c3749a3cb43 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:20.674014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-47156009-4602-4a09-bc8c-4b549fd1ac79 req-267c76ba-27db-4f16-9222-6c3749a3cb43 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:20.696220 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-47156009-4602-4a09-bc8c-4b549fd1ac79 req-267c76ba-27db-4f16-9222-6c3749a3cb43 service nova] Creating event network-vif-deleted:2de2e38f-cea5-4a34-ab3d-af26d621abf5 for instance 18a015dc-1320-42b4-ba9a-074efa9bb974 on nch2-master-1 Apr 02 21:23:20.702143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-47156009-4602-4a09-bc8c-4b549fd1ac79 req-267c76ba-27db-4f16-9222-6c3749a3cb43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044705 Apr 02 21:23:20.702936 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2851/6008] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:23:20.945420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:20.946058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:20.953297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:20.953772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:20.955751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:20.957000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:20.995078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:20.995538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:20.995999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lazy-loading 'fault' on Instance uuid 18a015dc-1320-42b4-ba9a-074efa9bb974 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:23:21.038608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1ba274f1104befa1bd14c95525c3ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c63afebe86f46e8b16647d8eda2cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:21.047687 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce6ccc8b-4e0f-4008-a3d2-99a6e3a6b2ac tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 200 len: 1338 microversion: 2.1 time: 0.106514 Apr 02 21:23:21.048313 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3158/6009] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:20 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:22.066627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:22.067652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] [instance: 18a015dc-1320-42b4-ba9a-074efa9bb974] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:22.074829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:22.075289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:22.076067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:22.076675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:22.090425 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] HTTP exception thrown: Instance 18a015dc-1320-42b4-ba9a-074efa9bb974 could not be found. Apr 02 21:23:22.091035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Returning 404 to user: Instance 18a015dc-1320-42b4-ba9a-074efa9bb974 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:23:22.091923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0e2792f-8a58-4f61-8aa5-ece5f1376f6f tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974" status: 404 len: 111 microversion: 2.1 time: 0.030063 Apr 02 21:23:22.092443 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2852/6010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:22 2022] GET /compute/v2.1/servers/18a015dc-1320-42b4-ba9a-074efa9bb974 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:23:22.252646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92de6825-d222-4245-a5da-636158430843 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] Calling method '.version_select at 0x7f54d4a88c10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:22.272869 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92de6825-d222-4245-a5da-636158430843 tempest-TestNetworkBasicOps-1076811798 tempest-TestNetworkBasicOps-1076811798-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1047807567" status: 202 len: 0 microversion: 2.1 time: 0.024130 Apr 02 21:23:22.273448 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3159/6011] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Apr 2 21:23:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1047807567 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:23:26.200732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:26.202019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:26.209514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:26.210046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:26.211167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:26.211726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:26.263147 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8a279061-a5c8-4ba8-b3dc-3f3185afd12b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action" status: 200 len: 24546 microversion: 2.1 time: 0.066090 Apr 02 21:23:26.264173 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2853/6012] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:23:26 2022] POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action => generated 24546 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:23:37.193161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:37.193791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:37.212292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:37.213272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:37.214254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:37.214862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:37.528906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c34839c1-57e9-4e0e-87c1-4e0f33d723d3 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1834 microversion: 2.1 time: 0.339593 Apr 02 21:23:37.529522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3160/6013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:37 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1834 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:37.550554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:37.551830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:37.568236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:37.568924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:37.569902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:37.571913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:37.854480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:37.864229 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a93521d4-ca42-4d9a-a471-b7fb73b98cc5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1683 microversion: 2.1 time: 0.317800 Apr 02 21:23:37.865077 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2854/6014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:37 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1683 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:37.984362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:37.985977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:37.994288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:37.994744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:37.995541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:38.003041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:38.053841 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0a228af-f35a-4b96-aa93-ac9711641edf tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action" status: 200 len: 32614 microversion: 2.1 time: 0.073424 Apr 02 21:23:38.054597 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3161/6015] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:23:37 2022] POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action => generated 32614 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:23:38.218747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:38.221371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:38.234012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:38.234555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:38.236893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:38.237471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:38.268171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2f4699b061734ae6b846fbb238a45b29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce69b144575d48ca9fdf5f7a55a2f43a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:38.268880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] flavor_id is None. Assuming migration. {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 02 21:23:38.269543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:23:38.421373 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e48414e3-c9b7-48aa-aa44-c6a238cdad3b tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action" status: 202 len: 0 microversion: 2.1 time: 0.209623 Apr 02 21:23:38.422146 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2855/6016] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:23:38 2022] POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:23:38.432115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:38.432876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:38.444421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:38.444836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:38.454453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:38.454972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:38.799381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:38.809403 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1a80f88-f278-40e9-b804-05933f47f97b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1692 microversion: 2.1 time: 0.382002 Apr 02 21:23:38.814410 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3162/6017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:38 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1692 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:39.832445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:39.833229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:39.850245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:39.850815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:39.852795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:39.853980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:40.097454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:40.113203 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1279c933-7f6b-4378-b78c-f001f89d6cee tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1692 microversion: 2.1 time: 0.284866 Apr 02 21:23:40.113981 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2856/6018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:39 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1692 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:41.135647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:41.137520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:41.161208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:41.162230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:41.164352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:41.164957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:41.572729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:41.580765 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7eaaf073-f220-4ec4-81ec-b85ef0231166 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1692 microversion: 2.1 time: 0.452521 Apr 02 21:23:41.581343 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3163/6019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:41 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1692 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:42.598825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:42.600107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:42.607481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:42.607943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:42.608921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:42.609363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:42.755627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:42.765351 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f6cf6632-1858-42d3-a41a-3f4874ae500b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.171026 Apr 02 21:23:42.766825 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2857/6020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:42 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:43.783585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:43.784200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:43.791705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:43.792171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:43.792994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:43.793446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:43.972569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:43.981210 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1d9b3c05-2bdf-40ea-91b4-645b4c54393a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.201849 Apr 02 21:23:43.982111 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3164/6021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:43 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:45.004971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:45.008209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:45.018342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:45.019261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:45.020209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:45.020936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:45.213120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:45.221622 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a748a6b2-9f79-44fd-9642-8a2bef55dce8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.225988 Apr 02 21:23:45.222255 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2858/6022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:44 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:46.242591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:46.243228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:46.249466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:46.249922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:46.250719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:46.251162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:46.416925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:46.431086 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-297dfbde-5ddd-4e92-b311-baaa2d8eda09 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.193937 Apr 02 21:23:46.431712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3165/6023] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:46 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:47.449979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:47.450678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:47.457954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:47.458421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:47.459214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:47.459661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:47.635815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:47.645968 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-956444da-0bce-409c-847c-52f254760cd2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.200225 Apr 02 21:23:47.646805 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2859/6024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:47 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:48.665663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:48.666503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:48.675097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:48.675702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:48.676878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:48.677543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:48.869785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:48.878660 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-62e0bacc-e273-44e6-9852-b1d2ad865656 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.217207 Apr 02 21:23:48.879242 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3166/6025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:48 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:49.895631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:49.896698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:49.903700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:49.904481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:49.905530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:49.906933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:50.065913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:50.074230 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c6f166f1-458c-4bca-aee4-ecae2324f91b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.182397 Apr 02 21:23:50.074860 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2860/6026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:49 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:51.093602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:51.094230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:51.101447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:51.101915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:51.102712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:51.103163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:51.262286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:51.270594 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb71add0-86e9-4f8f-a91b-db2fba9ebb91 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.180958 Apr 02 21:23:51.271170 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3167/6027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:51 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:23:52.288289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:52.289012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:52.300178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:52.304009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:52.305176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:52.305858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:52.566499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:52.575462 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f1e3f5d1-0bba-4c5e-93d6-d870777dfb78 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.291181 Apr 02 21:23:52.576122 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2861/6028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:52 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:53.603978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:53.605568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:53.620615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:53.626348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:53.627646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:53.628822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:54.009731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:54.023040 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c859b66a-0ffb-4040-9256-7b8c64202472 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.422573 Apr 02 21:23:54.024267 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3168/6029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:53 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:55.053971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:55.054639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:55.062072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:55.062566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:55.063659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:55.064530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:55.243770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:55.251301 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-065f32a2-4191-4eb3-a937-1d2d183e34b8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.201419 Apr 02 21:23:55.251898 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2862/6030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:55 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:56.209687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-820fc234-06d2-425a-a3d4-6b947b283cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Action: 'create', calling method: .version_select at 0x7f54d45bd550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-395673106"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:56.224818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-820fc234-06d2-425a-a3d4-6b947b283cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Getting quotas for project 0ac7776ae2fb45cfa015c4056f0ab4a0. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:23:56.229967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-820fc234-06d2-425a-a3d4-6b947b283cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Getting quotas for user 4cb67e8ec9b44d6f89640b4ccabd1987 and project 0ac7776ae2fb45cfa015c4056f0ab4a0. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:23:56.268145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:56.268852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:56.275285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:56.275752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:56.276569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:56.277022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:56.420853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:56.429150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25a267fa-64bc-410e-8000-bd2a19c209a3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.164740 Apr 02 21:23:56.429663 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2863/6031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:56 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:56.431568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-820fc234-06d2-425a-a3d4-6b947b283cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Getting quotas for project 0ac7776ae2fb45cfa015c4056f0ab4a0. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:23:56.436741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-820fc234-06d2-425a-a3d4-6b947b283cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Getting quotas for user 4cb67e8ec9b44d6f89640b4ccabd1987 and project 0ac7776ae2fb45cfa015c4056f0ab4a0. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:23:56.452006 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-820fc234-06d2-425a-a3d4-6b947b283cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.246220 Apr 02 21:23:56.452657 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3169/6032] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:23:56 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:57.445294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:57.445922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:57.452938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:57.453409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:57.454197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:57.454650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:57.536876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-975041338", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3d159ee6-7514-4ca1-803d-49d79bc9076a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-395673106", "security_groups": [{"name": "tempest-secgroup-smoke-1786476372"}], "networks": [{"uuid": "9f1df9e6-794c-48f6-899a-ff2d0287d391"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:23:57.595829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:57.603597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d40c5fa7-b8a8-4bf9-9f67-f902317a56c3 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.162220 Apr 02 21:23:57.604287 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2864/6033] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:57 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:57.654690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] validate_networks() for [('9f1df9e6-794c-48f6-899a-ff2d0287d391', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:23:58.060743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:23:58.061390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:23:58.062045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:23:58.062574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:23:58.063114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:23:58.072578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:58.073103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:58.073934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:58.074394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:58.092376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Getting quotas for project 0ac7776ae2fb45cfa015c4056f0ab4a0. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:23:58.098782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Getting quotas for user 4cb67e8ec9b44d6f89640b4ccabd1987 and project 0ac7776ae2fb45cfa015c4056f0ab4a0. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:23:58.170052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:23:58.172184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d159ee6-7514-4ca1-803d-49d79bc9076a',volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:23:58.305226 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-50468890-cfbe-419d-84f9-ce4c1dfcebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773081 Apr 02 21:23:58.318916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3170/6034] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:23:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:23:58.319787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9332d12d-c66f-4230-8fc2-96091986a5b7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:58.320512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9332d12d-c66f-4230-8fc2-96091986a5b7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:58.385561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9332d12d-c66f-4230-8fc2-96091986a5b7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:58.392939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9332d12d-c66f-4230-8fc2-96091986a5b7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1097 microversion: 2.1 time: 0.078143 Apr 02 21:23:58.393531 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2865/6035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1097 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:58.621551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:58.622200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:58.629460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:58.629921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:58.630817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:58.631277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:58.783962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:58.793727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7c7a1f92-c1bd-4098-a8da-0ae82facc46e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1697 microversion: 2.1 time: 0.177110 Apr 02 21:23:58.794316 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3171/6036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:58 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:59.409513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:59.410933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:59.422889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:59.423585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:59.424592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:59.425271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:59.518672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:23:59.529152 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a109f85-04f4-4307-8191-661fdde1a365 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1203 microversion: 2.1 time: 0.123939 Apr 02 21:23:59.531179 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2866/6037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1203 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:23:59.812390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:23:59.813902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:23:59.822429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:59.823243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:23:59.824416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:23:59.825111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:00.164255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:00.172983 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0c217087-c0e2-439b-a81c-757175dcf6e1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1696 microversion: 2.1 time: 0.365331 Apr 02 21:24:00.182911 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3172/6038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:23:59 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1696 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:00.183120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f4daedf4-2445-4e9f-80e8-70d6b23773af req-cde7a3cc-1f5d-40a0-b15f-bfd628b005b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "name": "network-vif-unplugged", "status": "completed", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:00.198085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f4daedf4-2445-4e9f-80e8-70d6b23773af req-cde7a3cc-1f5d-40a0-b15f-bfd628b005b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:00.198553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f4daedf4-2445-4e9f-80e8-70d6b23773af req-cde7a3cc-1f5d-40a0-b15f-bfd628b005b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:00.229443 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f4daedf4-2445-4e9f-80e8-70d6b23773af req-cde7a3cc-1f5d-40a0-b15f-bfd628b005b9 service nova] Creating event network-vif-unplugged:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch1-master-1 Apr 02 21:24:00.243916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-f4daedf4-2445-4e9f-80e8-70d6b23773af req-cde7a3cc-1f5d-40a0-b15f-bfd628b005b9 service nova] Instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:24:00.270743 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f4daedf4-2445-4e9f-80e8-70d6b23773af req-cde7a3cc-1f5d-40a0-b15f-bfd628b005b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.286656 Apr 02 21:24:00.271673 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2867/6039] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:00.550991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:00.554845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:00.569820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:00.571329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:00.576309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:00.577004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:00.974618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:00.988652 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-89edcefd-a8f5-4d2c-af44-277f2be69146 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1281 microversion: 2.1 time: 0.445180 Apr 02 21:24:00.990915 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3173/6040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:00 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1281 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:01.193052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:01.194312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:01.203317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:01.204006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:01.205172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:01.205847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:01.480276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-125c3930-44a2-40b1-ac16-f5ff4845b873 req-a291b734-cfb6-41e4-a3be-0e6344022ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467961f4-9252-4447-a1be-0f97e122bef6", "tag": "e7588b29-b144-491b-a130-04690f4e18ec"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:01.489506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-125c3930-44a2-40b1-ac16-f5ff4845b873 req-a291b734-cfb6-41e4-a3be-0e6344022ee3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:01.490105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-125c3930-44a2-40b1-ac16-f5ff4845b873 req-a291b734-cfb6-41e4-a3be-0e6344022ee3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:01.504436 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-125c3930-44a2-40b1-ac16-f5ff4845b873 req-a291b734-cfb6-41e4-a3be-0e6344022ee3 service nova] Creating event network-changed:e7588b29-b144-491b-a130-04690f4e18ec for instance 467961f4-9252-4447-a1be-0f97e122bef6 on nch1-master-1 Apr 02 21:24:01.510779 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-125c3930-44a2-40b1-ac16-f5ff4845b873 req-a291b734-cfb6-41e4-a3be-0e6344022ee3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036012 Apr 02 21:24:01.512989 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3174/6041] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:01.528691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:01.547183 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86a891ee-35d0-4d38-afff-453de545421a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1696 microversion: 2.1 time: 0.359555 Apr 02 21:24:01.557270 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2868/6042] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:01 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1696 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:02.008407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:02.009147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:02.016234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:02.016762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:02.017554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:02.018136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:02.239579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:02.247230 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-68cfd641-160d-4206-88bc-8aab0475407a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1269 microversion: 2.1 time: 0.244089 Apr 02 21:24:02.248158 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3175/6043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:02 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1269 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:02.305275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e8a8cbe5-9715-4c52-9a2a-6a155e461533 req-08008ff9-7e6f-4e71-8ee1-f9a4ee0a49a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:02.316663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e8a8cbe5-9715-4c52-9a2a-6a155e461533 req-08008ff9-7e6f-4e71-8ee1-f9a4ee0a49a1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:02.317344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e8a8cbe5-9715-4c52-9a2a-6a155e461533 req-08008ff9-7e6f-4e71-8ee1-f9a4ee0a49a1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:02.331465 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e8a8cbe5-9715-4c52-9a2a-6a155e461533 req-08008ff9-7e6f-4e71-8ee1-f9a4ee0a49a1 service nova] Creating event network-changed:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch1-master-1 Apr 02 21:24:02.337426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-e8a8cbe5-9715-4c52-9a2a-6a155e461533 req-08008ff9-7e6f-4e71-8ee1-f9a4ee0a49a1 service nova] Instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:24:02.348961 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e8a8cbe5-9715-4c52-9a2a-6a155e461533 req-08008ff9-7e6f-4e71-8ee1-f9a4ee0a49a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047807 Apr 02 21:24:02.349859 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2869/6044] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:02.566344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:02.567139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:02.574540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:02.575264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:02.576234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:02.576877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:02.939095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:02.947093 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d2243164-2a77-4def-891f-cec186bb14f8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1694 microversion: 2.1 time: 0.386551 Apr 02 21:24:02.948092 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3176/6045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:02 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1694 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:03.266680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:03.267425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:03.273754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:03.274212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:03.275051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:03.275497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:03.414722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:03.422416 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93266348-7d99-48cf-9f99-583efecd9993 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1269 microversion: 2.1 time: 0.161211 Apr 02 21:24:03.423001 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2870/6046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:03 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:03.965200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:03.965823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:03.973300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:03.973767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:03.974675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:03.975129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:04.116773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:04.124729 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18ac73ec-00f0-42e0-ba05-29496cab688b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1694 microversion: 2.1 time: 0.163655 Apr 02 21:24:04.125394 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3177/6047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:03 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:04.439639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:04.440838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:04.447722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:04.448208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:04.449039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:04.449746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:04.588941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:04.596323 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f01a7262-41c5-43a2-9dcb-6d76c0f213a1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1269 microversion: 2.1 time: 0.161199 Apr 02 21:24:04.596950 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2871/6048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:04 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:05.141312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:05.141833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:05.148700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.149160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.149928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.150369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.286786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:05.295018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-982b665b-cfa3-4fc2-b8be-742eac1090a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1691 microversion: 2.1 time: 0.157661 Apr 02 21:24:05.295570 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3178/6049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:05 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:05.312035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:05.312629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:05.318671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.319242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.320215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.320840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.437302 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35be0849-ea7f-4ac4-9d31-195eae7341e7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action" status: 202 len: 0 microversion: 2.1 time: 0.128865 Apr 02 21:24:05.438189 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2872/6050] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:24:05 2022] POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:24:05.448859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:05.449734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:05.455908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.456371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.457594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.457814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.597178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:05.605404 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bba7f317-179a-4030-9b49-055c9ac46e2b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1690 microversion: 2.1 time: 0.162846 Apr 02 21:24:05.605993 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3179/6051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:05 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:05.613637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:05.615037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:05.622112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.622570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.623346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:05.623789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:05.801638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-740201375", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:05.851064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:24:06.179580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:06.187691 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e03b53e5-8758-4d3b-b25a-92f2307111d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1269 microversion: 2.1 time: 0.578249 Apr 02 21:24:06.188304 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2873/6052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:05 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1269 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:06.444127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:24:06.444127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:24:06.444127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:24:06.444127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:24:06.444127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:24:06.456960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:06.457390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:06.458787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:06.459985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:06.483668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Getting quotas for project 7647e168474a45789031750d07df5429. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:24:06.489420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Getting quotas for user 4ad346194bea43d482ffa0722ca892f3 and project 7647e168474a45789031750d07df5429. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:24:06.503898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:24:06.506267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:24:06.553047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-952f21cd-d88d-40b7-b108-355f05141922 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755203 Apr 02 21:24:06.553704 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3180/6053] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:24:06.563995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-999fe9f4-e50f-42f5-ac9e-63a2835eb26d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:06.565138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-999fe9f4-e50f-42f5-ac9e-63a2835eb26d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:06.619825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-999fe9f4-e50f-42f5-ac9e-63a2835eb26d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:06.622950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:06.623585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:06.628795 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-999fe9f4-e50f-42f5-ac9e-63a2835eb26d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1214 microversion: 2.1 time: 0.068871 Apr 02 21:24:06.632683 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2874/6054] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:06 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:06.634006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:06.634468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:06.635420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:06.635884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:06.796275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:06.805179 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d52103d-bfb1-43c7-86ad-dda6489fdaf2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1690 microversion: 2.1 time: 0.186130 Apr 02 21:24:06.805797 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3181/6055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:06 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:07.205519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:07.206122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:07.213022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:07.213484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:07.214273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:07.214894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:07.363259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:07.371267 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8a4609a-d97c-4d36-a352-32fd8eeeacc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1269 microversion: 2.1 time: 0.170483 Apr 02 21:24:07.371851 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2875/6056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:07 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:07.646476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:07.647097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:07.654970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:07.655949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:07.656957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:07.657416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:07.742065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:07.749649 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b47ebf8-57a0-4098-8315-abc8e80ea1ae tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1284 microversion: 2.1 time: 0.107046 Apr 02 21:24:07.750233 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3182/6057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:07 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:07.823050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:07.823673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:07.831477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:07.831948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:07.833034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:07.833494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:07.976125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:07.983664 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65ad3682-d3dc-4edd-8f6b-4737d786102b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1690 microversion: 2.1 time: 0.164577 Apr 02 21:24:07.984247 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2876/6058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:07 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:08.389441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:08.391096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:08.398164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:08.398164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:08.398880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:08.399324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:08.685768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-64eb6af3-7e38-410b-8c92-c67ae5c29bfe req-90c43250-a27f-4ee8-84d0-5feb3ad5114e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467961f4-9252-4447-a1be-0f97e122bef6", "name": "network-vif-plugged", "status": "completed", "tag": "e7588b29-b144-491b-a130-04690f4e18ec"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:08.696025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-64eb6af3-7e38-410b-8c92-c67ae5c29bfe req-90c43250-a27f-4ee8-84d0-5feb3ad5114e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:08.696737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-64eb6af3-7e38-410b-8c92-c67ae5c29bfe req-90c43250-a27f-4ee8-84d0-5feb3ad5114e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:08.714829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-64eb6af3-7e38-410b-8c92-c67ae5c29bfe req-90c43250-a27f-4ee8-84d0-5feb3ad5114e service nova] Creating event network-vif-plugged:e7588b29-b144-491b-a130-04690f4e18ec for instance 467961f4-9252-4447-a1be-0f97e122bef6 on nch1-master-1 Apr 02 21:24:08.720818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-64eb6af3-7e38-410b-8c92-c67ae5c29bfe req-90c43250-a27f-4ee8-84d0-5feb3ad5114e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226661 Apr 02 21:24:08.721723 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2877/6059] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:08.773895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:08.774615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:08.783342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:08.785036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:08.786228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:08.787551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:08.848076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:08.856338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98b15d4f-7ea0-456c-9853-c4d078bc2ba7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1269 microversion: 2.1 time: 0.471253 Apr 02 21:24:08.857657 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3183/6060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:08 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1269 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:09.006230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:09.007226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:09.014516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:09.015945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:09.018545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:09.019344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:09.099978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:09.116640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d75a6c6-2c2a-4cb2-9316-59fc174f33b4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.348511 Apr 02 21:24:09.123753 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2878/6061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:08 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:09.243859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:09.253112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-007ce8ba-fd0a-418a-b2e4-0f39ef429dfe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1690 microversion: 2.1 time: 0.254884 Apr 02 21:24:09.257794 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3184/6062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:08 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:09.317058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-00440004-5a10-4689-8852-38e0b391a366 req-e18f02ba-73a6-43fd-ad22-c38741ab7172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40bc6b44-286e-4ab1-8518-4ce3e294d12d", "tag": "5bab4ba8-9e14-4e78-956c-244ee1ddcc81"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:09.330615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-00440004-5a10-4689-8852-38e0b391a366 req-e18f02ba-73a6-43fd-ad22-c38741ab7172 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:09.331189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-00440004-5a10-4689-8852-38e0b391a366 req-e18f02ba-73a6-43fd-ad22-c38741ab7172 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:09.346863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-00440004-5a10-4689-8852-38e0b391a366 req-e18f02ba-73a6-43fd-ad22-c38741ab7172 service nova] Creating event network-changed:5bab4ba8-9e14-4e78-956c-244ee1ddcc81 for instance 40bc6b44-286e-4ab1-8518-4ce3e294d12d on nch2-master-1 Apr 02 21:24:09.352863 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-00440004-5a10-4689-8852-38e0b391a366 req-e18f02ba-73a6-43fd-ad22-c38741ab7172 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039490 Apr 02 21:24:09.354257 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2879/6063] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:09.873849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:09.875547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:09.883102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:09.883661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:09.885192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:09.886063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:09.908239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-86708564-6ee5-48b1-84fe-5cf6726181f7 req-77f24431-2c80-441b-b29c-b0bb846e532f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:09.938181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-86708564-6ee5-48b1-84fe-5cf6726181f7 req-77f24431-2c80-441b-b29c-b0bb846e532f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:09.941300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-86708564-6ee5-48b1-84fe-5cf6726181f7 req-77f24431-2c80-441b-b29c-b0bb846e532f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:09.958738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-86708564-6ee5-48b1-84fe-5cf6726181f7 req-77f24431-2c80-441b-b29c-b0bb846e532f service nova] Creating event network-changed:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:24:09.967424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-86708564-6ee5-48b1-84fe-5cf6726181f7 req-77f24431-2c80-441b-b29c-b0bb846e532f service nova] Instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:24:09.992640 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-86708564-6ee5-48b1-84fe-5cf6726181f7 req-77f24431-2c80-441b-b29c-b0bb846e532f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091094 Apr 02 21:24:09.994732 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2880/6064] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:10.140328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:10.142038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:10.152133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:10.152954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:10.160863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:10.164719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:10.165340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:10.170378 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e36e11c6-9cde-4de8-9731-b62c35ed9caf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1213 microversion: 2.1 time: 0.300864 Apr 02 21:24:10.172570 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3185/6065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:09 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1213 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:10.271084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:10.271795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:10.277959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:10.278488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:10.279334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:10.279844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:10.556141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:10.564424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64a28d6d-26d5-4894-b5b0-1fce7c4f56b7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.432830 Apr 02 21:24:10.565592 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2881/6066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:10 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:10.661130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:10.672336 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f89b8d9-1dc6-4114-b15e-194e19e381cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1690 microversion: 2.1 time: 0.405108 Apr 02 21:24:10.673009 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3186/6067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:10 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1690 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:11.191391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:11.192113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:11.199934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:11.200663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:11.201730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:11.202199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:11.292765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:11.300801 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86d52ae6-dd4e-49f7-b89c-9d8d6179f3b6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.114801 Apr 02 21:24:11.301379 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2882/6068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:11 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:11.581986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:11.582611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:11.589614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:11.590078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:11.590855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:11.591303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:11.690172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:11.690802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:11.697116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:11.697660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:11.698524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:11.699048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:11.725276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:11.732736 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11cde0d5-6862-4250-9d7d-5f462b00e757 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.154615 Apr 02 21:24:11.733327 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3187/6069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:11 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:11.839435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:11.847597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a1059ae-ee55-42e7-996a-2435bae68382 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1690 microversion: 2.1 time: 0.161333 Apr 02 21:24:11.848176 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2883/6070] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:11 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:12.020096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f0855f26-3810-4234-862c-93cf5967d4ac req-1ee166b5-e97d-486e-abeb-58c337ecefcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467961f4-9252-4447-a1be-0f97e122bef6", "name": "network-vif-deleted", "tag": "e7588b29-b144-491b-a130-04690f4e18ec"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:12.028685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f0855f26-3810-4234-862c-93cf5967d4ac req-1ee166b5-e97d-486e-abeb-58c337ecefcd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.029137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f0855f26-3810-4234-862c-93cf5967d4ac req-1ee166b5-e97d-486e-abeb-58c337ecefcd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.041374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.compute.server_external_events [req-f0855f26-3810-4234-862c-93cf5967d4ac req-1ee166b5-e97d-486e-abeb-58c337ecefcd service nova] Unable to find a host for instance 467961f4-9252-4447-a1be-0f97e122bef6. Dropping event network-vif-deleted {{(pid=136518) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 02 21:24:12.042237 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f0855f26-3810-4234-862c-93cf5967d4ac req-1ee166b5-e97d-486e-abeb-58c337ecefcd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026196 Apr 02 21:24:12.042801 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3188/6071] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 02 21:24:12.317589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:12.318222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:12.325266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.325740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.326556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.327608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.388198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:12.396295 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fdf84ae3-edc6-4f5a-b7d9-21de9d591db1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082830 Apr 02 21:24:12.396913 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2884/6072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:12 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:12.750254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:12.750898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:12.757670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.758475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.759355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.759862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.866088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:12.867266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:12.875404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.875872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.876813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:12.877259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:12.910697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:12.918591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf2f5a1a-aed6-4db4-b0e2-1745e09b234b tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.172977 Apr 02 21:24:12.919168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3189/6073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:12 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:13.015468 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:13.022978 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a23fad6-d51a-4bd2-9c5b-19b17585c535 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1683 microversion: 2.1 time: 0.161468 Apr 02 21:24:13.023557 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2885/6074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:12 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:13.413538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:13.414153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:13.420917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:13.421367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:13.422133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:13.422574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:13.487438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:13.495001 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1e4876c1-f133-404e-ace9-ab59c4b3f4ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085417 Apr 02 21:24:13.495569 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3190/6075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:13 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:13.935384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:13.936004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:13.942825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:13.943288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:13.944056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:13.944528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:14.083474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:14.091082 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-973387f1-60ad-4ba7-8353-6f1c824100ab tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.159600 Apr 02 21:24:14.091852 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2886/6076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:13 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:14.512230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:14.512834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:14.520341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:14.520858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:14.521642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:14.522091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:14.582729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:14.590352 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c5af2a5-143a-40c8-a1c9-d13bc4559f05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082205 Apr 02 21:24:14.590932 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3191/6077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:14 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:15.112127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:15.112701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:15.119739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:15.120205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:15.121010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:15.121465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:15.252684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:15.260017 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-853d2a9a-cd46-49ce-8e21-b06f5af1718e tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.152611 Apr 02 21:24:15.260617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2887/6078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:15 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:15.607509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:15.608119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:15.614874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:15.615327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:15.616088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:15.616552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:15.679540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:15.687560 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ad5f3c9-51f1-430d-a517-d8b6f1259e31 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083944 Apr 02 21:24:15.688126 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3192/6079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:15 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:16.173795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e14ec0d1-779c-46ff-af41-35fcf0d73efb req-7313660d-08d6-45d2-af2c-76b941a29a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "name": "network-vif-plugged", "status": "completed", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:16.183409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e14ec0d1-779c-46ff-af41-35fcf0d73efb req-7313660d-08d6-45d2-af2c-76b941a29a06 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:16.183876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e14ec0d1-779c-46ff-af41-35fcf0d73efb req-7313660d-08d6-45d2-af2c-76b941a29a06 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:16.194994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e14ec0d1-779c-46ff-af41-35fcf0d73efb req-7313660d-08d6-45d2-af2c-76b941a29a06 service nova] Creating event network-vif-plugged:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:24:16.200114 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e14ec0d1-779c-46ff-af41-35fcf0d73efb req-7313660d-08d6-45d2-af2c-76b941a29a06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 Apr 02 21:24:16.200820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2888/6080] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:16.277574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:16.278241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:16.285274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:16.285746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:16.286536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:16.286995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:16.421682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:16.429713 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-04fddb2a-16fd-41f7-bd5c-3cab693784d4 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.156136 Apr 02 21:24:16.430312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3193/6081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:16 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:16.704720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:16.705436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:16.711666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:16.712130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:16.712945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:16.713397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:16.773856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:16.782167 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9fd2ded8-d4c1-4754-a519-32e003b703a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081780 Apr 02 21:24:16.782756 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2889/6082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:16 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:17.447367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:17.448010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:17.454861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:17.455315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:17.456085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:17.456548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:17.588249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:17.596233 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df005511-a993-4ae3-9e1d-a23b6b7fa5d8 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.152870 Apr 02 21:24:17.596844 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3194/6083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:17 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:17.799321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:17.799871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:17.806860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:17.807324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:17.808103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:17.808594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:17.869967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:17.877921 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b1e3ef66-f4fd-4561-937a-782e1dc3a266 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082623 Apr 02 21:24:17.878499 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2890/6084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:17 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:18.218832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-96ec0c8b-512b-4790-96d7-f8e5963dc558 req-3e35203d-2e54-46ce-b7f9-fda143531b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bc6b44-286e-4ab1-8518-4ce3e294d12d", "name": "network-vif-plugged", "status": "completed", "tag": "5bab4ba8-9e14-4e78-956c-244ee1ddcc81"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:18.226815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96ec0c8b-512b-4790-96d7-f8e5963dc558 req-3e35203d-2e54-46ce-b7f9-fda143531b18 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:18.227261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96ec0c8b-512b-4790-96d7-f8e5963dc558 req-3e35203d-2e54-46ce-b7f9-fda143531b18 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:18.238365 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-96ec0c8b-512b-4790-96d7-f8e5963dc558 req-3e35203d-2e54-46ce-b7f9-fda143531b18 service nova] Creating event network-vif-plugged:5bab4ba8-9e14-4e78-956c-244ee1ddcc81 for instance 40bc6b44-286e-4ab1-8518-4ce3e294d12d on nch2-master-1 Apr 02 21:24:18.243533 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-96ec0c8b-512b-4790-96d7-f8e5963dc558 req-3e35203d-2e54-46ce-b7f9-fda143531b18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028892 Apr 02 21:24:18.244225 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3195/6085] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:18.613256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:18.613806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:18.619852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:18.620315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:18.621125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:18.621575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:18.752148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:18.759618 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2083f21f-ad51-4548-a66b-cc6a78700399 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1314 microversion: 2.1 time: 0.150367 Apr 02 21:24:18.760195 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2891/6086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:18 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:18.895957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:18.896686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:18.903158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:18.903642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:18.904416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:18.905404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:18.969112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:18.976487 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79602d61-0622-4b38-97d2-c0b8a327d7a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085747 Apr 02 21:24:18.977051 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3196/6087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:18 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:19.777277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:19.777818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:19.785532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:19.786075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:19.786897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:19.787342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:19.921917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:19.929300 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12b8f84a-c048-496a-8cb5-14bbd48fd1f1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1463 microversion: 2.1 time: 0.156069 Apr 02 21:24:19.929888 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2892/6088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:19 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:19.966955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:19.968050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:19.974825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:19.975278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:19.976078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:19.976556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:19.994709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:19.995347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:20.001377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:20.001860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:20.002634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:20.003086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:20.004419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:24:20.066465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:20.074597 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79f49ddc-0729-4b7a-84f8-71c1c9e62d9e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084589 Apr 02 21:24:20.075412 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2893/6089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:19 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:20.079502 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b208a3d-5af7-443c-9e12-99d351bf36c7 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "DELETE /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 204 len: 0 microversion: 2.1 time: 0.116080 Apr 02 21:24:20.080109 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3197/6090] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:24:19 2022] DELETE /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:24:20.090545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:20.091407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:20.099147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:20.099614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:20.100401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:20.100878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:20.229889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:20.237300 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19579c99-50a3-47f3-bf64-69d6f34d5613 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1469 microversion: 2.1 time: 0.152584 Apr 02 21:24:20.237888 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2894/6091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:20 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:21.091916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:21.092588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:21.099491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:21.099954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:21.100756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:21.101208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:21.161513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:21.169273 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebffa250-e734-4349-b221-f8c5715fdf53 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081892 Apr 02 21:24:21.169851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3198/6092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:21 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:21.254609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:21.255239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:21.262045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:21.262508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:21.263293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:21.263745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:21.402719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:21.410894 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-51cc5ac1-f210-44e5-b362-5759f2bb4747 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1469 microversion: 2.1 time: 0.160190 Apr 02 21:24:21.411479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2895/6093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:21 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:21.986388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a39a0f0f-bdcc-4403-98c2-71acac0cde9e req-9b853f13-6446-4b0e-b0d5-487af8fba158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bc6b44-286e-4ab1-8518-4ce3e294d12d", "name": "network-vif-deleted", "tag": "5bab4ba8-9e14-4e78-956c-244ee1ddcc81"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:21.996928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a39a0f0f-bdcc-4403-98c2-71acac0cde9e req-9b853f13-6446-4b0e-b0d5-487af8fba158 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:21.997412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a39a0f0f-bdcc-4403-98c2-71acac0cde9e req-9b853f13-6446-4b0e-b0d5-487af8fba158 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:22.010386 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a39a0f0f-bdcc-4403-98c2-71acac0cde9e req-9b853f13-6446-4b0e-b0d5-487af8fba158 service nova] Creating event network-vif-deleted:5bab4ba8-9e14-4e78-956c-244ee1ddcc81 for instance 40bc6b44-286e-4ab1-8518-4ce3e294d12d on nch2-master-1 Apr 02 21:24:22.015967 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a39a0f0f-bdcc-4403-98c2-71acac0cde9e req-9b853f13-6446-4b0e-b0d5-487af8fba158 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034090 Apr 02 21:24:22.016628 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3199/6094] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:22.186518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:22.186951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:22.193139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:22.193596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:22.194363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:22.194813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:22.256724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:22.265127 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-490c51bb-f833-4857-8d07-46a7cf8d7a28 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083313 Apr 02 21:24:22.265708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2896/6095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:22 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:22.429038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:22.429745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:22.435935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:22.436399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:22.437266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:22.437665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:22.470963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:22.471433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:22.471906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lazy-loading 'fault' on Instance uuid 40bc6b44-286e-4ab1-8518-4ce3e294d12d {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:24:22.514986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad346194bea43d482ffa0722ca892f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e168474a45789031750d07df5429', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:22.521782 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb1582c1-352f-4a08-8a16-adc1b6e605c1 tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 200 len: 1304 microversion: 2.1 time: 0.097905 Apr 02 21:24:22.522368 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3200/6096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:22 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:23.281852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:23.282512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:23.289674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:23.290141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:23.290926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:23.291381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:23.350738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:23.358305 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eae81e33-3e52-4183-98ad-de782fc5a6dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080435 Apr 02 21:24:23.358888 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2897/6097] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:23 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:23.539425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:23.540046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] [instance: 40bc6b44-286e-4ab1-8518-4ce3e294d12d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:23.547372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:23.547829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:23.548627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:23.549071 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:23.562753 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] HTTP exception thrown: Instance 40bc6b44-286e-4ab1-8518-4ce3e294d12d could not be found. Apr 02 21:24:23.563385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] Returning 404 to user: Instance 40bc6b44-286e-4ab1-8518-4ce3e294d12d could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:24:23.564221 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c8389c20-0906-462d-a66f-ac7f0ab7fb2d tempest-VolumesNegativeTest-699432410 tempest-VolumesNegativeTest-699432410-project] 10.222.0.18 "GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d" status: 404 len: 111 microversion: 2.1 time: 0.029016 Apr 02 21:24:23.564769 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3201/6098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:23 2022] GET /compute/v2.1/servers/40bc6b44-286e-4ab1-8518-4ce3e294d12d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:24:24.374897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:24.375515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:24.382677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:24.382928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:24.383702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:24.384145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:24.452592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:24.460511 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84c54cb3-9aa0-4d90-bce8-739c3c5d78bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.089112 Apr 02 21:24:24.461106 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2898/6099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:24 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:25.477422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:25.478045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:25.485672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:25.486135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:25.486942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:25.487391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:25.547570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:25.555217 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43b13a23-971a-4c44-9102-222fe01243db tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081751 Apr 02 21:24:25.555788 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3202/6100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:25 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:26.571254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:26.571815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:26.578675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:26.579131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:26.579904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:26.580348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:26.638342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:26.645753 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a8da541-85b5-45fd-90f6-d1dff89e1577 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078546 Apr 02 21:24:26.646330 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2899/6101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:26 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:24:27.662388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:27.663017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:27.670934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:27.671397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:27.672208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:27.672765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:27.736425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:27.745122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-31a60321-508e-4855-b575-95b537076f97 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086482 Apr 02 21:24:27.745732 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3203/6102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:27 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:28.765225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:28.765857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:28.773833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:28.774290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:28.775070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:28.775512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:28.837770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:28.845249 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f9c2e8f-24fc-41fe-800c-5809886ed77f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086412 Apr 02 21:24:28.845818 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2900/6103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:28 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:29.861809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:29.862419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:29.869190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:29.869643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:29.870415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:29.870854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:29.933631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:29.941579 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b4c1cda-e169-4cb4-be3d-591ca481a151 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083689 Apr 02 21:24:29.942153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3204/6104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:29 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:30.958382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:30.959000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:30.965615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:30.966068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:30.966836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:30.967276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:31.025975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:31.033925 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ec237ca4-e28d-482b-b355-fcb3320a1531 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079485 Apr 02 21:24:31.034497 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2901/6105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:30 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:32.050232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:32.050846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:32.057707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:32.058162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:32.058935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:32.059380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:32.117309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:32.125111 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33d05d78-08b4-4afc-b1a6-e597f843a5f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078957 Apr 02 21:24:32.125679 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3205/6106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:32 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:33.142094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:33.142722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:33.149632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:33.150090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:33.150897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:33.151344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:33.213634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:33.221642 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-948b1e5e-c382-4713-917c-d173f84c809e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083499 Apr 02 21:24:33.222226 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2902/6107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:33 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:34.238905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:34.239548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:34.246381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:34.246836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:34.247628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:34.248069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:34.309387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:34.317367 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8be67c28-5719-4195-a8e7-d63d0c329005 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082406 Apr 02 21:24:34.317932 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3206/6108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:34 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:35.334742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:35.335358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:35.342116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:35.343080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:35.343865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:35.344292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:35.401595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:35.409826 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9fcbcf4-4ad5-42c6-ab0c-746dacfe21c8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079033 Apr 02 21:24:35.410400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2903/6109] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:35 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:36.426765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:36.427402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:36.434219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:36.434682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:36.435446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:36.435890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:36.498954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:36.506380 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4bf7b5d4-2c52-4da1-9a77-5a05c2084602 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083542 Apr 02 21:24:36.506955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3207/6110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:36 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:37.523810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:37.524434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:37.531800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:37.532264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:37.533071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:37.533523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:37.591605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:37.599716 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-929ae5fe-35f4-494e-a673-a343f2b6c9a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079829 Apr 02 21:24:37.600289 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2904/6111] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:37 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:38.616927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:38.617541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:38.625083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:38.625539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:38.626303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:38.626745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:38.685988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:38.693550 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92583335-b4ef-49bf-91a6-535916db4be2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080500 Apr 02 21:24:38.694125 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3208/6112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:38 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:39.710866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:39.711409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:39.718877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:39.719342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:39.720200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:39.720677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:39.779205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:39.787192 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0107a29-9cff-4ec9-b2b4-9140c7be48a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080362 Apr 02 21:24:39.787771 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2905/6113] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:39 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:40.805033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:40.805542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:40.812389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:40.812894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:40.813720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:40.814136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:40.877316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:40.884782 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-41032b55-3ac0-437f-9cff-205a10a502c1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083871 Apr 02 21:24:40.885359 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3209/6114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:40 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:41.225579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:41.226637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:41.234299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:41.234754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:41.235531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:41.235974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:41.291919 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1955cd0d-5067-498b-a32c-2dc4b3f975eb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action" status: 200 len: 63223 microversion: 2.1 time: 0.069980 Apr 02 21:24:41.292611 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2906/6115] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:24:41 2022] POST /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820/action => generated 63223 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:24:41.901304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:41.901916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:41.909250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:41.909701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:41.910465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:41.910909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:41.971975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:41.979856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b75e8561-8346-4a5f-a478-02920b95c31d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082383 Apr 02 21:24:41.980448 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3210/6116] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:41 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:42.999817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:43.000784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:43.008344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:43.008838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:43.009618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:43.010068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:43.072883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:43.081328 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-06a5f7b1-27db-4094-a3aa-0ac300db6114 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085916 Apr 02 21:24:43.081903 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2907/6117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:42 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:44.098025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:44.098647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:44.105135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:44.105592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:44.106367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:44.106813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:44.168607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:44.176591 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d88d454-7b30-4f7b-bd2e-4e3abff4282d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083229 Apr 02 21:24:44.177168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3211/6118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:44 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:45.193403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:45.194147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:45.200971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:45.201428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:45.202194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:45.203153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:45.260657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:45.268487 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed93ed04-fad0-4126-9f39-901e87073968 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079026 Apr 02 21:24:45.269232 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2908/6119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:45 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:46.285966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:46.286592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:46.293743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:46.294208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:46.294989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:46.295437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:46.365659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:46.373262 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf29a0b4-e678-4d02-ad13-60eccb63e688 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.091267 Apr 02 21:24:46.373839 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3212/6120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:46 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:47.390471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:47.391086 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:47.397995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:47.398459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:47.399228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:47.399675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:47.462815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:47.470904 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e694844b-dc71-44e3-b1b9-709c9555be2a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084391 Apr 02 21:24:47.471478 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2909/6121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:47 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:47.604430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:47.605073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:47.611795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:47.612257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:47.613061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:47.613526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:47.742623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed79dbb8-1d60-4a30-97f5-a7e67d6503f2 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1834 microversion: 2.1 time: 0.141886 Apr 02 21:24:47.743198 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3213/6122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:47 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1834 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:48.487178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:48.487831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:48.494181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:48.494633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:48.495405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:48.495844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:48.556841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:48.564924 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-22abb104-1e83-48a5-89fd-89b489e26f8d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081532 Apr 02 21:24:48.565529 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2910/6123] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:48 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:49.056287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:49.057070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:49.058239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-33e2ce42-991a-4f39-9d18-d7a932604134 req-c6292cc3-28b1-4642-aaba-efb654353d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:49.065179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.065915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.067007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.067598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-33e2ce42-991a-4f39-9d18-d7a932604134 req-c6292cc3-28b1-4642-aaba-efb654353d1b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.067928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.068061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-33e2ce42-991a-4f39-9d18-d7a932604134 req-c6292cc3-28b1-4642-aaba-efb654353d1b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.079442 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-33e2ce42-991a-4f39-9d18-d7a932604134 req-c6292cc3-28b1-4642-aaba-efb654353d1b service nova] Creating event network-changed:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:24:49.084580 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-33e2ce42-991a-4f39-9d18-d7a932604134 req-c6292cc3-28b1-4642-aaba-efb654353d1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030010 Apr 02 21:24:49.085193 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2911/6124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:24:49.097064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:24:49.178623 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dcf051b9-99f7-4545-b820-44b038c5bede tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 204 len: 0 microversion: 2.1 time: 0.125712 Apr 02 21:24:49.179687 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3214/6125] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:24:49 2022] DELETE /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:24:49.189653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:49.190402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:49.197000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.197479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.198602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.199056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.440822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:49.447425 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecd4a358-006c-4900-b807-6bad9304ca17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1689 microversion: 2.1 time: 0.263368 Apr 02 21:24:49.448147 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2912/6126] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:49 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:49.582803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:49.583582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:49.589694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.590247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.591108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:49.591619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:49.657992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:49.666469 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69b89b22-3eb9-42c4-9614-294c3a71c271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087938 Apr 02 21:24:49.676496 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3215/6127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:49 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:50.465161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:50.465774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:50.473252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:50.473709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:50.474477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:50.474917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:50.614168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:50.621518 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b944fb82-8378-4258-98ac-10805562a4dc tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 200 len: 1570 microversion: 2.1 time: 0.160294 Apr 02 21:24:50.622088 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2913/6128] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:50 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:50.683967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:50.684621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:50.691476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:50.691936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:50.692752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:50.693204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:50.753945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:50.761404 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b189f0b-b71b-473f-9912-ad5a528661f9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081363 Apr 02 21:24:50.761983 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3216/6129] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:50 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:51.150384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-9907b138-6777-4820-abef-eabb906186a4 req-117769da-837f-4d01-bb00-1c7b11f5b3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a76f4f0-1c69-4084-a0f3-c230e1796820", "name": "network-vif-deleted", "tag": "97fe7cd3-a132-4858-af0b-6a5df8c2b2c8"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:51.158835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9907b138-6777-4820-abef-eabb906186a4 req-117769da-837f-4d01-bb00-1c7b11f5b3a0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:51.159295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9907b138-6777-4820-abef-eabb906186a4 req-117769da-837f-4d01-bb00-1c7b11f5b3a0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:51.170829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-9907b138-6777-4820-abef-eabb906186a4 req-117769da-837f-4d01-bb00-1c7b11f5b3a0 service nova] Creating event network-vif-deleted:97fe7cd3-a132-4858-af0b-6a5df8c2b2c8 for instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 on nch2-master-1 Apr 02 21:24:51.176337 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-9907b138-6777-4820-abef-eabb906186a4 req-117769da-837f-4d01-bb00-1c7b11f5b3a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Apr 02 21:24:51.177019 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2914/6130] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:24:51.638160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:51.639123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 2a76f4f0-1c69-4084-a0f3-c230e1796820] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:51.646945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:51.647410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:51.648204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:51.648696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:51.662524 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] HTTP exception thrown: Instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 could not be found. Apr 02 21:24:51.663388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Returning 404 to user: Instance 2a76f4f0-1c69-4084-a0f3-c230e1796820 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:24:51.664259 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6649b674-ab14-4525-8c37-f382acb47c00 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820" status: 404 len: 111 microversion: 2.1 time: 0.030195 Apr 02 21:24:51.664847 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3217/6131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:51 2022] GET /compute/v2.1/servers/2a76f4f0-1c69-4084-a0f3-c230e1796820 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:24:51.781547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:51.782173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:51.789716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:51.790178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:51.790980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:51.791422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:51.861303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:51.868765 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac0fce89-b7c9-4a3b-80d2-ed84f538d629 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.092365 Apr 02 21:24:51.869348 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2915/6132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:51 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:52.885560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:52.886193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:52.893702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:52.894186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:52.894957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:52.895417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:52.958803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:52.966557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8120d9b8-5c66-4b5b-8322-99bc9d22254e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084879 Apr 02 21:24:52.967169 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3218/6133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:52 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:53.985575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:53.986969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:53.994210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:53.994713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:53.995557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:53.996003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:54.087219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:54.095865 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20226190-3a8a-4649-bc61-f2c4f6a503e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.115972 Apr 02 21:24:54.104736 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2916/6134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:53 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:54.737405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4571b1db-fd88-46bb-8780-f077a94f039d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '.version_select at 0x7f54d48f30d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:54.756762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4571b1db-fd88-46bb-8780-f077a94f039d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1347032415" status: 202 len: 0 microversion: 2.1 time: 0.023891 Apr 02 21:24:54.757456 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3219/6135] 10.222.0.18 () {58 vars in 1283 bytes} [Sat Apr 2 21:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1347032415 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:24:54.793704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92a23233-6575-4b29-a94c-4fa00c85b2cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: .version_select at 0x7f54d50ba820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1296202741"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:24:54.808125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-92a23233-6575-4b29-a94c-4fa00c85b2cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:24:54.813864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-92a23233-6575-4b29-a94c-4fa00c85b2cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:24:55.001235 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-92a23233-6575-4b29-a94c-4fa00c85b2cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:24:55.006821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-92a23233-6575-4b29-a94c-4fa00c85b2cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:24:55.021616 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-92a23233-6575-4b29-a94c-4fa00c85b2cb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.231865 Apr 02 21:24:55.022227 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2917/6136] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:24:54 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:55.113447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:55.114069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:55.121052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:55.121516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:55.122336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:55.122827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:55.200660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:55.208841 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a4ab3052-5756-417e-86f9-3c5f059c5d8b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.099338 Apr 02 21:24:55.209347 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3220/6137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:55 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:56.227145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:56.227767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:56.235010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:56.235467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:56.236298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:56.236793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:56.299338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:56.307088 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-774da21a-d769-4185-8ba6-5a1737c46657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085431 Apr 02 21:24:56.307665 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2918/6138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:56 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:57.323838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:57.324494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:57.332245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:57.332745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:57.333535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:57.333982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:57.429657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:57.437080 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff267ba4-aa99-4fc4-8d00-88bf6e560b55 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.117189 Apr 02 21:24:57.437658 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3221/6139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:57 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:58.458300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:58.460156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:58.468499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:58.469082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:58.470229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:58.470687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:58.553687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:58.561914 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-504f4f5c-6178-4229-bc9c-63efc1958cc7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.107943 Apr 02 21:24:58.563094 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2919/6140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:24:59.579441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:24:59.580265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:24:59.587040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:59.587789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:59.588850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:24:59.589501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:24:59.678282 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:24:59.689583 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-508aa81d-6273-4847-ae87-2394668512f1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.114491 Apr 02 21:24:59.690170 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3222/6141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:24:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:00.707519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:00.708225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:00.718031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:00.718592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:00.719635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:00.720181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:00.808895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:00.822847 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efb700c9-7a94-48ce-9f1c-139a7cb154e1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.114569 Apr 02 21:25:00.824579 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2920/6142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:00 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:01.075938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-889673297", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "bbf0c12a-0451-48a7-9935-d4b111d8c599"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1296202741", "security_groups": [{"name": "tempest-secgroup-smoke-1037777726"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:01.214669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] validate_networks() for [('bbf0c12a-0451-48a7-9935-d4b111d8c599', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:25:01.613145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:25:01.613652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:25:01.614144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:25:01.614567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:25:01.615025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:25:01.624445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:01.624942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:01.625874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:01.626402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:01.643810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:25:01.649577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:25:01.662341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:25:01.665027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:25:01.716661 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f787fc21-5ba2-4a20-b9bd-828aa6aae825 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.645574 Apr 02 21:25:01.717451 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3223/6143] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:25:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:25:01.727771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2826bd45-07a6-42bd-ae81-c278eef67367 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:01.728481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2826bd45-07a6-42bd-ae81-c278eef67367 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:01.798030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2826bd45-07a6-42bd-ae81-c278eef67367 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:01.807095 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2826bd45-07a6-42bd-ae81-c278eef67367 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1266 microversion: 2.1 time: 0.083401 Apr 02 21:25:01.807706 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2921/6144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:01 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:01.841531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:01.842688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:01.850180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:01.850771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:01.851811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:01.852258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:01.918582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:01.927213 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a82ee410-a38b-4245-bcf0-2aa39b87f8cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.090338 Apr 02 21:25:01.927789 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3224/6145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:01 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:02.832522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:02.834018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:02.850384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:02.850849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:02.851661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:02.852113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:02.943861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:02.944505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:02.952636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:02.953304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:02.954271 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:02.954879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:02.956311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:02.965314 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-88569029-21be-4b6a-9892-de6ca2aef057 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1336 microversion: 2.1 time: 0.142315 Apr 02 21:25:02.976191 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2922/6146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:02 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1336 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:03.023396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:03.033436 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f85bf198-6d14-4455-98ce-4f7eaea77b20 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.093470 Apr 02 21:25:03.034863 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3225/6147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:02 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:03.982869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:03.983717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:03.991053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:03.991547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:03.992342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:03.992833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:04.051975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:04.053380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:04.063621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:04.064978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:04.066696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:04.067323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:04.152490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:04.161805 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e81721f-5a66-4a6d-aede-47ba01155d0d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.114505 Apr 02 21:25:04.163281 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3226/6148] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:04 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:04.290981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:04.300577 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df8a2e23-76b0-4327-b696-d53a762b0d77 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.321598 Apr 02 21:25:04.310547 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2923/6149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:03 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:04.348143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-851a42f7-32a8-4bfd-b0eb-6011d17c99f9 req-d1f5bb4a-5463-4bc7-8c4a-24418046e889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e207ac98-51fd-4d4d-8272-cd8ef74336cd", "tag": "545cbd80-3609-456a-8a7e-8f43da176dd4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:04.356895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-851a42f7-32a8-4bfd-b0eb-6011d17c99f9 req-d1f5bb4a-5463-4bc7-8c4a-24418046e889 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:04.357640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-851a42f7-32a8-4bfd-b0eb-6011d17c99f9 req-d1f5bb4a-5463-4bc7-8c4a-24418046e889 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:04.373491 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-851a42f7-32a8-4bfd-b0eb-6011d17c99f9 req-d1f5bb4a-5463-4bc7-8c4a-24418046e889 service nova] Creating event network-changed:545cbd80-3609-456a-8a7e-8f43da176dd4 for instance e207ac98-51fd-4d4d-8272-cd8ef74336cd on nch2-master-1 Apr 02 21:25:04.384363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-851a42f7-32a8-4bfd-b0eb-6011d17c99f9 req-d1f5bb4a-5463-4bc7-8c4a-24418046e889 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040642 Apr 02 21:25:04.386268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3227/6150] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:25:05.178789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:05.179414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:05.186266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:05.186726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:05.187496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:05.187941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:05.267587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:05.275032 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa30105b-9791-47f8-93d7-c3c7b54ba015 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.100289 Apr 02 21:25:05.275610 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2924/6151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:05 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:05.319910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:05.320802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:05.327628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:05.328089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:05.329046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:05.329564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:05.477118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:05.484733 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-51a7e88d-bc01-4cff-b75f-74a0a6f6e5a5 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.170078 Apr 02 21:25:05.485350 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3228/6152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:05 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:06.292293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:06.292950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:06.300238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:06.300742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:06.301516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:06.301962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:06.360846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:06.368216 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af265b84-28e0-4307-9a8a-373aa41ca0df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080077 Apr 02 21:25:06.368829 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2925/6153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:06 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:06.502306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:06.502924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:06.509732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:06.510191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:06.510961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:06.511400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:06.648226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:06.656338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0750c27d-db95-4e6f-b82e-2b77bd40a880 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.158578 Apr 02 21:25:06.656939 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3229/6154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:06 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:07.385670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:07.386287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:07.393650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:07.394103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:07.394904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:07.395352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:07.454694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:07.462404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-23fb5cf9-bd2a-4e30-a2a2-888c2ea705a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080796 Apr 02 21:25:07.462984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2926/6155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:07 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:07.673769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:07.674394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:07.681288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:07.681753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:07.682534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:07.682985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:07.823413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:07.830822 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69769d6a-d2e0-4cde-8204-79fd59899c17 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.160960 Apr 02 21:25:07.831396 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3230/6156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:07 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:08.479185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:08.479798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:08.487221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:08.487678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:08.488440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:08.488907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:08.550476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:08.557754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-26d52565-5f0b-4c65-b485-6a475affb271 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082509 Apr 02 21:25:08.558418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2927/6157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:08 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:08.847579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:08.848194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:08.854952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:08.855409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:08.856175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:08.856655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:08.988698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:08.995985 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-59e03692-e2a3-467c-922f-7792f9583c8b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.152276 Apr 02 21:25:08.996638 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3231/6158] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:08 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:09.575348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:09.575963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:09.583199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:09.583655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:09.584418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:09.584884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:09.644270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:09.651644 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7282b404-7859-4eac-a6d5-b2ce9f309be9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080326 Apr 02 21:25:09.652217 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2928/6159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:09 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:10.013045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:10.013662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:10.020939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:10.021428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:10.022200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:10.022661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:10.158799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:10.166520 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b8d98dd-b6b9-459d-8934-ba57ac1ebcec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.157334 Apr 02 21:25:10.167103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3232/6160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:10 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:10.315734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-7a820590-254b-403d-8f93-1eb7b28501fb req-ba99adfd-082e-486c-80f0-af130a1fb923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e207ac98-51fd-4d4d-8272-cd8ef74336cd", "name": "network-vif-plugged", "status": "completed", "tag": "545cbd80-3609-456a-8a7e-8f43da176dd4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:10.323702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7a820590-254b-403d-8f93-1eb7b28501fb req-ba99adfd-082e-486c-80f0-af130a1fb923 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:10.324154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7a820590-254b-403d-8f93-1eb7b28501fb req-ba99adfd-082e-486c-80f0-af130a1fb923 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:10.336147 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-7a820590-254b-403d-8f93-1eb7b28501fb req-ba99adfd-082e-486c-80f0-af130a1fb923 service nova] Creating event network-vif-plugged:545cbd80-3609-456a-8a7e-8f43da176dd4 for instance e207ac98-51fd-4d4d-8272-cd8ef74336cd on nch2-master-1 Apr 02 21:25:10.341120 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-7a820590-254b-403d-8f93-1eb7b28501fb req-ba99adfd-082e-486c-80f0-af130a1fb923 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028993 Apr 02 21:25:10.341925 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2929/6161] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:25:10.669040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:10.669668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:10.675697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:10.676159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:10.677002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:10.677456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:10.738201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:10.745677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-536757c7-73da-473d-9ae1-f13d0f6c3553 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080585 Apr 02 21:25:10.746254 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3233/6162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:10 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:11.184609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:11.185327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:11.192088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:11.192587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:11.193372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:11.193828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:11.326116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:11.334134 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-42f7f1c9-9d4f-4689-8f97-d028b9ff4210 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1392 microversion: 2.1 time: 0.154724 Apr 02 21:25:11.334704 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2930/6163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:11 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:11.763233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:11.763783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:11.770687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:11.771152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:11.771942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:11.772395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:11.833294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:11.840698 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-759f357c-bfd1-401f-b48c-a2db73ca3cac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081499 Apr 02 21:25:11.841276 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3234/6164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:11 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:12.351610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:12.352288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:12.360031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:12.360514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:12.361717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:12.362164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:12.502661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:12.509985 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1fac2ba3-ab3f-4248-b203-66904a19aeb8 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1565 microversion: 2.1 time: 0.162716 Apr 02 21:25:12.510553 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2931/6165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:12 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:12.526632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:12.527254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:12.533569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:12.534075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:12.534858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:12.535302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:12.672287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:12.681508 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff82850d-db85-4c2a-a27a-0e10a528fa01 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1565 microversion: 2.1 time: 0.158743 Apr 02 21:25:12.682079 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3235/6166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:12 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:12.858442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:12.859240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:12.865216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:12.865676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:12.866487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:12.866937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:12.930223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:12.937802 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d53c1ba-a662-47a0-a3a4-dd73ea8c62ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083872 Apr 02 21:25:12.938395 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2932/6167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:12 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:13.954363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:13.955009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:13.961964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:13.962452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:13.963258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:13.963720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:14.040031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:14.048348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-012bce2d-cc9b-4725-9f8f-7a866e1797a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.097939 Apr 02 21:25:14.048970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3236/6168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:13 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:14.625820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:14.626451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:14.628205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-63381efc-1c2f-4144-afd0-6645322aa6c5 req-184d3a8b-a886-4a40-ae91-f3e14fc118fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e207ac98-51fd-4d4d-8272-cd8ef74336cd", "tag": "545cbd80-3609-456a-8a7e-8f43da176dd4"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:14.633511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:14.634233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:14.635033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:14.635486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:14.637246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-63381efc-1c2f-4144-afd0-6645322aa6c5 req-184d3a8b-a886-4a40-ae91-f3e14fc118fa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:14.637926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-63381efc-1c2f-4144-afd0-6645322aa6c5 req-184d3a8b-a886-4a40-ae91-f3e14fc118fa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:14.652244 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-63381efc-1c2f-4144-afd0-6645322aa6c5 req-184d3a8b-a886-4a40-ae91-f3e14fc118fa service nova] Creating event network-changed:545cbd80-3609-456a-8a7e-8f43da176dd4 for instance e207ac98-51fd-4d4d-8272-cd8ef74336cd on nch2-master-1 Apr 02 21:25:14.658338 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-63381efc-1c2f-4144-afd0-6645322aa6c5 req-184d3a8b-a886-4a40-ae91-f3e14fc118fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034028 Apr 02 21:25:14.659320 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3237/6169] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:25:14.872543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:14.880899 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0747d56-a292-4be0-b880-e5a04a5f9aa4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1565 microversion: 2.1 time: 0.259537 Apr 02 21:25:14.881487 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2933/6170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:14 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1565 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:15.067217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:15.068409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:15.075110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:15.075671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:15.077517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:15.078338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:15.147693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:15.155401 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54a66fb5-9523-465a-b431-1b0668241a9c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.093455 Apr 02 21:25:15.156247 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3238/6171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:15 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:16.171748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:16.172372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:16.179254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:16.179721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:16.180526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:16.180977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:16.241795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:16.249179 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d5890c56-4b60-4cec-a835-b98f27ffd32d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081343 Apr 02 21:25:16.249758 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2934/6172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:16 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:17.265964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:17.266580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:17.273391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:17.273854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:17.274627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:17.275073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:17.334582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:17.342580 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3eb4002-c2c6-42ef-badd-f9891be91df7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080111 Apr 02 21:25:17.343142 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3239/6173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:17 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:18.359913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:18.360475 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:18.366919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:18.367376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:18.368143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:18.368694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:18.430637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:18.438798 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6102e10d-9995-444c-8dc7-78819eb819cd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083597 Apr 02 21:25:18.439376 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2935/6174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:18 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:19.456486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:19.456870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:19.465904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:19.466556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:19.467375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:19.467833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:19.528972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:19.536425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69dd6b16-76b1-4488-bbad-dfcd40d4737c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085076 Apr 02 21:25:19.537026 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3240/6175] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:19 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:20.553640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:20.554263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:20.561115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:20.561576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:20.562953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:20.563401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:20.621152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:20.629421 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-14f54fcc-8507-4b7a-9175-f8caf3d91e36 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079735 Apr 02 21:25:20.629994 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2936/6176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:20 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:21.646821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:21.647444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:21.654399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:21.654864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:21.655653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:21.656150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:21.719907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:21.727382 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bedbfe92-0d09-434e-89f1-c6ecca2a7733 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084611 Apr 02 21:25:21.727970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3241/6177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:21 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:22.743231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:22.743893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:22.751347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:22.751807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:22.752612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:22.753063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:22.811355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:22.819580 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-377540a0-bf91-4eb6-8830-ad014dc40c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080318 Apr 02 21:25:22.820158 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2937/6178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:22 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:23.836415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:23.836993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:23.844264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:23.844746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:23.845538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:23.845993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:23.907270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:23.915047 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ed0256c-0844-4a01-af92-3aae36085d4c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082619 Apr 02 21:25:23.915630 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3242/6179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:23 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:24.932675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:24.933291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:24.940057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:24.940537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:24.941359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:24.941800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:25.000582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:25.007995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af13c000-0e8c-42f3-8a4f-fed2fcfeeccd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079283 Apr 02 21:25:25.008914 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2938/6180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:24 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:26.025781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:26.026329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:26.033929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:26.034392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:26.035180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:26.035632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:26.097932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:26.105238 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b35407d9-3d4f-40f7-915e-dfe3f401f626 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083488 Apr 02 21:25:26.105813 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3243/6181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:26 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:27.121979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:27.122541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:27.129850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:27.130304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:27.131069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:27.131510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:27.190799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:27.198151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5351eab0-1bd8-4ea5-a5ce-1193395ccbfb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080228 Apr 02 21:25:27.198722 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2939/6182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:27 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:28.215214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:28.215832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:28.222644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:28.223101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:28.223885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:28.224320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:28.283464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:28.291186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-adcdc053-c02d-40fa-9e6b-2adaa93aa9d4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079977 Apr 02 21:25:28.291759 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3244/6183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:28 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:29.308187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:29.308818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:29.315659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:29.316121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:29.317120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:29.317567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:29.377506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:29.385405 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01739355-ef15-410c-81c7-e37051685ff2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081369 Apr 02 21:25:29.385984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2940/6184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:29 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:30.403252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:30.403863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:30.412251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:30.412883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:30.413679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:30.414119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:30.476314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:30.484421 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2df870e7-2627-4ef4-b20d-e93b43a91b7a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085189 Apr 02 21:25:30.485020 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3245/6185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:30 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:31.501016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:31.501644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:31.508489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:31.508946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:31.509793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:31.510172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:31.575351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:31.583434 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c8f81c7c-9a46-422f-9c2c-d46ebe561495 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086871 Apr 02 21:25:31.584037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2941/6186] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:31 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:32.602612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:32.603241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:32.610193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:32.611006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:32.611924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:32.612714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:32.674263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:32.681686 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4e2c9fd4-75ea-4259-bf51-c9e149332295 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083034 Apr 02 21:25:32.682262 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3246/6187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:32 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:33.698500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:33.699168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:33.706036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:33.706435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:33.707204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:33.707651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:33.765909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:33.773424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-708f2044-b922-48a0-8b3d-43a79ef3cb3c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078925 Apr 02 21:25:33.773998 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2942/6188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:33 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:34.791208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:34.791750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:34.798496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:34.798949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:34.799716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:34.800152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:34.863525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:34.871029 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11f09940-9a4f-468a-9f19-9a2fd71ab144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084105 Apr 02 21:25:34.871595 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3247/6189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:34 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:35.887759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:35.888305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:35.895297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:35.895757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:35.896563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:35.897014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:35.955698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:35.963168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-631c89b7-0170-4886-ad85-e0ce38ca4992 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079370 Apr 02 21:25:35.963748 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2943/6190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:35 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:36.980609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:36.981245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:36.988685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:36.989154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:36.989937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:36.990388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:37.049229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:37.056641 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac09c205-3eab-4757-8f6b-e0061d82ce6b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079952 Apr 02 21:25:37.057214 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3248/6191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:36 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:38.074048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:38.074670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:38.082128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:38.082600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:38.083375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:38.083819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:38.133905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:38.134853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:38.142305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:38.142686 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:38.142822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:38.143534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:38.143979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:38.150345 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71527bd6-b64c-420a-b6f1-b871e39c6561 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080191 Apr 02 21:25:38.151237 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2944/6192] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:38 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:38.206056 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e223799-1e94-4ec2-a396-9fb02f88782f tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd/action" status: 200 len: 24559 microversion: 2.1 time: 0.075945 Apr 02 21:25:38.206707 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3249/6193] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:25:38 2022] POST /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd/action => generated 24559 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:25:39.167265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:39.167902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:39.175253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:39.175706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:39.176486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:39.176933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:39.234999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:39.242703 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f3796ce-41d1-4f29-9607-4358b96f3520 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079362 Apr 02 21:25:39.243276 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2945/6194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:39 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:40.260854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:40.261595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:40.269891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:40.270353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:40.271133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:40.271576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:40.335251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:40.343398 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43a434c9-3081-4590-ba44-6139886e0b29 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086936 Apr 02 21:25:40.343977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3250/6195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:40 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:41.360353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:41.360985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:41.367949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:41.368411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:41.369206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:41.369652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:41.428357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:41.435901 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-18d6e6f6-8c90-4b5b-9a3d-91c451671c2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079517 Apr 02 21:25:41.436503 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2946/6196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:41 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:42.454033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:42.454680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:42.461523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:42.461979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:42.462756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:42.463200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:42.523021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:42.531066 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a007012-6ef9-48e8-95dc-3b7755f797a9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080984 Apr 02 21:25:42.531643 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3251/6197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:42 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:43.547943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:43.548599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:43.555534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:43.555990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:43.556818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:43.557268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:43.917179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:43.925322 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-221a7108-1c49-4a33-a6b5-ba766e6b65b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.381297 Apr 02 21:25:43.925905 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2947/6198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:43 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:44.942120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:44.942751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:44.949529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:44.949988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:44.950759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:44.951205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:45.013802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:45.021335 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3efe420-c91d-4588-b02b-a7d39560eebe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083102 Apr 02 21:25:45.021848 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3252/6199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:44 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:46.038409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:46.039031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:46.046353 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:46.046825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:46.047663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:46.048115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:46.106247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:46.114070 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c8b54e44-7849-43f9-920d-1d3acbc1ceeb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079948 Apr 02 21:25:46.114649 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2948/6200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:46 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:47.130898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:47.131452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:47.138260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:47.138720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:47.139492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:47.139956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:47.201310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:47.208727 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f5b969ad-6aa3-486b-9248-78d17f9445d1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081837 Apr 02 21:25:47.209306 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3253/6201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:47 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:48.226521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:48.227168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:48.234362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:48.234820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:48.235627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:48.236078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:48.294627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:48.302552 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2962969-3955-428d-8b5c-d2789d565e1c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079987 Apr 02 21:25:48.303121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2949/6202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:48 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:49.134704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:49.135256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:49.142771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.143230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.144001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.144470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.283490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:49.292350 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02c7d5fd-d8e7-4639-8e52-b698d3b15188 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1684 microversion: 2.1 time: 0.161571 Apr 02 21:25:49.292982 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3254/6203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:49 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:49.319074 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:49.319691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:49.326447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.326887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.328343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.328774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.388014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:49.396620 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85256b7c-a9ed-49e9-86f8-c62720c69dbf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081376 Apr 02 21:25:49.397004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:49.397360 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2950/6204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:49 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:49.397976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:49.403809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.404266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.405092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.405540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.453185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-777c668f-6aa0-4081-8821-bd07ce822585 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd/action" status: 200 len: 32630 microversion: 2.1 time: 0.059201 Apr 02 21:25:49.455301 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3255/6205] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:25:49 2022] POST /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 02 21:25:49.637310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:49.637860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:49.644516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.644986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.645768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.646220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.777293 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5855337b-534a-4d05-aaaa-eb9389402c1e tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1835 microversion: 2.1 time: 0.143803 Apr 02 21:25:49.777885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2951/6206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:49 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1835 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:49.796621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:49.797874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:49.805107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.805573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.806362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:49.806812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:49.899188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lazy-loading 'flavor' on Instance uuid e207ac98-51fd-4d4d-8272-cd8ef74336cd {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:25:49.913359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Going to try to live migrate instance to another host {{(pid=136518) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 02 21:25:50.413545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:50.414108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:50.421189 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:50.421654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:50.422464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:50.422910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:50.486888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:50.494459 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25cb979c-171e-470f-a318-6e3f759b6fb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085061 Apr 02 21:25:50.495044 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2952/6207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:50 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:51.122655 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a3dcd7a8-21a2-42a5-9544-c7439011554c tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd/action" status: 202 len: 0 microversion: 2.1 time: 1.331720 Apr 02 21:25:51.123425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3256/6208] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:25:49 2022] POST /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd/action => generated 0 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:25:51.132747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:51.133363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:51.140601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:51.141058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:51.141833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:51.142275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:51.293732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:51.301157 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eeb1e4ba-1079-4873-b724-dfcd9b071d1e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1694 microversion: 2.1 time: 0.173289 Apr 02 21:25:51.301735 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2953/6209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:51 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:51.511490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:51.512059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:51.520296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:51.520796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:51.521569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:51.522011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:51.589544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:51.600501 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c72503d-246c-4dba-97fe-19450fde9fb8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.093222 Apr 02 21:25:51.601090 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3257/6210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:51 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:52.319400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:52.319929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:52.331900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:52.332425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:52.333855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:52.334016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:52.483961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:52.491528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ab6e283f-e181-477f-b42e-fe98de386aa6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1694 microversion: 2.1 time: 0.176239 Apr 02 21:25:52.492105 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2954/6211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:52 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:52.617225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:52.617860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:52.625199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:52.625658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:52.626428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:52.626870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:52.720402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:52.727795 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f537e772-dd6f-4914-8a7d-22e9fb27a40c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.114501 Apr 02 21:25:52.728365 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3258/6212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:52 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:53.509247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:53.509860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:53.517231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:53.517685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:53.518450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:53.518890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:53.660961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:53.668666 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-894b269c-a4c1-45ac-8682-8cbce595c3d7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1684 microversion: 2.1 time: 0.163407 Apr 02 21:25:53.669235 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2955/6213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:53 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:53.684947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:53.685728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:53.692482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:53.692948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:53.693735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:53.694183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:53.745128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:53.745643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:53.752016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:53.752492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:53.753269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:53.753708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:53.814512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:53.822512 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cea3ef88-32a5-4403-9d84-d99d0575cb1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081325 Apr 02 21:25:53.823090 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2956/6214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:53 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:25:53.826256 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b9a59b2b-e53a-472e-ba77-904f82bf2243 tempest-TestNetworkAdvancedServerOps-970847150 tempest-TestNetworkAdvancedServerOps-970847150-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1835 microversion: 2.1 time: 0.145309 Apr 02 21:25:53.826924 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3259/6215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:53 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1835 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:54.839319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:54.839949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:54.847673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:54.848133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:54.848950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:54.849400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:54.911664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:54.919589 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3315813d-20ff-4eab-a397-668f106c479b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084209 Apr 02 21:25:54.920165 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2957/6216] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:54 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:55.066476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:55.067111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:55.069121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-cff04983-a8c4-407c-93d8-8d8af6fe3d28 req-004bc8c4-32b8-4b51-af1b-0d79da75d82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e207ac98-51fd-4d4d-8272-cd8ef74336cd", "tag": "545cbd80-3609-456a-8a7e-8f43da176dd4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:55.074413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.075088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:55.075877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.076320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:55.078115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cff04983-a8c4-407c-93d8-8d8af6fe3d28 req-004bc8c4-32b8-4b51-af1b-0d79da75d82c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.078633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-cff04983-a8c4-407c-93d8-8d8af6fe3d28 req-004bc8c4-32b8-4b51-af1b-0d79da75d82c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:55.090022 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-cff04983-a8c4-407c-93d8-8d8af6fe3d28 req-004bc8c4-32b8-4b51-af1b-0d79da75d82c service nova] Creating event network-changed:545cbd80-3609-456a-8a7e-8f43da176dd4 for instance e207ac98-51fd-4d4d-8272-cd8ef74336cd on nch2-master-1 Apr 02 21:25:55.096139 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-cff04983-a8c4-407c-93d8-8d8af6fe3d28 req-004bc8c4-32b8-4b51-af1b-0d79da75d82c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Apr 02 21:25:55.096796 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2958/6217] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:25:55.103284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:25:55.191832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-afb83c44-9f47-4f29-b13b-b6356d0ce6f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 204 len: 0 microversion: 2.1 time: 0.128983 Apr 02 21:25:55.193413 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3260/6218] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:25:55 2022] DELETE /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:25:55.201717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:55.203008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:55.210018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.210489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:55.211280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.211731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:55.462068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:55.470573 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cde5e989-1f7d-4b65-b8e2-e7f99282b165 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1690 microversion: 2.1 time: 0.273121 Apr 02 21:25:55.471170 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2959/6219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:55 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1690 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:55.937643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:55.938368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:55.944986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.945451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:55.946227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:55.946677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:56.009936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:56.018105 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eeef15d6-5b72-4766-b4a7-6d8bbc4851ee tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085452 Apr 02 21:25:56.018711 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3261/6220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:55 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:56.493832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:56.494455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:56.501295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:56.501758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:56.502534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:56.503083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:56.650768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:56.658987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6aa5b300-fea6-4d29-93f1-57ae57d4973d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1571 microversion: 2.1 time: 0.169078 Apr 02 21:25:56.659571 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2960/6221] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:56 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:57.034859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:57.035508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:57.043316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:57.044023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:57.045608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:57.046072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:57.108067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:57.115748 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2ea8815-ff33-45b8-92b6-987189647321 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084822 Apr 02 21:25:57.116583 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3262/6222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:57 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:57.204646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-772ab529-47a2-4be9-8527-09c2fcdf0338 req-21dc495d-132d-4b3e-bb8b-b5b56fadcf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e207ac98-51fd-4d4d-8272-cd8ef74336cd", "name": "network-vif-deleted", "tag": "545cbd80-3609-456a-8a7e-8f43da176dd4"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:25:57.212969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-772ab529-47a2-4be9-8527-09c2fcdf0338 req-21dc495d-132d-4b3e-bb8b-b5b56fadcf58 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:57.213459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-772ab529-47a2-4be9-8527-09c2fcdf0338 req-21dc495d-132d-4b3e-bb8b-b5b56fadcf58 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:57.227110 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-772ab529-47a2-4be9-8527-09c2fcdf0338 req-21dc495d-132d-4b3e-bb8b-b5b56fadcf58 service nova] Creating event network-vif-deleted:545cbd80-3609-456a-8a7e-8f43da176dd4 for instance e207ac98-51fd-4d4d-8272-cd8ef74336cd on nch2-master-1 Apr 02 21:25:57.232055 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-772ab529-47a2-4be9-8527-09c2fcdf0338 req-21dc495d-132d-4b3e-bb8b-b5b56fadcf58 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031207 Apr 02 21:25:57.232886 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2961/6223] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:25:57.677200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:57.677803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:57.684052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:57.684552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:57.685343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:57.685797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:57.716913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:57.717381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:57.718377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lazy-loading 'fault' on Instance uuid e207ac98-51fd-4d4d-8272-cd8ef74336cd {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:25:57.759674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:57.766825 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a76ecc7e-2286-4002-9eaa-9233c9addfd1 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 200 len: 1440 microversion: 2.1 time: 0.093688 Apr 02 21:25:57.767405 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3263/6224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:57 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:58.134554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:58.135184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:58.141438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:58.141902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:58.142676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:58.143123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:58.203056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:58.210472 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e5462fff-c4ff-4bb7-b2ff-f53cf9af5e1f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081141 Apr 02 21:25:58.211050 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2962/6225] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:25:58.785787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:58.786670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: e207ac98-51fd-4d4d-8272-cd8ef74336cd] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:58.793570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:58.794030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:58.794813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:58.795261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:58.810090 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] HTTP exception thrown: Instance e207ac98-51fd-4d4d-8272-cd8ef74336cd could not be found. Apr 02 21:25:58.810693 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Returning 404 to user: Instance e207ac98-51fd-4d4d-8272-cd8ef74336cd could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:25:58.811547 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff608a78-6bd8-4ee8-bd90-b3721f438d46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd" status: 404 len: 111 microversion: 2.1 time: 0.029814 Apr 02 21:25:58.812098 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3264/6226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:58 2022] GET /compute/v2.1/servers/e207ac98-51fd-4d4d-8272-cd8ef74336cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:25:59.231199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:25:59.231824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:25:59.239324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:59.239789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:59.240609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:25:59.241058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:25:59.318164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:25:59.325621 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac40a66f-1f4a-4389-9733-fc0abff92208 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.098353 Apr 02 21:25:59.326200 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2963/6227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:25:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:00.345416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:00.346157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:00.353522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:00.354110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:00.355174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:00.355862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:00.442887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:00.451354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cc800dc1-26b3-46b6-92e9-83c139d32fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.112352 Apr 02 21:26:00.457912 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3265/6228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:00 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:01.468646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:01.469179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:01.482964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:01.482964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:01.482964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:01.482964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:01.575716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:01.585366 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8a1ff4d5-ff10-49b0-9a05-32698da50868 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.120054 Apr 02 21:26:01.585366 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2964/6229] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:01 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:01.964364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ca226737-a3c9-44b5-a07c-f1d3f3e3e1d9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '.version_select at 0x7f54d45f18b0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:01.983054 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ca226737-a3c9-44b5-a07c-f1d3f3e3e1d9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1296202741" status: 202 len: 0 microversion: 2.1 time: 0.024374 Apr 02 21:26:01.984540 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3266/6230] 10.222.0.18 () {58 vars in 1283 bytes} [Sat Apr 2 21:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1296202741 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:26:02.008234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f896283-4a2d-4e54-baf8-ffdbc153ceb7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: .version_select at 0x7f54d4d3ff70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-837804392"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:02.022216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9f896283-4a2d-4e54-baf8-ffdbc153ceb7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:26:02.027758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9f896283-4a2d-4e54-baf8-ffdbc153ceb7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:26:02.159689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9f896283-4a2d-4e54-baf8-ffdbc153ceb7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:26:02.165003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-9f896283-4a2d-4e54-baf8-ffdbc153ceb7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:26:02.179825 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f896283-4a2d-4e54-baf8-ffdbc153ceb7 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.175619 Apr 02 21:26:02.180441 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2965/6231] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:26:02 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:02.601658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:02.602416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:02.609240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:02.609777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:02.613934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:02.614434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:02.694599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:02.703021 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b043d4bf-2b6b-416f-9620-a563500bcbda tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.105282 Apr 02 21:26:02.703615 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3267/6232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:02 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:03.720515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:03.721140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:03.727855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:03.728311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:03.729118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:03.729562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:03.812660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:03.820205 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9152a93a-8320-48a7-8d0d-34877ad16166 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.105011 Apr 02 21:26:03.821034 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2966/6233] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:03 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:04.837607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:04.838342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:04.845471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:04.845932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:04.846726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:04.847174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:04.918290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:04.926726 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b7c63c1d-a3ef-467f-b9b4-252ce783f1e8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.093121 Apr 02 21:26:04.927311 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3268/6234] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:04 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:05.943391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:05.944180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:05.951060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:05.951645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:05.953195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:05.953865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:06.025888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:06.034754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-352535f6-af6d-4653-a983-564a8f093bd5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.095350 Apr 02 21:26:06.036232 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2967/6235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:05 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:07.052730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:07.053592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:07.071744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:07.072283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:07.073274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:07.074018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:07.155569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:07.164315 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8bb020e5-a0b8-46a8-8272-b1d1c55f7b33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.115532 Apr 02 21:26:07.165087 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3269/6236] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:07 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:07.629773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-31924084", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "ac5533aa-8fd2-455c-8c78-a549717cd773"}], "key_name": "tempest-TestNetworkAdvancedServerOps-837804392", "security_groups": [{"name": "tempest-secgroup-smoke-1382237981"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:07.748918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] validate_networks() for [('ac5533aa-8fd2-455c-8c78-a549717cd773', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:26:08.182743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:08.184696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:08.192811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:08.193640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:08.194686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:08.195358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:08.242789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:26:08.243217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:26:08.243698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:26:08.244109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:26:08.244717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:26:08.261529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:08.262373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:08.263419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:08.264064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:08.274688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:08.283649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:26:08.284196 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7c275f63-b388-4a6a-ab40-cdfba63a1145 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.107214 Apr 02 21:26:08.285164 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3270/6237] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:08 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:08.289751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Getting quotas for user c87f4a9a2f5a4c9d831ca26b8bc91f17 and project 8c67d04af96d45f995da597f3f678014. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:26:08.303335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:26:08.305796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:26:08.360447 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e4f101d-e221-447c-b40f-3651534b957a tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.734356 Apr 02 21:26:08.361149 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2968/6238] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:26:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:26:08.383536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b52a450-f852-44c8-ac8b-1917257a3227 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:08.384713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b52a450-f852-44c8-ac8b-1917257a3227 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:08.491736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b52a450-f852-44c8-ac8b-1917257a3227 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:08.501434 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b52a450-f852-44c8-ac8b-1917257a3227 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1264 microversion: 2.1 time: 0.133245 Apr 02 21:26:08.504498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3271/6239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:08 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1264 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:09.303796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:09.305332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:09.317177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:09.317929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:09.318884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:09.319495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:09.411652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:09.422098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-233cf17d-788a-4e82-b733-258f2087453f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.124142 Apr 02 21:26:09.433650 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2969/6240] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:09 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:09.520761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:09.521384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:09.533118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:09.533591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:09.534405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:09.534857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:09.651991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:09.665451 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b63aecf5-f161-42d0-9cda-b7d28405c131 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1324 microversion: 2.1 time: 0.148915 Apr 02 21:26:09.667654 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3272/6241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:09 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:10.441125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:10.441760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:10.450212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:10.450932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:10.452705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:10.453427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:10.536509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:10.550518 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0bf755e-4958-4f5b-8a1e-8dc79481cb58 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.109071 Apr 02 21:26:10.551257 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2970/6242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:10 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:10.685094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:10.685717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:10.694462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:10.694947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:10.695752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:10.696212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:10.849137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:10.856856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79825c6c-3bde-4437-b379-341685b45a72 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1390 microversion: 2.1 time: 0.175652 Apr 02 21:26:10.858713 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3273/6243] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:10 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:11.185645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-03cd798e-b5b4-475c-9604-584daa3d86bd req-b8290fa6-e34c-4a46-97b8-4136b3e43857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:11.197543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-03cd798e-b5b4-475c-9604-584daa3d86bd req-b8290fa6-e34c-4a46-97b8-4136b3e43857 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:11.198223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-03cd798e-b5b4-475c-9604-584daa3d86bd req-b8290fa6-e34c-4a46-97b8-4136b3e43857 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:11.212181 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-03cd798e-b5b4-475c-9604-584daa3d86bd req-b8290fa6-e34c-4a46-97b8-4136b3e43857 service nova] Creating event network-changed:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:26:11.224715 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-03cd798e-b5b4-475c-9604-584daa3d86bd req-b8290fa6-e34c-4a46-97b8-4136b3e43857 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046472 Apr 02 21:26:11.225978 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2971/6244] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:26:11.567950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:11.568612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:11.574576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:11.575045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:11.575826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:11.576278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:11.638459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:11.646222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21a54e14-5603-42eb-af78-be2379f5b571 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082267 Apr 02 21:26:11.646807 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3274/6245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:11 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:11.876644 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:11.877361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:11.883511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:11.883977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:11.884787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:11.885241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:12.110984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:12.118460 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c4e59ac-2b8d-4106-8a3d-2027618474f9 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1390 microversion: 2.1 time: 0.247021 Apr 02 21:26:12.119035 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2972/6246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:11 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:12.663281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:12.663907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:12.671332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:12.671790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:12.672600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:12.673051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:12.738244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:12.745821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae37130b-9e99-42ea-bffc-81a08f169035 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086732 Apr 02 21:26:12.746402 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3275/6247] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:12 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:13.135225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:13.135768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:13.143075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:13.143532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:13.144300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:13.144773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:13.582657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:13.590454 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-024b0618-1586-46a0-ad4d-498eb05c53bb tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1390 microversion: 2.1 time: 0.459144 Apr 02 21:26:13.591035 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2973/6248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:13 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1390 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:13.762336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:13.762956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:13.769722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:13.770183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:13.770952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:13.771395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:13.830665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:13.838114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30f97def-0dc1-42d8-ab89-e6b83d8d8b61 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079735 Apr 02 21:26:13.838693 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3276/6249] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:13 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:14.607810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:14.608763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:14.616640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:14.617099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:14.617883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:14.618329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:14.754872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:14.762438 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-906a42ef-8400-4bfa-84c2-792402c33e60 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1390 microversion: 2.1 time: 0.158869 Apr 02 21:26:14.763019 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2974/6250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:14 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:14.854338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:14.854954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:14.861683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:14.862140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:14.862909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:14.863381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:14.926854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:14.934606 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3dd79d6-77a4-4234-8964-ef737c30da9d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084450 Apr 02 21:26:14.935194 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3277/6251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:14 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:15.780170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:15.780871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:15.788143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:15.788624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:15.789399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:15.789843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:15.931129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:15.940114 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39b501f7-e349-4a17-a034-ff8a960fd45c tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1390 microversion: 2.1 time: 0.164365 Apr 02 21:26:15.940744 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2975/6252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:15 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:15.950974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:15.952150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:15.958981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:15.959448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:15.960230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:15.960708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:16.019240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:16.026637 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-848e6322-aeba-49d0-8526-e54c302c6bcb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079563 Apr 02 21:26:16.027216 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3278/6253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:15 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:16.585210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-9db997ca-e767-47ee-908e-f5614b392b57 req-187deb3e-0ba1-4b00-9ac6-5e590ad4f15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "name": "network-vif-plugged", "status": "completed", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:16.593746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9db997ca-e767-47ee-908e-f5614b392b57 req-187deb3e-0ba1-4b00-9ac6-5e590ad4f15e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:16.594247 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9db997ca-e767-47ee-908e-f5614b392b57 req-187deb3e-0ba1-4b00-9ac6-5e590ad4f15e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:16.605435 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-9db997ca-e767-47ee-908e-f5614b392b57 req-187deb3e-0ba1-4b00-9ac6-5e590ad4f15e service nova] Creating event network-vif-plugged:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:26:16.610342 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-9db997ca-e767-47ee-908e-f5614b392b57 req-187deb3e-0ba1-4b00-9ac6-5e590ad4f15e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028793 Apr 02 21:26:16.611196 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2976/6254] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:26:16.960912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:16.961538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:16.968429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:16.968865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:16.969647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:16.970103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:17.046433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:17.047272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:17.053433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:17.053896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:17.054704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:17.055155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:17.104802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:17.112979 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72fc9ec5-f996-40c2-ac6f-92c51a1a939b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1390 microversion: 2.1 time: 0.155902 Apr 02 21:26:17.113509 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3279/6255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:16 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:17.115277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:17.122824 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afab2b73-ad85-4a12-9831-3cb450f7b3fc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082331 Apr 02 21:26:17.123952 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2977/6256] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:17 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:26:18.129903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:18.130520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:18.137466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:18.137929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:18.138717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:18.138893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:18.139296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:18.139520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:18.146706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:18.147172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:18.147959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:18.148413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:18.207723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:18.215348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-11b927d2-2ecc-4b48-a7b0-d78dbf715c4a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080277 Apr 02 21:26:18.215867 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2978/6257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:18 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:26:18.292822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:18.300409 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08df2680-b7fb-4e45-93f8-c85841021823 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1562 microversion: 2.1 time: 0.174485 Apr 02 21:26:18.301013 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3280/6258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:18 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:18.316882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:18.317623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:18.324260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:18.324810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:18.325789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:18.326498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:18.464133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:18.472251 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5fec3b4c-ab23-425f-b722-8f83687f5bc2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1562 microversion: 2.1 time: 0.159208 Apr 02 21:26:18.472777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2979/6259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:18 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:19.233324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:19.233997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:19.240799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:19.241257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:19.242024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:19.242466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:19.308641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:19.316952 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42f33654-bb6d-4295-b0ae-ae91d7f93b19 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087473 Apr 02 21:26:19.317956 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3281/6260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:19 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:20.122653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8bb0142b-530b-4151-bd61-29a2930c7f55 req-a454e3e0-afbd-4bba-84e4-1a9f437ae407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:20.127649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:20.128284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:20.137523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:20.137990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:20.138254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8bb0142b-530b-4151-bd61-29a2930c7f55 req-a454e3e0-afbd-4bba-84e4-1a9f437ae407 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:20.138784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:20.139233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:20.144587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8bb0142b-530b-4151-bd61-29a2930c7f55 req-a454e3e0-afbd-4bba-84e4-1a9f437ae407 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:20.157018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8bb0142b-530b-4151-bd61-29a2930c7f55 req-a454e3e0-afbd-4bba-84e4-1a9f437ae407 service nova] Creating event network-changed:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:26:20.162908 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8bb0142b-530b-4151-bd61-29a2930c7f55 req-a454e3e0-afbd-4bba-84e4-1a9f437ae407 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044001 Apr 02 21:26:20.163736 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3282/6261] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:26:20.336281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:20.337256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:20.344317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:20.344890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:20.345793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:20.346436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:20.374361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:20.391459 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb8f655f-2569-4074-8e1b-f274d45378ec tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1562 microversion: 2.1 time: 0.275575 Apr 02 21:26:20.392382 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2980/6262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:20 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1562 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:20.425481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:20.433587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e80b285-5b3a-41b6-a75b-44a8725b49a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.103034 Apr 02 21:26:20.434739 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3283/6263] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:20 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:26:21.449773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:21.450394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:21.457102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:21.457563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:21.458347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:21.458794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:21.521939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:21.530131 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f60a502-bb3c-4b38-b8b4-866cb7c6aaab tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084325 Apr 02 21:26:21.531264 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2981/6264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:21 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:22.547163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:22.547771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:22.554639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:22.555094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:22.555858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:22.556299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:22.617463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:22.625742 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3679a2b7-2658-4685-a159-02cb8e129109 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082494 Apr 02 21:26:22.626344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3284/6265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:22 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:23.643287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:23.643975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:23.650816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:23.651277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:23.652054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:23.652540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:23.713145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:23.721353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f4082502-94ff-499d-b7ef-89316bd84f00 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082546 Apr 02 21:26:23.721935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2982/6266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:23 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:24.738263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:24.738801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:24.745587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:24.746046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:24.746824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:24.747401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:24.807425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:24.815417 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a021159-5d43-49bd-9d2e-00f4ef8b021a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081248 Apr 02 21:26:24.816001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3285/6267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:24 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:25.833246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:25.833890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:25.840997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:25.841454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:25.842215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:25.842656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:25.900790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:25.908849 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-941bc466-a107-4546-bb69-9535cca5a8a5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079487 Apr 02 21:26:25.909425 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2983/6268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:25 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:26.926264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:26.926882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:26.933695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:26.934148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:26.934917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:26.935363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:26.996813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:27.004202 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85752de0-13ea-4837-90dd-a792ccc53cf3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081936 Apr 02 21:26:27.004808 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3286/6269] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:26 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:28.020776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:28.021390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:28.028157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:28.028647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:28.029414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:28.029861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:28.088623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:28.095958 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2da30fa-3b86-4bbb-8d37-65dfda02e534 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079129 Apr 02 21:26:28.096546 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2984/6270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:28 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:29.112329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:29.112920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:29.119716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:29.120169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:29.120967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:29.121412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:29.180098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:29.187959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c59d6256-f825-4eb7-86fa-eee58f37fd72 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079651 Apr 02 21:26:29.188544 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3287/6271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:29 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:30.204918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:30.205542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:30.211988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:30.212443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:30.213241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:30.213688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:30.272143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:30.279682 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f83a3eb7-82f6-4328-81f5-dd88428cc504 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078876 Apr 02 21:26:30.280316 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2985/6272] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:30 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:31.296916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:31.297538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:31.304338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:31.304824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:31.305604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:31.306051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:31.367556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:31.375651 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a7a0032f-bc3e-4e0c-afaf-c5fcd18df98d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082661 Apr 02 21:26:31.376232 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3288/6273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:31 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:32.392926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:32.393545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:32.400359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:32.400852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:32.401627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:32.402072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:32.461420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:32.469809 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af889148-ccfc-458f-80a3-ad92803ff566 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081292 Apr 02 21:26:32.470382 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2986/6274] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:32 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:33.487209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:33.487830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:33.494652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:33.495110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:33.495882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:33.496328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:33.562790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:33.570524 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cefcf5e6-8db4-4a17-a166-95be6e2f60f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087887 Apr 02 21:26:33.571107 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3289/6275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:33 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:34.587155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:34.587783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:34.594687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:34.595149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:34.595922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:34.596379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:34.657630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:34.666480 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e428d399-b9ba-48d9-909d-44c97d69e2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083272 Apr 02 21:26:34.667053 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2987/6276] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:34 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:35.683612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:35.684263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:35.691489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:35.691945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:35.692826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:35.693272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:35.752266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:35.759661 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-27ae212a-191c-46f7-8945-86508ffcd877 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079976 Apr 02 21:26:35.760228 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3290/6277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:35 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:36.777141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:36.777764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:36.784619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:36.785080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:36.786111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:36.786560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:36.848348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:36.855848 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f9e4b30-23c7-4268-b12d-0fd968e488b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082656 Apr 02 21:26:36.856646 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2988/6278] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:36 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:37.873194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:37.874355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:37.881185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:37.881649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:37.882430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:37.882885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:37.941826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:37.949302 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0dea0f6f-f74c-43ed-aff6-831769cc12a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080161 Apr 02 21:26:37.949878 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3291/6279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:37 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:38.965935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:38.966549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:38.973902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:38.974352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:38.975116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:38.975554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:39.033374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:39.041048 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad135184-eaf0-44e0-8344-489556654593 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078867 Apr 02 21:26:39.041617 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2989/6280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:38 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:40.058131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:40.058748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:40.065811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:40.066275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:40.067049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:40.067496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:40.129858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:40.137645 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-433f8c55-5da2-479b-b986-eae2bab72235 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083466 Apr 02 21:26:40.138226 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3292/6281] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:40 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:41.156839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:41.157459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:41.164580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:41.165043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:41.165816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:41.166267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:41.227145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:41.234663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09ba8688-2028-4a66-89d6-ffd58263c86d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081786 Apr 02 21:26:41.235233 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2990/6282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:41 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:42.252096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:42.252766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:42.259207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:42.259664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:42.260434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:42.260900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:42.319262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:42.326725 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dfaa06de-f528-46ea-824f-2e1953d34949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079333 Apr 02 21:26:42.327295 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3293/6283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:42 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:43.343941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:43.344582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:43.351374 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:43.351830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:43.352625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:43.353070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:43.414888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:43.422586 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ace0ae7d-8c64-4b1d-b96c-abcd2bae6110 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082507 Apr 02 21:26:43.423154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2991/6284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:43 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:43.742356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:43.743334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:43.750854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:43.751315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:43.752110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:43.752577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:43.802785 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33112642-0190-4fce-a25e-75c703fc85ac tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27/action" status: 200 len: 24570 microversion: 2.1 time: 0.064244 Apr 02 21:26:43.803431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3294/6285] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:26:43 2022] POST /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27/action => generated 24570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:26:44.439993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:44.440651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:44.447649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:44.448107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:44.448913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:44.449361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:44.508897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:44.516953 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3a0647e-dd70-4f1c-a691-4f472b43d405 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081124 Apr 02 21:26:44.517523 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2992/6286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:44 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:45.534530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:45.535491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:45.542968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:45.543421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:45.544190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:45.544663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:45.604301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:45.612863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-64e28b6e-61c9-4ead-b549-3d6d36394354 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083121 Apr 02 21:26:45.613424 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3295/6287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:45 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:46.630101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:46.630725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:46.637662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:46.638127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:46.639010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:46.639462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:46.701544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:46.709330 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-543fcb63-9d6e-478b-88b9-7f101d038a62 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083186 Apr 02 21:26:46.709820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2993/6288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:46 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:47.726114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:47.726663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:47.734070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:47.734527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:47.735302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:47.735749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:47.795676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:47.803085 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3791af0-26f2-4612-88db-3cce968279ed tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081008 Apr 02 21:26:47.803656 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3296/6289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:47 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:48.820038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:48.820589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:48.827808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:48.828261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:48.829080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:48.829524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:48.890827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:48.898256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2b11086d-587f-4440-8fb5-f66bda09c0d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082188 Apr 02 21:26:48.898822 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2994/6290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:48 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:49.915569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:49.916185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:49.923592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:49.924045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:49.924881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:49.925326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:49.985497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:49.992906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d6902f9-9a18-4735-8adb-c3ed424988f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081217 Apr 02 21:26:49.997630 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3297/6291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:49 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:51.010503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:51.011117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:51.018515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:51.018966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:51.019732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:51.020174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:51.079597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:51.087129 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62c0e31e-1b72-4546-9afb-ff7c65fc66cb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080536 Apr 02 21:26:51.087702 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2995/6292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:51 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:52.103968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:52.104564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:52.111779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:52.112236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:52.113074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:52.113517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:52.173654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:52.181053 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80b91606-f295-4b24-9775-89cd4692fc48 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081205 Apr 02 21:26:52.181625 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3298/6293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:52 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:53.197898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:53.198520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:53.205359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:53.205820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:53.206599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:53.207047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:53.377182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:53.384693 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6014f4a2-9db1-414a-83a8-15a7fc648b5f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.190728 Apr 02 21:26:53.385269 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2996/6294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:53 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:26:54.402048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:54.402658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:54.410279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.410755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.411525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.411968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.529821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:54.537580 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13324f96-1da8-43a9-b80b-663551b7f9d2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.139690 Apr 02 21:26:54.538150 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3299/6295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:54 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:54.734419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:26:54.735820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:54.742551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.743007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.743773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.744213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.820102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:26:54.820560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:26:54.821039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:26:54.821458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:26:54.821873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:26:54.882304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:54.888045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.888538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.889357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.890029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.916117 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bece4b37-bb53-4da6-ac49-48293f3ae187 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27/action" status: 202 len: 1135 microversion: 2.1 time: 0.185677 Apr 02 21:26:54.916818 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2997/6296] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:26:54 2022] POST /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27/action => generated 1135 bytes in 187 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 02 21:26:54.931791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:54.932560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:54.939181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.939758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:54.940651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:54.941355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:55.079288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:55.086923 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abbc23a4-77ea-450d-ad0e-1ed1132fd4a4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.159341 Apr 02 21:26:55.087510 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3300/6297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:54 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:55.554285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:55.554907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:55.561203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:55.561670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:55.562441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:55.562889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:55.620610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:55.627981 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e0754eb1-56d8-48ad-81d8-52adc3d8b202 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.077714 Apr 02 21:26:55.628571 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2998/6298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:55 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:56.104414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:56.105053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:56.111808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:56.112622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:56.113394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:56.113838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:56.252923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:56.260383 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35a049ba-2fa8-4ceb-917a-62e568681e46 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.159969 Apr 02 21:26:56.261005 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3301/6299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:56 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:56.644889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:56.645504 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:56.652152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:56.652642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:56.653409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:56.653869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:56.718567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:56.726029 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-da396fe1-6c96-4cbb-8a3c-edea75699a37 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085029 Apr 02 21:26:56.726610 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 2999/6300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:56 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:57.278141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:57.278813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:57.286524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:57.286986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:57.287762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:57.288211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:57.424353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:57.431823 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f9762b28-4386-4dc4-b778-c5cdbec60e8e tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.157619 Apr 02 21:26:57.432397 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3302/6301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:57 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:57.742724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:57.743379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:57.750806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:57.751271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:57.752055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:57.752532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:57.813396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:57.821197 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0d5509e-5b44-40f0-9069-3c6f760c70e9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082354 Apr 02 21:26:57.821951 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3000/6302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:57 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:58.449844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:58.450471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:58.457977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:58.458441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:58.459229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:58.459678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:58.599528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:58.607872 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11cd5402-1728-4f0d-b18d-b583d433b812 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.161401 Apr 02 21:26:58.608584 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3303/6303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:58 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:58.838859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:58.839558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:58.846474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:58.846939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:58.847722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:58.848168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:58.929438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:58.937665 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f837968f-fc88-4f8d-b93b-ea730e3e29bd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.102663 Apr 02 21:26:58.938243 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3001/6304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:59.625707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:59.626332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:59.633143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:59.633611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:59.634395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:59.634850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:59.771381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:26:59.779318 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c848f1a-ad54-4ff2-b01d-7ce782ddc278 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.157709 Apr 02 21:26:59.779903 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3304/6305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:59 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:26:59.954443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:26:59.955094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:26:59.962084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:59.962555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:26:59.963404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:26:59.963858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:00.023377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:00.033377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cbc55339-303c-4ebd-bc50-58fec3eaa7b3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082975 Apr 02 21:27:00.033963 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3002/6306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:26:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:00.797085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:00.797616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:00.804426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:00.804924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:00.805707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:00.806154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:00.939432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:00.946894 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-207c6d6a-ed21-4716-b744-b04a6f916690 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.154530 Apr 02 21:27:00.947473 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3305/6307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:00 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:01.049350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:01.049906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:01.056874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:01.057456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:01.058314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:01.058817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:01.117114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:01.124415 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13ac4985-cdb4-4b5a-a01d-31d6dc7381a3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079031 Apr 02 21:27:01.125087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3003/6308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:01 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:01.964631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:01.965252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:01.972733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:01.973192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:01.973989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:01.974429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:02.121698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:02.129228 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf3a75c5-6a9a-4f98-9b1a-30f3f8a1cde0 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.168806 Apr 02 21:27:02.129805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3306/6309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:01 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:02.140877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:02.141496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:02.148210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:02.148694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:02.149458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:02.149896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:02.211965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:02.221138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5bc2738b-1a0b-444a-86d3-a2fc9c324ad0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084001 Apr 02 21:27:02.221651 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3004/6310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:02 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:03.146442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:03.146972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:03.153797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:03.154249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:03.155009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:03.155452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:03.238114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:03.238781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:03.245668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:03.246131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:03.246918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:03.247362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:03.294941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:03.302977 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2910dc9-cfd5-41e8-be13-0c9ce74efdd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.160523 Apr 02 21:27:03.303557 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3307/6311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:03 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:03.310738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:03.318713 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b7215995-c35e-4a1c-863e-cd4c22085d5b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085309 Apr 02 21:27:03.319273 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3005/6312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:03 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:27:04.320998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:04.321570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:04.328972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:04.329428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:04.330196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:04.330637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:04.336946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:04.337583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:04.344421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:04.344919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:04.345712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:04.346161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:04.411093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:04.418468 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fb232b54-6566-40a5-8991-2f1b4365d5ac tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085848 Apr 02 21:27:04.419042 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3006/6313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:04 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:27:04.467310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:04.474887 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fd781ec0-a613-499b-a7de-15a53a6043af tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.157914 Apr 02 21:27:04.475459 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3308/6314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:04 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:05.435209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:05.435805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:05.443449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:05.444047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:05.444870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:05.445317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:05.491207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:05.491846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:05.498646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:05.499101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:05.500563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:05.501009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:05.506491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:05.514041 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-66c95d39-8651-435c-a00a-508802fb35d9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082800 Apr 02 21:27:05.514621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3007/6315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:05 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:05.636316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:05.643794 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90553188-b6d3-4d6d-8ebd-1237b65329fe tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.156583 Apr 02 21:27:05.644382 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3309/6316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:05 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:27:06.531046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:06.531672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:06.538801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:06.539263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:06.540042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:06.540514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:06.600078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:06.607528 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c056e27-a339-47fe-9322-1ad69cac3c9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080925 Apr 02 21:27:06.608129 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3008/6317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:06 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:06.661578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:06.662193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:06.669158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:06.669619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:06.670418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:06.670859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:06.807600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:06.815360 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d7159c5-185a-438c-b6cd-dfde2227563b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1689 microversion: 2.1 time: 0.157880 Apr 02 21:27:06.815934 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3310/6318] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:06 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:07.624990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:07.626220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:07.633048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:07.633507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:07.634279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:07.634726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:07.693093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:07.700385 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84b3f5a9-2b2d-4156-9eea-b52e25c80a71 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079333 Apr 02 21:27:07.700980 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3009/6319] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:07 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:07.832381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:07.833004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:07.839705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:07.840165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:07.840960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:07.841401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:07.976592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:07.984343 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c96458a7-1510-4b27-99e8-43bdb0c8e62b tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1695 microversion: 2.1 time: 0.155962 Apr 02 21:27:07.985650 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3311/6320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:07 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:08.717263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:08.717811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:08.724849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:08.725317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:08.726098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:08.726548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:08.785860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:08.793691 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7bca25cf-1d31-4fea-b649-dc0fb2629953 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080467 Apr 02 21:27:08.794270 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3010/6321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:08 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:09.003212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:09.003768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:09.010590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:09.011050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:09.011828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:09.012279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:09.144730 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:09.152928 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56745baf-b373-45a7-8b2c-2daa1e074194 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1695 microversion: 2.1 time: 0.154339 Apr 02 21:27:09.153518 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3312/6322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:08 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:09.810450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:09.811049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:09.817757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:09.818202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:09.818971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:09.819410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:09.880478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:09.888086 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7197355-e60c-4a56-b1b0-1c9eae5e995e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081629 Apr 02 21:27:09.888724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3011/6323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:09 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:10.169838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:10.170479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:10.177351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:10.177813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:10.178599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:10.179051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:10.315288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:10.322730 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-991bf1a9-1faf-48f0-8fc7-eaabc8c373e2 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1680 microversion: 2.1 time: 0.156840 Apr 02 21:27:10.323312 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3313/6324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:10 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:10.900334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f81a4a88-110d-4e6d-8de8-e8239e49b1ba req-04eb61c9-6f0b-4827-8ff5-3644b2467a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "name": "network-vif-unplugged", "status": "completed", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:27:10.905780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:10.906955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:10.911826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f81a4a88-110d-4e6d-8de8-e8239e49b1ba req-04eb61c9-6f0b-4827-8ff5-3644b2467a46 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:10.912568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f81a4a88-110d-4e6d-8de8-e8239e49b1ba req-04eb61c9-6f0b-4827-8ff5-3644b2467a46 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:10.914152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:10.914608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:10.915576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:10.916028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:10.925090 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f81a4a88-110d-4e6d-8de8-e8239e49b1ba req-04eb61c9-6f0b-4827-8ff5-3644b2467a46 service nova] Creating event network-vif-unplugged:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:27:10.930575 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f81a4a88-110d-4e6d-8de8-e8239e49b1ba req-04eb61c9-6f0b-4827-8ff5-3644b2467a46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034739 Apr 02 21:27:10.931384 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3012/6325] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:27:10.977667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:10.988173 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-73e4bfa4-4ff8-4bdd-a111-efa6dd85ca8f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086867 Apr 02 21:27:10.988786 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3314/6326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:10 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:27:12.007695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:12.008792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:12.014922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:12.015391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:12.016928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:12.017379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:12.081068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:12.088510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19061309-2a9f-4dbf-a222-013cecd23414 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087163 Apr 02 21:27:12.089097 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3013/6327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:11 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:12.945994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c6de5104-c922-45ae-9ad2-b0b3d915f093 req-e3e989f0-a46c-44b9-a4ea-cd4a8560efac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "name": "network-vif-plugged", "status": "completed", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:27:12.954988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c6de5104-c922-45ae-9ad2-b0b3d915f093 req-e3e989f0-a46c-44b9-a4ea-cd4a8560efac service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:12.955445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c6de5104-c922-45ae-9ad2-b0b3d915f093 req-e3e989f0-a46c-44b9-a4ea-cd4a8560efac service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:12.966575 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c6de5104-c922-45ae-9ad2-b0b3d915f093 req-e3e989f0-a46c-44b9-a4ea-cd4a8560efac service nova] Creating event network-vif-plugged:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:27:12.972402 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c6de5104-c922-45ae-9ad2-b0b3d915f093 req-e3e989f0-a46c-44b9-a4ea-cd4a8560efac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030292 Apr 02 21:27:12.973245 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3315/6328] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:27:13.105363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:13.105982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:13.112773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:13.113230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:13.113999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:13.114441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:13.173602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:13.180910 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a3c345a-edcd-4e49-9776-d3f5343fe6c9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079452 Apr 02 21:27:13.181646 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3014/6329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:13 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:14.199656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:14.200367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:14.206713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:14.207176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:14.207954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:14.208404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:14.268011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:14.275464 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5d6649c-843c-4622-84b6-2de5d05e0be1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080958 Apr 02 21:27:14.276043 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3316/6330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:14 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:15.293175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:15.293717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:15.300681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:15.301144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:15.301913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:15.302357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:15.360489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:15.367870 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f17c2407-12d9-4108-ba43-000dfc1faefd tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078715 Apr 02 21:27:15.368445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3015/6331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:15 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:16.384049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:16.384706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:16.392095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:16.392592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:16.393373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:16.393821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:16.452476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:16.461518 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1a87100-6ff2-4e54-93b6-a9c7d3e32094 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081138 Apr 02 21:27:16.462743 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3317/6332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:16 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:17.478217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:17.478877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:17.486068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:17.486532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:17.487326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:17.487809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:17.550371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:17.558368 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ebd9e282-2cab-4d51-9d7d-9eeca14dd98b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084130 Apr 02 21:27:17.558948 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3016/6333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:17 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:18.575914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:18.576560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:18.584008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:18.584510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:18.585299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:18.585749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:18.647915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:18.655390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-694574b7-8750-4f25-bea8-f1e3250e10b5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083446 Apr 02 21:27:18.655976 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3318/6334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:18 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:19.672964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:19.673570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:19.680229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:19.680721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:19.681490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:19.681934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:19.746436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:19.754555 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d0b8d0a-7f37-432a-983c-8e5fbe242944 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085822 Apr 02 21:27:19.755133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3017/6335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:19 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:20.773211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:20.773749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:20.779771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:20.780233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:20.781046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:20.781494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:20.843166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:20.851106 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2d06746b-fa4b-4d46-93c2-1db07e09d8fb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082904 Apr 02 21:27:20.851680 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3319/6336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:20 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:21.870763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:21.871311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:21.878771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:21.879224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:21.879988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:21.880436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:21.938874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:21.946315 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1d248bc-28b0-4817-8fb3-e197a80d6dde tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079677 Apr 02 21:27:21.946885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3018/6337] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:21 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:27:22.962104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:22.962756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:22.969608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:22.970062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:22.970833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:22.971281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:23.032653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:23.040254 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ad7da41d-bfa5-4b23-8dc6-c2444eb42131 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082060 Apr 02 21:27:23.040859 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3320/6338] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:22 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:24.057227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:24.057846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:24.064719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:24.065176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:24.065958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:24.066405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:24.124629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:24.132052 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afb0442a-555f-46b3-b1d7-664ec768553e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078816 Apr 02 21:27:24.132654 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3019/6339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:24 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:25.148710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:25.149327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:25.156077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:25.156563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:25.158067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:25.158517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:25.216547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:25.224436 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b2fc394-77f2-4026-8c8d-89c89d71fedc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079750 Apr 02 21:27:25.225028 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3321/6340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:25 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:26.241699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:26.242320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:26.249137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:26.249597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:26.250369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:26.250818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:26.309292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:26.317393 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c525e0bb-da9f-4adb-82a9-0c4118f8fe33 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079640 Apr 02 21:27:26.317967 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3020/6341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:26 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:27.333745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:27.334401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:27.341794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:27.342256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:27.343045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:27.343495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:27.406519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:27.414305 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a95374fe-7857-4dc2-b339-242663a5a949 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085007 Apr 02 21:27:27.414888 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3322/6342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:27 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:28.431040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:28.431669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:28.438674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:28.439657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:28.440442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:28.440916 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:28.503762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:28.511292 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a65591d-02a7-4879-a8ea-5a2a1d5c71de tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084230 Apr 02 21:27:28.511873 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3021/6343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:28 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:29.527167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:29.527783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:29.534871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:29.535329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:29.536093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:29.536563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:29.604849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:29.613152 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-094d5739-fc62-402d-a890-c19eeb0bb92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.089983 Apr 02 21:27:29.613723 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3323/6344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:29 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:30.630179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:30.630849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:30.637337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:30.637797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:30.638569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:30.639016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:30.697498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:30.704881 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-656a09c6-b2b6-4cb2-9d1f-6f64304db92b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079195 Apr 02 21:27:30.705947 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3022/6345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:30 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:31.722762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:31.723301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:31.730064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:31.730519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:31.731288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:31.731728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:31.790699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:31.798124 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ee77217-8e5a-4020-a5b4-3d77f74a5539 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079917 Apr 02 21:27:31.798695 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3324/6346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:31 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:32.815281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:32.816479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:32.823420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:32.823877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:32.824691 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:32.825133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:32.885555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:32.892885 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91928ab9-670e-4361-bf74-ebc80aa7f5a4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081643 Apr 02 21:27:32.893456 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3023/6347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:32 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:33.910554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:33.911177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:33.918020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:33.918476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:33.919248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:33.919695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:33.979075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:33.986502 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-393c38d3-9b1f-470d-bd18-1d3b3a0846d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080141 Apr 02 21:27:33.987073 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3325/6348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:33 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:35.003722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:35.004895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:35.011638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:35.012090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:35.012895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:35.013340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:35.071621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:35.078995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-681a61a4-ff5c-4985-baa4-521185e5fcd2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079236 Apr 02 21:27:35.079562 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3024/6349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:34 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:36.096635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:36.097177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:36.103991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:36.104468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:36.105261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:36.105708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:36.166596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:36.174041 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eedb55d8-addf-46e4-ae04-d66f7cf27b77 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081504 Apr 02 21:27:36.174621 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3326/6350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:36 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:36.844595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:27:36.845469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:36.852286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:36.852790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:36.853568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:36.854016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:36.905371 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41d0f09d-50d4-4183-ac4b-b64c447e43f4 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "POST /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27/action" status: 200 len: 24568 microversion: 2.1 time: 0.064704 Apr 02 21:27:36.906216 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3025/6351] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:27:36 2022] POST /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27/action => generated 24568 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:27:37.191192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:37.191942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:37.199743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:37.200203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:37.201014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:37.201460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:37.260057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:37.267440 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-177083bf-cd41-4728-82f1-b925c90daa1e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080304 Apr 02 21:27:37.268014 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3327/6352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:37 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:38.285110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:38.285797 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:38.293521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:38.293978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:38.294748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:38.295186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:38.358124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:38.366711 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0116cfe7-a95c-424a-8b9a-35aa9df00787 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086174 Apr 02 21:27:38.367289 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3026/6353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:38 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:39.383765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:39.384314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:39.391228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:39.391726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:39.392493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:39.392947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:39.456266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:39.464585 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b3f2bcd-1494-468c-bf57-6121f38e8ffe tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084850 Apr 02 21:27:39.465163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3328/6354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:39 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:40.480928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:40.481575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:40.488914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:40.489373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:40.490180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:40.490630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:40.548552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:40.556413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6198b9eb-d5e1-4e23-9c4d-dc3fc8d9ffb4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079377 Apr 02 21:27:40.557019 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3027/6355] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:40 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:41.574084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:41.574698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:41.580814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:41.581270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:41.582703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:41.583145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:41.640886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:41.648798 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d131d35c-6d3a-4e2e-bdc1-c9029a0b9863 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079483 Apr 02 21:27:41.649374 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3329/6356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:41 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:42.668992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:42.669759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:42.677616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:42.678085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:42.678863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:42.679312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:42.736933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:42.744859 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bb21fd1-7e30-47da-a53a-ea336861a0f8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082147 Apr 02 21:27:42.745431 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3028/6357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:42 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:43.762320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:43.762881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:43.769313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:43.769773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:43.770549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:43.770991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:43.830114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:43.837762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d42c9c78-f361-4b81-8961-5cd62fc8d7f2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079653 Apr 02 21:27:43.838344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3330/6358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:43 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:44.854789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:44.855345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:44.862345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:44.862811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:44.864268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:44.864739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:44.926703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:44.934027 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7a98fd2d-2c2a-4a70-a5aa-dfbe70406260 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083580 Apr 02 21:27:44.934592 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3029/6359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:44 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:45.950733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:45.951356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:45.958478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:45.958937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:45.959719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:45.960169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:46.018773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:46.026285 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-80a3e70f-b45e-45d4-a926-2d0cd2aac2a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079561 Apr 02 21:27:46.026858 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3331/6360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:45 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:47.043700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:47.044354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:47.051823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:47.052285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:47.053096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:47.053541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:47.114830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:47.122227 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85f6bbb1-fd6a-4c73-aedf-ebd7bde6eaea tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082484 Apr 02 21:27:47.122800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3030/6361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:47 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:48.139119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:48.139862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:48.147735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:48.148201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:48.149033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:48.149485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:48.217332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:48.226422 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1a943115-83f3-4408-90d5-7c36729de3f6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.091311 Apr 02 21:27:48.227028 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3332/6362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:48 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:49.174154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:49.174651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:49.176129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8715eddc-cb6a-470e-8f45-8303eb1f362a req-fc693549-286d-43d7-a239-9eccb336ad1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:27:49.182100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.182570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.183360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.183812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.185561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8715eddc-cb6a-470e-8f45-8303eb1f362a req-fc693549-286d-43d7-a239-9eccb336ad1e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.186022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8715eddc-cb6a-470e-8f45-8303eb1f362a req-fc693549-286d-43d7-a239-9eccb336ad1e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.197778 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8715eddc-cb6a-470e-8f45-8303eb1f362a req-fc693549-286d-43d7-a239-9eccb336ad1e service nova] Creating event network-changed:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:27:49.202940 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8715eddc-cb6a-470e-8f45-8303eb1f362a req-fc693549-286d-43d7-a239-9eccb336ad1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031243 Apr 02 21:27:49.203816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3333/6363] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:27:49.211044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:27:49.246447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:49.247494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:49.256314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.256879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.258210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.258539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.337033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:49.341953 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56a488ea-bfa0-4957-aafd-2eccbd141f56 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 204 len: 0 microversion: 2.1 time: 0.171667 Apr 02 21:27:49.346800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3031/6364] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:27:49 2022] DELETE /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:27:49.348090 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b139650c-6f0e-4f12-852e-ee3022789345 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.107317 Apr 02 21:27:49.348907 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3334/6365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:49 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:49.354690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:49.355410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:49.363343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.363816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.364647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:49.365101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:49.626509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:49.634301 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0054ed9d-3c07-451f-a1cd-8bf4260e9c2d tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1686 microversion: 2.1 time: 0.284044 Apr 02 21:27:49.634969 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3032/6366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:49 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1686 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:50.365770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:50.366321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:50.373158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:50.373615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:50.374388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:50.374837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:50.437515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:50.445893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76f6daba-2264-4488-a7e1-a85b329289bb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084642 Apr 02 21:27:50.446487 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3335/6367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:50 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:50.651795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:50.652420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:50.660049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:50.660615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:50.661393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:50.661841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:50.802578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:50.811412 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d86f4e51-31bd-44e3-bcef-56cb4a942381 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1568 microversion: 2.1 time: 0.163464 Apr 02 21:27:50.812145 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3033/6368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:50 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:51.395641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-46e123b6-6416-43af-8fdb-540761bbb7be req-b12002b9-eb54-4b28-99e0-626e37aad0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158072e1-e533-4042-a08b-f8b84cd89b27", "name": "network-vif-deleted", "tag": "c8b6c2e9-8b6b-4973-8d9f-d0048741ef04"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:27:51.405020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-46e123b6-6416-43af-8fdb-540761bbb7be req-b12002b9-eb54-4b28-99e0-626e37aad0fc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:51.405472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-46e123b6-6416-43af-8fdb-540761bbb7be req-b12002b9-eb54-4b28-99e0-626e37aad0fc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:51.417304 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-46e123b6-6416-43af-8fdb-540761bbb7be req-b12002b9-eb54-4b28-99e0-626e37aad0fc service nova] Creating event network-vif-deleted:c8b6c2e9-8b6b-4973-8d9f-d0048741ef04 for instance 158072e1-e533-4042-a08b-f8b84cd89b27 on nch2-master-1 Apr 02 21:27:51.422956 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-46e123b6-6416-43af-8fdb-540761bbb7be req-b12002b9-eb54-4b28-99e0-626e37aad0fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031667 Apr 02 21:27:51.423620 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3336/6369] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:27:51.463139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:51.463754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:51.469763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:51.470801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:51.470992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:51.471436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:51.537372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:51.545285 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3838af58-a333-4a6a-a2b2-5fef12115253 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085858 Apr 02 21:27:51.546371 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3034/6370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:51 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:51.829338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:51.830089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:51.836812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:51.837305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:51.838090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:51.838593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:51.873036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:51.873501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:51.873964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lazy-loading 'fault' on Instance uuid 158072e1-e533-4042-a08b-f8b84cd89b27 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:27:51.922007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87f4a9a2f5a4c9d831ca26b8bc91f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c67d04af96d45f995da597f3f678014', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:51.930400 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87e84c86-bf23-4908-ba03-17337cfeacd6 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 200 len: 1354 microversion: 2.1 time: 0.105329 Apr 02 21:27:51.930970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3337/6371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:51 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:52.564474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:52.565117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:52.572651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:52.573107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:52.573872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:52.574310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:52.634352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:52.641698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47b59cd0-c7dd-4c79-8dad-d878a89cf5d8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081247 Apr 02 21:27:52.642298 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3035/6372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:52 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:52.947732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:52.948342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] [instance: 158072e1-e533-4042-a08b-f8b84cd89b27] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:52.955176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:52.955631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:52.956424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:52.956891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:52.970015 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] HTTP exception thrown: Instance 158072e1-e533-4042-a08b-f8b84cd89b27 could not be found. Apr 02 21:27:52.970601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Returning 404 to user: Instance 158072e1-e533-4042-a08b-f8b84cd89b27 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:27:52.971420 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-028067ed-d30d-427f-93b4-18d5609ffe02 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27" status: 404 len: 111 microversion: 2.1 time: 0.027685 Apr 02 21:27:52.972485 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3338/6373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:52 2022] GET /compute/v2.1/servers/158072e1-e533-4042-a08b-f8b84cd89b27 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:27:53.659537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:53.660226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:53.667445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:53.667941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:53.668760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:53.669248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:53.733527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:53.740889 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6cfc8c0-7f3d-4eb8-8a9c-08c7987861a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086307 Apr 02 21:27:53.741476 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3036/6374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:53 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:54.757635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:54.758265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:54.765716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:54.766431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:54.767251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:54.767901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:54.842131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:54.851740 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aed20ae9-4550-46ee-930a-5675765dbf16 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.097983 Apr 02 21:27:54.853187 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3339/6375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:54 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:55.869821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:55.870540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:55.877491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:55.877952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:55.878806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:55.879257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:55.954048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:55.962576 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c6e2d10a-b123-4a73-8ec0-0bd0a82d5b09 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.096445 Apr 02 21:27:55.962953 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3037/6376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:55 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:56.347495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cecea82e-55a3-4696-a6e0-9efeb591c377 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] Calling method '.version_select at 0x7f54da25c9d0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:56.365963 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cecea82e-55a3-4696-a6e0-9efeb591c377 tempest-TestNetworkAdvancedServerOps-1748328729 tempest-TestNetworkAdvancedServerOps-1748328729-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-837804392" status: 202 len: 0 microversion: 2.1 time: 0.022947 Apr 02 21:27:56.366560 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3340/6377] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 21:27:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-837804392 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:27:56.980318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:56.981122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:56.989292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:56.989749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:56.990526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:56.990969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:57.053698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:57.061830 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62474a84-4892-44ae-803e-463e8d037115 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086529 Apr 02 21:27:57.062402 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3038/6378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:56 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:58.080448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:58.081337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:58.088771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:58.089226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:58.089995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:58.090437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:58.149159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:58.156435 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-987a8e6c-0dda-4656-844d-8a4582f7cc9b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080879 Apr 02 21:27:58.157021 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3341/6379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:27:59.174316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:27:59.175426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:27:59.182258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:59.182710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:59.183471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:27:59.183913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:27:59.242101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:27:59.249431 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1a24d41f-f885-418d-81c8-f2e6a7eacd4b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079063 Apr 02 21:27:59.250000 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3039/6380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:27:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:00.266739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:00.267359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:00.275040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:00.275504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:00.276285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:00.276782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:00.342965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:00.350445 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b92a157c-eb18-41b9-8525-b38fa268c7ad tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087703 Apr 02 21:28:00.351016 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3342/6381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:00 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:01.367314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:01.367842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:01.374845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:01.375300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:01.376075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:01.376620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:01.439093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:01.447146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5590ed72-b5ee-40c1-a6b4-00ef6f3e142c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083833 Apr 02 21:28:01.447940 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3040/6382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:01 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:02.463216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:02.463835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:02.470682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:02.471145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:02.471915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:02.472392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:02.531428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:02.539684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d8563548-3ac0-4683-8b6d-cc103bf3e13c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080416 Apr 02 21:28:02.540268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3343/6383] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:02 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:03.556331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:03.556979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:03.563679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:03.564132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:03.564932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:03.565372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:03.631749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:03.640310 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-493c5412-ef3b-4151-bcae-09249e822486 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087832 Apr 02 21:28:03.640918 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3041/6384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:03 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:04.657996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:04.658615 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:04.666007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:04.666463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:04.667265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:04.667714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:04.729129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:04.736594 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f08676c2-e2fd-4eb8-914f-18b02a478416 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082814 Apr 02 21:28:04.737168 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3344/6385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:04 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:05.754252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:05.754798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:05.761550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:05.762005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:05.762791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:05.763228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:05.823492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:05.831143 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eb653242-f60c-43e4-8027-5a15e20a2788 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081433 Apr 02 21:28:05.832294 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3042/6386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:05 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:06.849231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:06.849772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:06.856617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:06.857080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:06.857845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:06.858288 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:06.916849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:06.924168 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a1ad3b43-5bcc-4d36-8a48-61dc78d16033 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079622 Apr 02 21:28:06.924768 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3345/6387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:06 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:07.940937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:07.941559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:07.948305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:07.948801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:07.949576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:07.950023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:08.008771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:08.016266 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f4e717cd-4a81-44bb-b7c9-9f7802f38abb tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079238 Apr 02 21:28:08.016870 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3043/6388] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:07 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:09.033224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:09.033838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:09.041222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:09.041677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:09.042447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:09.042886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:09.103508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:09.110824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe3f3452-683d-43ce-9507-a9ffeca7e0b8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081799 Apr 02 21:28:09.111412 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3346/6389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:09 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:10.127341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:10.127979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:10.135068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:10.135516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:10.136295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:10.136778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:10.195656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:10.203051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c28bc9a0-51f4-4e27-b81f-844fab0d242e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079613 Apr 02 21:28:10.203634 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3044/6390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:10 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:11.219972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:11.220572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:11.227517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:11.227983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:11.228814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:11.229267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:11.288812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:11.296363 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ff07bfb-a908-4994-bdc2-ac5757755319 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080402 Apr 02 21:28:11.296971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3347/6391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:11 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:28:12.312985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:12.313604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:12.321004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:12.321465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:12.322239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:12.322684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:12.382988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:12.390466 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8a87b2d-f140-4297-9639-584cbbf2eebc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081361 Apr 02 21:28:12.391046 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3045/6392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:12 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:13.408227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:13.408880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:13.416100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:13.416592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:13.417363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:13.417801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:13.481740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:13.489756 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d3717323-2d30-4d43-8212-978bf42d93a0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085672 Apr 02 21:28:13.490339 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3348/6393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:13 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:13.661362 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:28:13.661556 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:28:14.506429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:14.507054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:14.514081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:14.514536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:14.515341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:14.515782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:14.576036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:14.583535 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f8f54e0-8865-4bd8-a8c3-827b9a1b8167 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081683 Apr 02 21:28:14.584108 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3046/6394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:14 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:15.599892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:15.600524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:15.607320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:15.607777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:15.608572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:15.609019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:15.668251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:15.676085 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb4dc0ba-ab19-4e12-9373-7a578ea72144 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080119 Apr 02 21:28:15.676663 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3349/6395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:15 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:16.692658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:16.694360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:16.700224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:16.700717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:16.701486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:16.701924 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:16.766710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:16.774709 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0008512b-8d89-4221-9233-892ca475594b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085982 Apr 02 21:28:16.775394 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3047/6396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:16 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:17.791855 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:17.792410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:17.799221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:17.799672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:17.800437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:17.800899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:17.860562 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:17.868411 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-820b8312-091e-4584-a739-82dac6c475df tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080569 Apr 02 21:28:17.869003 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3350/6397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:17 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:18.884545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:18.885098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:18.891612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:18.892101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:18.892897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:18.893841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:18.952305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:18.960226 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f0da560-a3f6-4264-ad08-caf1cf30e7dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079720 Apr 02 21:28:18.960820 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3048/6398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:18 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:19.979446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:19.980056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:19.989439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:19.990154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:19.991418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:19.991953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:20.055701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:20.063112 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4a45ebd9-d67c-4c43-8dc4-1e4bee91aa0b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.089108 Apr 02 21:28:20.063689 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3351/6399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:19 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:21.079126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:21.079750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:21.086559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:21.087050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:21.087822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:21.088273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:21.146588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:21.153980 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-60542d90-c842-42a7-b890-71f9c3cb71dc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078774 Apr 02 21:28:21.154555 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3049/6400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:21 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:22.170688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:22.171311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:22.178189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:22.178652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:22.179430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:22.179877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:22.244264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:22.256393 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-194d4b8e-dad2-4084-b4e9-9e36d400f8d5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.089696 Apr 02 21:28:22.257003 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3352/6401] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:22 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:23.273434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:23.273974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:23.280745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:23.281201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:23.281965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:23.282669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:23.342770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:23.350842 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07caa532-f4be-44a8-a4e4-eca13dc89a52 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081641 Apr 02 21:28:23.351411 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3050/6402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:23 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:24.367541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:24.368194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:24.375006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:24.375472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:24.376287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:24.376775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:24.436362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:24.444578 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e1315e30-47a7-464e-95d1-4103adc2fc2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080954 Apr 02 21:28:24.445164 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3353/6403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:24 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:25.461240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:25.461864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:25.468655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:25.469119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:25.469893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:25.470341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:25.529626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:25.538356 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-82a66b0d-fe8b-4bac-ad84-4bd3fdcf8423 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080984 Apr 02 21:28:25.538931 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3051/6404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:25 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:26.555270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:26.555916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:26.562734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:26.563223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:26.564004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:26.564463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:26.623090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:26.631072 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-837eeee8-db49-4458-a93b-101f0777b085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079835 Apr 02 21:28:26.631642 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3354/6405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:26 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:27.648325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:27.648979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:27.655935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:27.656398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:27.657467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:27.657920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:27.716328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:27.724329 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12afd8db-36fa-40e4-a2da-8efd37a37ca2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079958 Apr 02 21:28:27.724937 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3052/6406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:27 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:28.741096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:28.741668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:28.748379 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:28.748868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:28.749638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:28.750086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:28.811123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:28.818609 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d57368ba-3f55-419c-a83d-4a5fb6341625 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082246 Apr 02 21:28:28.819201 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3355/6407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:28 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:29.835715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:29.836327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:29.843991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:29.844532 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:29.845319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:29.845762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:29.910852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:29.918204 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e706d241-d874-45b4-86db-b8b85e669ba1 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086367 Apr 02 21:28:29.918785 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3053/6408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:29 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:30.935372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:30.935994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:30.942956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:30.943414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:30.944191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:30.944665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:31.007367 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:31.015052 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da856ca2-2547-4718-8eba-4c74ee6b336f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083578 Apr 02 21:28:31.015622 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3356/6409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:30 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:32.032684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:32.033806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:32.040721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:32.041186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:32.041963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:32.042414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:32.101018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:32.108368 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9e7b9be-a6f8-427b-b76d-78f86aa4d889 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079865 Apr 02 21:28:32.108978 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3054/6410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:32 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:33.125658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:33.126277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:33.133094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:33.133548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:33.134313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:33.134755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:33.193234 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:33.200608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a234d93d-fc88-4f2b-89ad-5299c530fc0e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078825 Apr 02 21:28:33.201118 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3357/6411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:33 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:34.217707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:34.218320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:34.225597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:34.226052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:34.226814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:34.227253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:34.285811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:34.293043 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-179fd4a9-2292-4806-b3d5-303e9b62d59b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079238 Apr 02 21:28:34.293605 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3055/6412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:34 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:35.310521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:35.311042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:35.318481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:35.318935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:35.319701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:35.320151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:35.382515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:35.390221 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8656a0ce-0ed1-4617-ba01-0c2c3a3be964 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083360 Apr 02 21:28:35.390810 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3358/6413] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:35 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:36.407413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:36.408704 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:36.415558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:36.416014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:36.416848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:36.417335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:36.476683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:36.484187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-071ec7dd-a095-4573-9cf3-618c5cc77122 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080903 Apr 02 21:28:36.484811 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3056/6414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:36 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:37.501593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:37.502828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:37.509630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:37.510081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:37.510847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:37.511287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:37.570674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:37.578164 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd3439e6-88dd-44a4-950d-eb95695d3d34 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080370 Apr 02 21:28:37.578741 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3359/6415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:37 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:38.598078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:38.599038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:38.609221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:38.609920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:38.611107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:38.611790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:38.672534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:38.679846 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1c3d362f-6a18-4778-80a3-7a496aa3b809 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.088011 Apr 02 21:28:38.680420 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3057/6416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:38 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:39.917185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:39.917812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:39.925031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:39.925497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:39.926281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:39.926732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:39.989565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:39.997063 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-042a679b-1bc5-4667-8978-37a999e8f8f7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.304603 Apr 02 21:28:39.997662 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3360/6417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:39 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:41.013589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:41.014205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:41.021089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:41.021550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:41.022324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:41.022770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:41.080948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:41.088256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d2039502-39da-4077-991e-5c3ed2814042 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078530 Apr 02 21:28:41.088856 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3058/6418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:41 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:42.105560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:42.106181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:42.112630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:42.113090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:42.113863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:42.114310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:42.173167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:42.180440 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78373ed3-6e9f-404b-a96c-d07e475f124a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078948 Apr 02 21:28:42.181034 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3361/6419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:42 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:43.197118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:43.197774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:43.205269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:43.205678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:43.206452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:43.206896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:43.270723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:43.278063 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-41a13e98-43c2-4149-bac9-931ad24dcf96 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084824 Apr 02 21:28:43.278648 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3059/6420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:43 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:44.295296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:44.295913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:44.303218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:44.303674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:44.304482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:44.304919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:44.364074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:44.371582 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1373d93f-8d22-44a2-8d82-9509c53125b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080283 Apr 02 21:28:44.372157 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3362/6421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:44 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:45.389187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:45.389735 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:45.397146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:45.397599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:45.398365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:45.398805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:45.462527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:45.472045 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1543fba-414c-4f28-af25-ca02393a533a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086782 Apr 02 21:28:45.472657 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3060/6422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:45 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:46.487947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:46.488606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:46.495951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:46.496407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:46.497210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:46.497653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:46.558637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:46.565972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22304386-9366-4a38-b2f2-24630e9658a2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081982 Apr 02 21:28:46.566544 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3363/6423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:46 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:47.582992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:47.583605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:47.590396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:47.590848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:47.591611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:47.592052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:47.650005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:47.657727 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f5d4cb88-2dfd-4959-8946-5c0aa0f7a14e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079133 Apr 02 21:28:47.658086 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3061/6424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:47 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:48.674267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:48.674896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:48.682185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:48.682655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:48.683430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:48.683880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:48.748669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:48.756201 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8237d54d-1962-4d20-b903-429a1e7c19ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085894 Apr 02 21:28:48.756816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3364/6425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:48 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:49.772173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:49.772825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:49.779339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:49.779799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:49.780602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:49.781049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:49.839655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:49.848282 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-15bde3fe-3bcc-4c19-a5f7-45b4329e1f7d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080002 Apr 02 21:28:49.849028 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3062/6426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:49 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:50.866811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:50.867390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:50.874042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:50.874502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:50.875277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:50.875723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:50.935655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:50.943108 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b4cf4fa-3955-4187-98c9-1db816d835ce tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080391 Apr 02 21:28:50.943685 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3365/6427] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:50 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:51.959233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:51.959851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:51.966625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:51.967083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:51.967884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:51.968329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:52.026625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:52.034773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-62e9788f-6332-44df-988b-35e064fb9959 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079481 Apr 02 21:28:52.035347 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3063/6428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:51 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:53.051398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:53.052019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:53.058917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:53.059399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:53.060182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:53.060658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:53.120091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:53.127971 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3402ff35-fbd4-40f0-b2d4-7d544d4cf3a6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080501 Apr 02 21:28:53.128574 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3366/6429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:53 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:54.145196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:54.145814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:54.152866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:54.153324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:54.154093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:54.154546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:54.221354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:54.228876 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a1e9256-9fb6-4831-a25d-b47422b6a69a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.088100 Apr 02 21:28:54.229440 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3064/6430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:54 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:55.245968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:55.246613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:55.253405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:55.253868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:55.254644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:55.255088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:55.314569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:55.321996 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cbec0a0f-8f55-4676-96fa-f88a5dd9220d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080000 Apr 02 21:28:55.322577 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3367/6431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:55 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:56.338202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:56.338823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:56.346236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:56.346721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:56.348174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:56.348663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:56.414206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:56.421683 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc5f06c8-281a-4e49-b488-351d2fd1fa05 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087463 Apr 02 21:28:56.422255 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3065/6432] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:56 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:57.439802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:57.440445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:57.447486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:57.447946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:57.448752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:57.449203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:57.512469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:57.520587 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8eeb3f6-043d-4789-a875-eb7468c629b2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085202 Apr 02 21:28:57.521166 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3368/6433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:57 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:58.538140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:58.538753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:58.545506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:58.545967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:58.546727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:58.547167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:58.606505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:58.613985 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c9c8d944-48bf-429a-a6ac-9128b9021fb9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079729 Apr 02 21:28:58.614563 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3066/6434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:28:59.630650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:28:59.631270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:28:59.638133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:59.638603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:59.639380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:28:59.639834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:28:59.699305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:28:59.707026 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2981673e-4225-4702-b18d-afca7889b0da tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080324 Apr 02 21:28:59.707606 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3369/6435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:28:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:00.723398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:00.723938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:00.730371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:00.730829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:00.731627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:00.732073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:00.793589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:00.801637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13fdbc60-2cfd-4dc6-bc55-083881da6657 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082433 Apr 02 21:29:00.802214 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3067/6436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:00 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:01.818454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:01.818999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:01.825785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:01.826239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:01.827006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:01.827444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:01.892894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:01.900315 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-09725e64-96e5-40c4-8285-a7e8b08cbe67 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086032 Apr 02 21:29:01.900923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3370/6437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:01 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:02.917840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:02.918456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:02.925729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:02.926181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:02.926949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:02.927387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:02.985730 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:02.993426 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b08f2f92-2a2d-4d87-9764-3eb0712519e2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079503 Apr 02 21:29:02.994034 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3068/6438] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:02 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:04.010691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:04.011309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:04.018736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:04.019189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:04.019953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:04.020422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:04.079459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:04.086798 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05cdd71f-3c71-425d-9684-2accc4aaab22 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080073 Apr 02 21:29:04.087368 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3371/6439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:04 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:05.103756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:05.104365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:05.111171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:05.111669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:05.112445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:05.112910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:05.171488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:05.179318 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9e2bb708-7a38-464b-bc87-457a2570d607 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079476 Apr 02 21:29:05.179886 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3069/6440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:05 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:06.195768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:06.196481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:06.203504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:06.203965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:06.204775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:06.205218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:06.263942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:06.271425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e29a6df6-dfd0-4056-a31b-dcca6b444adf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079624 Apr 02 21:29:06.271994 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3372/6441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:06 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:07.288726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:07.289262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:07.296054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:07.296555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:07.297337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:07.297790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:07.357301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:07.364783 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc325db4-9238-4577-96ac-d0aba3f9592e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080061 Apr 02 21:29:07.365364 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3070/6442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:07 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:08.382297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:08.382902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:08.389663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:08.390120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:08.390913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:08.391340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:08.451357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:08.459762 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d0a5570e-787c-4f12-a67a-09c2b8521116 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081372 Apr 02 21:29:08.460314 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3373/6443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:08 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:29:09.477028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:09.477673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:09.486114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:09.487526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:09.488992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:09.489793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:09.556920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:09.564367 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a948c9c7-e1ae-4cb2-b6d0-ef029af6874e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.091350 Apr 02 21:29:09.564978 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3071/6444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:09 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:10.581529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:10.582155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:10.589043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:10.589516 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:10.590298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:10.590748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:10.652968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:10.660677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bad857c2-3593-4742-b458-ecfdbe57e926 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083179 Apr 02 21:29:10.661257 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3374/6445] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:10 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:11.677270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:11.677883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:11.684627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:11.685081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:11.685843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:11.686284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:11.744150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:11.751394 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a834deeb-b193-4a47-8da0-0ff15887c920 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078010 Apr 02 21:29:11.751960 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3072/6446] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:11 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:12.768119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:12.768733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:12.775443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:12.775899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:12.776705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:12.777153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:12.836574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:12.844076 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1cf28a37-37f4-48fb-9f23-81e51d6d6def tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079931 Apr 02 21:29:12.844678 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3375/6447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:12 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:13.861418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:13.861969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:13.869331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:13.869791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:13.870556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:13.870998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:13.929125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:13.936383 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-570303d0-f598-450d-b677-37366cec61c2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078964 Apr 02 21:29:13.936983 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3073/6448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:13 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:14.953147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:14.953765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:14.961216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:14.961671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:14.962436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:14.962877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:15.024096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:15.031432 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9b6356fe-e013-43a3-94a9-ff89c9970a84 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082229 Apr 02 21:29:15.032001 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3376/6449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:14 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:16.048615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:16.049233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:16.056127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:16.056622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:16.057617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:16.057835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:16.120535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:16.128341 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09f2ed34-8c06-4053-b763-e5cf2ecaa085 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.083106 Apr 02 21:29:16.128938 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3074/6450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:16 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:17.145699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:17.146313 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:17.153068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:17.153527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:17.154294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:17.154734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:17.214038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:17.222760 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b1f7f39-33ee-4535-9549-db7902ec6ce8 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080191 Apr 02 21:29:17.223278 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3377/6451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:17 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:18.239214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:18.239836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:18.246444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:18.246937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:18.247713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:18.248155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:18.306665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:18.313994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-96c2c37f-dce1-48fc-bd90-3ce79199d306 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078720 Apr 02 21:29:18.314570 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3075/6452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:18 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:19.331016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:19.332582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:19.339588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:19.340044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:19.340843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:19.341285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:19.400465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:19.408180 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87a8cb9a-d85f-43d0-b1f4-fed219c997c7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081188 Apr 02 21:29:19.408803 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3378/6453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:19 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:20.425206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:20.425834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:20.432943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:20.433565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:20.434350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:20.434805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:20.495323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:20.502820 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d9bbed8-a2cb-48e0-8db1-5775e108f10f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081526 Apr 02 21:29:20.503902 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3076/6454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:20 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:21.519785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:21.520404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:21.527490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:21.527941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:21.528741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:21.529181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:21.588216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:21.595789 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0d2570e-da12-4ae0-b826-619ff64cebdf tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080570 Apr 02 21:29:21.596357 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3379/6455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:21 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:22.612566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:22.613179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:22.619891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:22.620370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:22.621162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:22.621600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:22.687708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:22.695212 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91fec2ae-a496-4720-82c4-0e7d592c2fe3 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086621 Apr 02 21:29:22.695784 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3077/6456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:22 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:23.712759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:23.713306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:23.720035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:23.720526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:23.721303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:23.721751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:23.785669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:23.793192 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f47cc8b7-6452-4158-a493-b66bd57517d0 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084498 Apr 02 21:29:23.793787 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3380/6457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:23 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:24.809953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:24.810505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:24.817409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:24.817879 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:24.818657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:24.819110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:24.879162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:24.886757 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57fcc9ad-703a-46c3-a752-d20f6f9bcb24 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080758 Apr 02 21:29:24.887337 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3078/6458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:24 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:25.903320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:25.903920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:25.911046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:25.911500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:25.912301 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:25.912775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:25.970953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:25.978610 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-82578295-2483-4251-b3ab-7938a8e7cce4 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079277 Apr 02 21:29:25.979177 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3381/6459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:25 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:26.995100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:26.995663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:27.002453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:27.002907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:27.003670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:27.004110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:27.062737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:27.069976 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ebeb4182-3da3-44ec-add5-574ac6b1ada5 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078818 Apr 02 21:29:27.070544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3079/6460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:26 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:28.086625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:28.087249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:28.094025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:28.094485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:28.095255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:28.095714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:28.156947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:28.165043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c4122648-a682-40c6-99a3-d70968351a51 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082349 Apr 02 21:29:28.165619 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3382/6461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:28 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:29.181633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:29.182253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:29.188854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:29.189317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:29.190096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:29.190546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:29.248810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:29.256138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-df3c3df2-0b6a-4f85-9aeb-d7d76b7cb5ff tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078662 Apr 02 21:29:29.256746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3080/6462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:29 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:30.273511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:30.274120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:30.280904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:30.281357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:30.282121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:30.282566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:30.342658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:30.350381 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0cbbb2c2-920c-495d-9143-608c4e914162 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081452 Apr 02 21:29:30.350953 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3383/6463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:30 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:31.367853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:31.368426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:31.375239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:31.375703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:31.376505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:31.376961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:31.435913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:31.446186 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3119b261-42cf-4753-87fa-8a2169891198 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082285 Apr 02 21:29:31.446781 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3081/6464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:31 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:32.463175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:32.463803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:32.470744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:32.471204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:32.471990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:32.472433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:32.531577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:32.539996 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-869228f2-ca2f-494c-b3c7-74322e35205c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080706 Apr 02 21:29:32.540595 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3384/6465] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:32 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:33.557207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:33.557864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:33.564948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:33.565402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:33.566707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:33.567174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:33.626903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:33.635038 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0858a73b-1e89-4101-9d92-3266480bda64 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082152 Apr 02 21:29:33.635612 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3082/6466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:33 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:34.651509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:34.652127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:34.659206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:34.660292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:34.661092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:34.661535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:34.720373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:34.728438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b260f260-54ee-4972-8ab5-540d289a5ce6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080879 Apr 02 21:29:34.729030 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3385/6467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:34 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:35.745170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:35.745727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:35.752589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:35.753050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:35.754355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:35.754801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:35.819826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:35.827317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de5a53ff-2282-445e-be56-4fe5ad588555 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.086163 Apr 02 21:29:35.827912 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3083/6468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:35 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:36.844240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:36.844905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:36.852222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:36.852715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:36.853484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:36.853924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:36.917605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:36.924930 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3704251-fc49-4b41-8c3b-1cd3e874463b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084583 Apr 02 21:29:36.926019 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3386/6469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:36 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:37.941251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:37.941868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:37.948603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:37.949057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:37.949842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:37.950282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:38.008542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:38.015821 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b440d2d9-a6bc-4c9b-b07b-7e657c8eb622 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078485 Apr 02 21:29:38.016384 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3084/6470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:37 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:39.032611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:39.033233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:39.041121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:39.041575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:39.042344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:39.042786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:39.101570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:39.109697 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9fc9c855-3cdb-4b58-a658-0477be72a28e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081024 Apr 02 21:29:39.110272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3387/6471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:39 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:40.128003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:40.129168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:40.135863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:40.136317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:40.137108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:40.137555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:40.197263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:40.204684 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-867074bb-dfc3-4488-aee3-82d18e0bbd3b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080655 Apr 02 21:29:40.205258 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3085/6472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:40 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:41.222209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:41.223434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:41.230253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:41.230709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:41.231472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:41.231912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:41.293159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:41.300559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-327f4edc-46fb-48f5-85a4-863afe410484 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082205 Apr 02 21:29:41.301136 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3388/6473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:41 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:42.317645 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:42.318255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:42.325164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:42.325618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:42.326386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:42.326857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:42.385885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:42.393213 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-143d24f8-328f-43c3-ae13-2b446ed3749c tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.079966 Apr 02 21:29:42.393778 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3086/6474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:42 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:43.411455 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:43.412074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:43.418600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:43.419052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:43.419820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:43.420258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:43.479880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:43.487564 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10aa698f-a93b-40ab-8ba8-18bba215ac1d tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080896 Apr 02 21:29:43.488185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3389/6475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:43 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:44.505144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:44.505770 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:44.512697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:44.513165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:44.513943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:44.514395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:44.574206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:44.581939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b849d6e-a560-4040-94de-4b6027eb6556 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.081576 Apr 02 21:29:44.582524 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3087/6476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:44 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:45.599160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:45.599774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:45.606669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:45.607124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:45.607886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:45.608335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:45.667793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:45.675306 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-92339b18-0598-42eb-bf93-33d98ca95ef2 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080591 Apr 02 21:29:45.676398 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3390/6477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:45 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:46.693283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:46.694430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:46.703822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:46.704277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:46.705176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:46.705764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:46.765368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:46.773402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2d179c2-9b80-4ed2-be06-533d9e024183 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084719 Apr 02 21:29:46.773974 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3088/6478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:46 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:47.790879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:47.791429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:47.798201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:47.798663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:47.799436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:47.799882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:47.859068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:47.867133 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c05638dd-8fd6-47e6-97cc-0906ea170fbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080282 Apr 02 21:29:47.867712 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3391/6479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:47 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:48.883810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:48.884358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:48.890914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:48.891376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:48.892144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:48.892621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:48.957681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:48.965157 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-19e2e4ba-fe5c-47f6-9eb4-49dca074905b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085332 Apr 02 21:29:48.965731 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3089/6480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:48 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:49.982692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:49.983314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:49.990372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:49.990831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:49.991607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:49.992053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:50.055872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:50.063364 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-731935ee-e2ff-4a50-9716-54eb6d38410a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.084829 Apr 02 21:29:50.063943 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3392/6481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:49 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:51.080257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:51.080898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:51.087641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:51.088095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:51.088892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:51.089333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:51.147676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:51.155338 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dae47d7e-0761-4afd-bc55-24d658db6f4f tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.078965 Apr 02 21:29:51.155905 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3090/6482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:51 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:52.171983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:52.172649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:52.179485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:52.179945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:52.180757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:52.181203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:52.240634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:52.248092 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b31c709a-1282-41dd-bf0b-b8d45503ed2e tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080066 Apr 02 21:29:52.248730 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3393/6483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:52 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:53.265226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:53.265764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:53.273593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:53.274090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:53.274874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:53.275328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:53.334728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:53.341948 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3806f293-c25d-45c7-a2ba-68e2acb77e04 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080729 Apr 02 21:29:53.342516 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3091/6484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:53 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:54.190412 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:29:54.190668 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:29:54.359430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:54.360090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:54.366966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:54.367423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:54.368305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:54.368771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:54.433733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:54.441289 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6db64c19-41fa-40e0-8535-84c2e20fc0a7 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.085662 Apr 02 21:29:54.442540 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3394/6485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:54 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:55.458969 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:55.459610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:55.466445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:55.466901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:55.467669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:55.468113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:55.527454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:55.535185 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f31a5d92-efdd-4c31-b898-45fa1c298c2b tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080283 Apr 02 21:29:55.535746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3092/6486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:55 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:56.551530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:56.552153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:56.558923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:56.559381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:56.560163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:56.560645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:56.621722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:56.629696 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef3fbe1a-9de4-4779-9b69-c9aa0258844a tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.082602 Apr 02 21:29:56.630268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3395/6487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:56 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:57.646356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:57.646981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:57.654290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:57.654758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:57.655539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:57.655991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:57.714923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:57.722517 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5531ae69-acc4-4455-ab0c-73cfad3bd500 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.080082 Apr 02 21:29:57.723132 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3093/6488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:57 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:58.739319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:58.739873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:58.746988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:58.747460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:58.748239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:58.748720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:58.814977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb67e8ec9b44d6f89640b4ccabd1987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac7776ae2fb45cfa015c4056f0ab4a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:29:58.823152 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61984934-370c-48c2-a34f-3cf5470a16d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 200 len: 1145 microversion: 2.1 time: 0.087946 Apr 02 21:29:58.823726 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3396/6489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:58 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:29:58.839182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:58.839678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:58.846398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:58.846897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:58.847682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:58.848198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:58.871459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:29:58.880883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:58.881338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:58.928153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lazy-loading 'flavor' on Instance uuid 467961f4-9252-4447-a1be-0f97e122bef6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:29:58.939191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lazy-loading 'system_metadata' on Instance uuid 467961f4-9252-4447-a1be-0f97e122bef6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:29:58.989543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lazy-loading 'metadata' on Instance uuid 467961f4-9252-4447-a1be-0f97e122bef6 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:29:59.193008 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-92c07774-4744-414d-a17b-1a1c998f22d6 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "DELETE /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 204 len: 0 microversion: 2.1 time: 0.357589 Apr 02 21:29:59.193626 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3094/6490] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:29:58 2022] DELETE /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:29:59.201735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:59.202382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] [instance: 467961f4-9252-4447-a1be-0f97e122bef6] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:29:59.208898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:59.209365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:59.210141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:29:59.210586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:29:59.224653 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] HTTP exception thrown: Instance 467961f4-9252-4447-a1be-0f97e122bef6 could not be found. Apr 02 21:29:59.225246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Returning 404 to user: Instance 467961f4-9252-4447-a1be-0f97e122bef6 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:29:59.226070 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d7946b3-4bde-493f-afdc-012c3eadecbc tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6" status: 404 len: 111 microversion: 2.1 time: 0.028343 Apr 02 21:29:59.226607 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3397/6491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:29:59 2022] GET /compute/v2.1/servers/467961f4-9252-4447-a1be-0f97e122bef6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:29:59.429749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8eb190b6-2369-4c32-8536-6c8b24181ed9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] Calling method '.version_select at 0x7f54c77e9b80>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:29:59.455029 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8eb190b6-2369-4c32-8536-6c8b24181ed9 tempest-TestVolumeBackupRestore-163528694 tempest-TestVolumeBackupRestore-163528694-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-395673106" status: 202 len: 0 microversion: 2.1 time: 0.029450 Apr 02 21:29:59.455990 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3095/6492] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Apr 2 21:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-395673106 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:30:18.958935 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:30:18.959642 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:30:25.847856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1312035523", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9342a8a0-eb55-4b5d-bcc7-d568064a1279", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "42da5f51-4ee8-4338-9167-b7fb170cce38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:25.935763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] validate_networks() for [('42da5f51-4ee8-4338-9167-b7fb170cce38', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:30:26.329559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:30:26.329992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:30:26.330468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:30:26.330880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:30:26.331300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:30:26.341034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:26.341488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:26.342300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:26.342926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:26.361115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:30:26.366819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:30:26.379462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:30:26.381484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9342a8a0-eb55-4b5d-bcc7-d568064a1279',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:30:26.452780 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f7c2747-78ea-4eb7-8501-b39df538aa0f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608723 Apr 02 21:30:26.453764 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3398/6493] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:30:26.465485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c09fed4-2b96-4220-bf23-bddda64483f1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:26.466110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4c09fed4-2b96-4220-bf23-bddda64483f1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:26.517683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4c09fed4-2b96-4220-bf23-bddda64483f1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:26.524950 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c09fed4-2b96-4220-bf23-bddda64483f1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1057 microversion: 2.1 time: 0.064617 Apr 02 21:30:26.525521 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3096/6494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:26 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1057 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:27.549671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:27.550296 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:27.565373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:27.565859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:27.566872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:27.567315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:27.633294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:27.641018 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96e96a8d-1d74-4ab6-a14c-c6c575409b37 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1117 microversion: 2.1 time: 0.102654 Apr 02 21:30:27.641597 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3399/6495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:27 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1117 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:28.658351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:28.658985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:28.667175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:28.667649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:28.669062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:28.669847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:28.916356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:28.923939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-06a96df8-eeaf-4ff1-931f-dc6a71bdff3e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1169 microversion: 2.1 time: 0.269653 Apr 02 21:30:28.924694 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3097/6496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:28 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1169 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:29.157884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f657beab-bad3-49ed-a273-6099ac04cb78 req-7cad25a9-c5a3-44ee-94a6-0a91696e7142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f2c1d2-1534-44c7-8f04-6b4ce250e520", "tag": "59f03a54-45ed-4e09-8244-64eda84d2c01"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:29.166802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f657beab-bad3-49ed-a273-6099ac04cb78 req-7cad25a9-c5a3-44ee-94a6-0a91696e7142 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:29.167537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f657beab-bad3-49ed-a273-6099ac04cb78 req-7cad25a9-c5a3-44ee-94a6-0a91696e7142 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:29.182561 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f657beab-bad3-49ed-a273-6099ac04cb78 req-7cad25a9-c5a3-44ee-94a6-0a91696e7142 service nova] Creating event network-changed:59f03a54-45ed-4e09-8244-64eda84d2c01 for instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 on nch2-master-1 Apr 02 21:30:29.188430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f657beab-bad3-49ed-a273-6099ac04cb78 req-7cad25a9-c5a3-44ee-94a6-0a91696e7142 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194636 Apr 02 21:30:29.189550 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3400/6497] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:30:29.941263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:29.941971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:29.948861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:29.949329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:29.950148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:29.950661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:30.089907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:30.097253 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ddf3d55f-16d1-462d-a8c7-15754aac5638 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1169 microversion: 2.1 time: 0.159929 Apr 02 21:30:30.097812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3098/6498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:29 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:31.115998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:31.116741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:31.123049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:31.123507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:31.124280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:31.124745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:31.264982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:31.272442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b6c61eab-141b-44eb-b964-f61a09d70b3a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1169 microversion: 2.1 time: 0.161539 Apr 02 21:30:31.276494 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3401/6499] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:31 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1169 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:32.291753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:32.292448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:32.300519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:32.300981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:32.301757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:32.302205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:32.442061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:32.450252 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e44bb7c6-f3c0-4a08-85bb-8ca413d4c038 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1203 microversion: 2.1 time: 0.164695 Apr 02 21:30:32.450833 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3099/6500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:32 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:33.467423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:33.468047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:33.475864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:33.476337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:33.477493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:33.477993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:33.613921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:33.621258 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fab34bcc-e7b7-43e4-813f-eb24920728ce tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1203 microversion: 2.1 time: 0.157956 Apr 02 21:30:33.621836 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3402/6501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:33 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:34.638365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:34.638991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:34.645813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:34.646282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:34.647095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:34.647540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:34.777359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:34.784818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2e8aa4e-817f-46ac-bc81-1b0bb006986c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1203 microversion: 2.1 time: 0.150396 Apr 02 21:30:34.785388 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3100/6502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:34 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:35.802316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:35.802932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:35.809919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:35.810382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:35.811161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:35.811610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:35.948347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:35.956115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f08cdfe-73c9-491c-a274-410758ebd031 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1203 microversion: 2.1 time: 0.157637 Apr 02 21:30:35.956727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3403/6503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:35 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:36.973030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:36.973633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:36.980991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:36.981452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:36.982220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:36.982663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:37.112398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:37.119781 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-583da0b5-2aaa-402c-a0c4-03c4151e2bc3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1203 microversion: 2.1 time: 0.150637 Apr 02 21:30:37.120351 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3101/6504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:36 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:37.786990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-95a408ab-2ec1-4a68-b8df-abb09432ca39 req-a9967398-160b-4a61-b8df-9eaf85e22939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f2c1d2-1534-44c7-8f04-6b4ce250e520", "name": "network-vif-plugged", "status": "completed", "tag": "59f03a54-45ed-4e09-8244-64eda84d2c01"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:37.795430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-95a408ab-2ec1-4a68-b8df-abb09432ca39 req-a9967398-160b-4a61-b8df-9eaf85e22939 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:37.795880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-95a408ab-2ec1-4a68-b8df-abb09432ca39 req-a9967398-160b-4a61-b8df-9eaf85e22939 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:37.807473 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-95a408ab-2ec1-4a68-b8df-abb09432ca39 req-a9967398-160b-4a61-b8df-9eaf85e22939 service nova] Creating event network-vif-plugged:59f03a54-45ed-4e09-8244-64eda84d2c01 for instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 on nch2-master-1 Apr 02 21:30:37.812961 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-95a408ab-2ec1-4a68-b8df-abb09432ca39 req-a9967398-160b-4a61-b8df-9eaf85e22939 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095423 Apr 02 21:30:37.813573 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3404/6505] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:30:38.136310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:38.137098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:38.143881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:38.144339 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:38.145137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:38.145581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:38.273779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:38.281234 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4612c28c-75d8-45f4-8ac9-90f40fb9be6e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1203 microversion: 2.1 time: 0.148737 Apr 02 21:30:38.281804 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3102/6506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:38 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:39.299859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:39.300503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:39.307598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.308064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.308872 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.309325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.442419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:39.450515 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35a36f78-70f7-445b-bd02-bf2db9ee915e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1389 microversion: 2.1 time: 0.155105 Apr 02 21:30:39.451099 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3405/6507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:39 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:39.467069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:39.467682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:39.474358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.474810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.475600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.476037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.609041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:39.616894 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e909dc4-91e1-4480-beaa-07eb892d12c7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1389 microversion: 2.1 time: 0.153604 Apr 02 21:30:39.617459 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3103/6508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:39 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:39.633334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:39.633983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:39.639871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.640335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.641142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.641592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.777088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:39.784701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c3888384-a6a4-4cfa-9f33-bc849be2a488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1389 microversion: 2.1 time: 0.155912 Apr 02 21:30:39.785274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3406/6509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:39 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:39.853217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:39.853728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:39.859838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.860292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.861140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.861582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.886874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:30:39.961612 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 204 len: 0 microversion: 2.1 time: 0.112586 Apr 02 21:30:39.963354 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3104/6510] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:30:39 2022] DELETE /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:30:39.971970 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:39.972668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:39.979212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.979675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:39.980469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:39.980959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:40.111997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:40.119643 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a0194e30-bae3-482f-9e46-bd9f5b5c20ec tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1395 microversion: 2.1 time: 0.151892 Apr 02 21:30:40.120219 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3407/6511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:39 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:41.137589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:41.138295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:41.145090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:41.145551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:41.146324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:41.146771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:41.279726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:41.287468 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f78965d-cae7-4848-9f15-4a948cc44c65 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1395 microversion: 2.1 time: 0.154170 Apr 02 21:30:41.288662 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3105/6512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:41 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:42.117985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-4b70e051-8732-4bac-ade1-0215259816ad req-40d7b251-5a71-4313-8c64-c8e14950c996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f2c1d2-1534-44c7-8f04-6b4ce250e520", "name": "network-vif-deleted", "tag": "59f03a54-45ed-4e09-8244-64eda84d2c01"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:42.128359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4b70e051-8732-4bac-ade1-0215259816ad req-40d7b251-5a71-4313-8c64-c8e14950c996 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:42.128950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-4b70e051-8732-4bac-ade1-0215259816ad req-40d7b251-5a71-4313-8c64-c8e14950c996 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:42.142962 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-4b70e051-8732-4bac-ade1-0215259816ad req-40d7b251-5a71-4313-8c64-c8e14950c996 service nova] Creating event network-vif-deleted:59f03a54-45ed-4e09-8244-64eda84d2c01 for instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 on nch2-master-1 Apr 02 21:30:42.149037 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-4b70e051-8732-4bac-ade1-0215259816ad req-40d7b251-5a71-4313-8c64-c8e14950c996 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Apr 02 21:30:42.149885 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3408/6513] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:30:42.305322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:42.306078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:42.314295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:42.315125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:42.316564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:42.317354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:42.387556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:42.396402 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f194e81-ebe5-4bc1-9ee3-4abc26051e40 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 200 len: 1188 microversion: 2.1 time: 0.095429 Apr 02 21:30:42.397070 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3106/6514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:42 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:43.415556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:43.416274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:43.422596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:43.423062 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:43.423840 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:43.424291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:43.437425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 could not be found. Apr 02 21:30:43.438075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:30:43.438915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f0c655d8-8d60-4c28-b6f0-2b8686287b58 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 404 len: 111 microversion: 2.1 time: 0.029427 Apr 02 21:30:43.439455 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3409/6515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:43 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:30:43.468668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:43.469207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:43.476488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:43.476948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:43.477749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:43.478198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:43.491036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 could not be found. Apr 02 21:30:43.491629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:30:43.492481 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a1031aa2-22f4-4e02-a7ad-f552ff24483c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 404 len: 111 microversion: 2.1 time: 0.027675 Apr 02 21:30:43.493012 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3107/6516] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:30:43 2022] DELETE /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:30:43.501004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:43.501628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: d7f2c1d2-1534-44c7-8f04-6b4ce250e520] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:43.507713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:43.508164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:43.508972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:43.509419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:43.523361 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 could not be found. Apr 02 21:30:43.523959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance d7f2c1d2-1534-44c7-8f04-6b4ce250e520 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:30:43.524910 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-27136918-7526-430f-8b40-9229d4a532b1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520" status: 404 len: 111 microversion: 2.1 time: 0.027673 Apr 02 21:30:43.525440 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3410/6517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:43 2022] GET /compute/v2.1/servers/d7f2c1d2-1534-44c7-8f04-6b4ce250e520 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:30:48.334820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1717328837", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1ead373a-9c05-40aa-bfaa-a7e5ab689d21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "42da5f51-4ee8-4338-9167-b7fb170cce38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:48.394929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] validate_networks() for [('42da5f51-4ee8-4338-9167-b7fb170cce38', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:30:48.782774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:30:48.783207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:30:48.783689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:30:48.784111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:30:48.784553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:30:48.793547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:48.794004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:48.794810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:48.795258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:48.812191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:30:48.817453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:30:48.874655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:30:48.876759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ead373a-9c05-40aa-bfaa-a7e5ab689d21',volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:30:48.995452 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2f1253f1-b7b9-44c6-934c-c3379c920044 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664450 Apr 02 21:30:48.996172 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3108/6518] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:30:49.006619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-576d7f80-a179-4846-bcf7-5f4cce65a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:49.007312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-576d7f80-a179-4846-bcf7-5f4cce65a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:49.061657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-576d7f80-a179-4846-bcf7-5f4cce65a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:49.068417 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-576d7f80-a179-4846-bcf7-5f4cce65a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1071 microversion: 2.1 time: 0.066041 Apr 02 21:30:49.069006 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3411/6519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:49 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1071 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:50.087004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:50.087838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:50.095220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:50.095675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:50.096522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:50.096940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:50.165689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:50.173572 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56ff31ee-3e38-4bec-b92b-529d5ede408b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1187 microversion: 2.1 time: 0.091840 Apr 02 21:30:50.174403 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3109/6520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:50 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:30:51.191888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:51.192549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:51.203871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:51.204404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:51.205237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:51.205694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:51.312001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5163d923-02b7-4fee-b977-7eb0e51e65ba req-b4bbc381-578d-439a-ad63-a6296387288e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda83762-1f41-4f9a-b100-ea1becc147d7", "tag": "e89078bf-5c7c-4354-a7ab-cccf80a19328"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:51.330393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5163d923-02b7-4fee-b977-7eb0e51e65ba req-b4bbc381-578d-439a-ad63-a6296387288e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:51.330778 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5163d923-02b7-4fee-b977-7eb0e51e65ba req-b4bbc381-578d-439a-ad63-a6296387288e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:51.345331 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5163d923-02b7-4fee-b977-7eb0e51e65ba req-b4bbc381-578d-439a-ad63-a6296387288e service nova] Creating event network-changed:e89078bf-5c7c-4354-a7ab-cccf80a19328 for instance fda83762-1f41-4f9a-b100-ea1becc147d7 on nch2-master-1 Apr 02 21:30:51.351971 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5163d923-02b7-4fee-b977-7eb0e51e65ba req-b4bbc381-578d-439a-ad63-a6296387288e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045950 Apr 02 21:30:51.353871 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3110/6521] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:30:51.383680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:51.393357 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ce7dc61d-535b-417b-b2df-2948517ebd1a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.206357 Apr 02 21:30:51.394300 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3412/6522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:51 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:52.411433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:52.412406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:52.419922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:52.420377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:52.421173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:52.421613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:52.661385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:52.669822 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37c1e6d6-f06e-4415-a52c-f59e086a69f3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.262574 Apr 02 21:30:52.670664 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3111/6523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:52 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:53.686829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:53.687444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:53.694874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:53.695335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:53.696108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:53.696600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:53.827574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:53.835701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21e67251-9e1f-4088-8386-4fb2d66ad76a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.152223 Apr 02 21:30:53.836282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3413/6524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:53 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:54.852952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:54.853536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:54.860210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:54.860701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:54.861463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:54.861903 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:54.996994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:55.004344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-abd7adac-fda6-4b7a-85a3-3e47a008b488 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.156024 Apr 02 21:30:55.004936 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3112/6525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:54 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:56.022045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:56.023221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:56.030007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:56.030466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:56.031232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:56.031678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:56.165836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:56.174067 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3ce3a9c-f779-4442-bdc8-57594afc8d2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.155943 Apr 02 21:30:56.174706 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3414/6526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:56 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:57.191238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:57.191844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:57.198544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:57.198998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:57.199760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:57.200199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:57.338257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:57.345692 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-824255e1-eada-4936-b472-316ec6c9c2ee tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.158317 Apr 02 21:30:57.346444 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3113/6527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:57 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:57.833163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-546e7ae0-1a60-4bdc-b6ad-9d7b35f34cb6 req-de0087bb-61b6-4f54-9b9c-9af3ab32e4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda83762-1f41-4f9a-b100-ea1becc147d7", "name": "network-vif-plugged", "status": "completed", "tag": "e89078bf-5c7c-4354-a7ab-cccf80a19328"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:57.847352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-546e7ae0-1a60-4bdc-b6ad-9d7b35f34cb6 req-de0087bb-61b6-4f54-9b9c-9af3ab32e4c8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:57.847803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-546e7ae0-1a60-4bdc-b6ad-9d7b35f34cb6 req-de0087bb-61b6-4f54-9b9c-9af3ab32e4c8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:57.865309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-546e7ae0-1a60-4bdc-b6ad-9d7b35f34cb6 req-de0087bb-61b6-4f54-9b9c-9af3ab32e4c8 service nova] Creating event network-vif-plugged:e89078bf-5c7c-4354-a7ab-cccf80a19328 for instance fda83762-1f41-4f9a-b100-ea1becc147d7 on nch2-master-1 Apr 02 21:30:57.872366 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-546e7ae0-1a60-4bdc-b6ad-9d7b35f34cb6 req-de0087bb-61b6-4f54-9b9c-9af3ab32e4c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042964 Apr 02 21:30:57.873159 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3415/6528] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:30:58.362950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:58.363528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:58.370262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:58.370716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:58.371485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:58.371933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:58.508594 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:58.516021 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-83ff007a-3941-486c-85b3-0c1a327da24d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1217 microversion: 2.1 time: 0.157555 Apr 02 21:30:58.516621 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3114/6529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:58 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:59.534636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:59.535343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:59.542059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:59.542521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:59.543300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:59.543748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:59.680814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:59.688425 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be99917a-f7ff-46c0-960a-aa32e6140a92 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1403 microversion: 2.1 time: 0.158959 Apr 02 21:30:59.689020 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3416/6530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:59 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:59.705179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:30:59.705731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:59.712910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:59.713371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:59.714130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:59.714574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:59.846463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:30:59.853988 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc432922-cd40-40c0-960f-16d73a7e69b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1403 microversion: 2.1 time: 0.152867 Apr 02 21:30:59.854564 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3115/6531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:30:59 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:30:59.870544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1903148907"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:30:59.871596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:30:59.877631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:59.878091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:59.878868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:30:59.879317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:30:59.967374 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Attempting to quiesce instance before volume snapshot. Apr 02 21:31:00.026855 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Apr 02 21:31:00.092751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Creating snapshot from volume 1ead373a-9c05-40aa-bfaa-a7e5ab689d21. {{(pid=136518) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Apr 02 21:31:00.976380 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79663d51-be38-4177-b1d3-b5cd858f35f9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7/action" status: 202 len: 0 microversion: 2.1 time: 1.109516 Apr 02 21:31:00.977200 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3417/6532] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:30:59 2022] POST /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7/action => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 21:31:02.122410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1208607151", "imageRef": "c9912612-0fd8-4f06-9a0f-4bb162fbce96", "flavorRef": "452", "networks": [{"uuid": "42da5f51-4ee8-4338-9167-b7fb170cce38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:02.174294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] validate_networks() for [('42da5f51-4ee8-4338-9167-b7fb170cce38', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:31:02.568813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:31:02.569349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:31:02.569907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:31:02.570322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:31:02.570738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:31:02.580124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:02.580612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:02.581423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:02.581868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:02.598651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:31:02.604787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:31:02.617844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:31:02.620431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9fd47783-01ef-4651-a85b-c7d4215f24b8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:31:02.697112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3f753f92-171f-4b57-baf9-602d98feda29 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578252 Apr 02 21:31:02.700612 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3116/6533] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:31:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:31:02.708908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10d42ca5-8668-4db4-969d-f90e14e03664 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:02.709645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10d42ca5-8668-4db4-969d-f90e14e03664 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:02.772768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10d42ca5-8668-4db4-969d-f90e14e03664 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:02.779909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10d42ca5-8668-4db4-969d-f90e14e03664 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1230 microversion: 2.1 time: 0.076077 Apr 02 21:31:02.780504 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3418/6534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:02 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1230 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:31:03.798311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:03.799173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:03.806935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:03.807483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:03.808503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:03.808960 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:03.890046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:03.898829 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc87921b-9c32-4279-96c3-cf840d1fef5a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1300 microversion: 2.1 time: 0.105130 Apr 02 21:31:03.899421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3117/6535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:03 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:04.915904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:04.916612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:04.924599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:04.925075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:04.925881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:04.926329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:05.066945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-de941677-6e14-4de5-8438-acd8d7707b72 req-39df75dd-f780-44d6-8459-1158b2ced109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ce5aa87-2667-40ec-ab04-36860f059431", "tag": "90970c47-5454-4b40-a6cb-def9bb64b673"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:05.086142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de941677-6e14-4de5-8438-acd8d7707b72 req-39df75dd-f780-44d6-8459-1158b2ced109 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:05.087001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-de941677-6e14-4de5-8438-acd8d7707b72 req-39df75dd-f780-44d6-8459-1158b2ced109 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:05.102856 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-de941677-6e14-4de5-8438-acd8d7707b72 req-39df75dd-f780-44d6-8459-1158b2ced109 service nova] Creating event network-changed:90970c47-5454-4b40-a6cb-def9bb64b673 for instance 9ce5aa87-2667-40ec-ab04-36860f059431 on nch2-master-1 Apr 02 21:31:05.108919 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-de941677-6e14-4de5-8438-acd8d7707b72 req-39df75dd-f780-44d6-8459-1158b2ced109 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046633 Apr 02 21:31:05.110429 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3118/6536] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:31:05.121514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:05.133956 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-488ac97c-e3f1-427c-8f6e-196416afa0de tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1342 microversion: 2.1 time: 0.222618 Apr 02 21:31:05.144953 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3419/6537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:04 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1342 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:06.153020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:06.153724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:06.159871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:06.160275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:06.161075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:06.161520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:06.297963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:06.305255 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9009f132-2d9f-4928-af34-5d9a77a3a0f7 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1342 microversion: 2.1 time: 0.157883 Apr 02 21:31:06.305825 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3119/6538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:06 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:07.322651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:07.323280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:07.330133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:07.330597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:07.331375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:07.331831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:07.473760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:07.482194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7b6e3029-f0bb-4716-9ac1-3c7c2d855b5b tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1342 microversion: 2.1 time: 0.163830 Apr 02 21:31:07.482784 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3420/6539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:07 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:08.498804 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:08.499434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:08.506406 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:08.506867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:08.507659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:08.508116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:08.639450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:08.646976 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1beca2b-8363-497a-a9b0-a9df514a79b5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1376 microversion: 2.1 time: 0.152100 Apr 02 21:31:08.647552 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3120/6540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:08 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:09.664703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:09.665332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:09.672177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:09.672684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:09.673467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:09.673919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:09.805866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:09.813716 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05c2d0a0-7be8-49ac-b056-a3084778dca0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1376 microversion: 2.1 time: 0.153799 Apr 02 21:31:09.814286 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3421/6541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:09 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:10.831221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:10.831765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:10.838642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:10.839154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:10.839929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:10.840372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:10.980533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:10.988150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b7d4c50-823d-4e02-a87b-a6ff5474a0c1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1376 microversion: 2.1 time: 0.160980 Apr 02 21:31:10.988759 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3121/6542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:10 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:12.007177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:12.008165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:12.016399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:12.017020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:12.017862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:12.018318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:12.161915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:12.170672 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-13c26335-e69b-41fa-bdd5-9abfff6a4087 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1376 microversion: 2.1 time: 0.168357 Apr 02 21:31:12.171246 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3422/6543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:12 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:13.187738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:13.188364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:13.195254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:13.195715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:13.196513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:13.196966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:13.332507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:13.339865 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6eacf406-b55c-4052-b95b-1b0b0fb3eab0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1376 microversion: 2.1 time: 0.156081 Apr 02 21:31:13.340445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3122/6544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:13 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:13.936797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f3203deb-7691-41b8-ae6a-d067289fbd52 req-945dafe6-77f5-4c0c-8a8f-4f0ad66ff21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce5aa87-2667-40ec-ab04-36860f059431", "name": "network-vif-plugged", "status": "completed", "tag": "90970c47-5454-4b40-a6cb-def9bb64b673"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:13.946539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f3203deb-7691-41b8-ae6a-d067289fbd52 req-945dafe6-77f5-4c0c-8a8f-4f0ad66ff21b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:13.947045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f3203deb-7691-41b8-ae6a-d067289fbd52 req-945dafe6-77f5-4c0c-8a8f-4f0ad66ff21b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:13.959386 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f3203deb-7691-41b8-ae6a-d067289fbd52 req-945dafe6-77f5-4c0c-8a8f-4f0ad66ff21b service nova] Creating event network-vif-plugged:90970c47-5454-4b40-a6cb-def9bb64b673 for instance 9ce5aa87-2667-40ec-ab04-36860f059431 on nch2-master-1 Apr 02 21:31:13.964984 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f3203deb-7691-41b8-ae6a-d067289fbd52 req-945dafe6-77f5-4c0c-8a8f-4f0ad66ff21b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Apr 02 21:31:13.965613 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3423/6545] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:31:14.358145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:14.358695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:14.364762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:14.365222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:14.365991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:14.366440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:14.504441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:14.512583 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-952410e6-e0f3-4d64-a007-b303a5143fa2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1376 microversion: 2.1 time: 0.160043 Apr 02 21:31:14.513153 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3123/6546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:14 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:15.530958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:15.531686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:15.539026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:15.539503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:15.540293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:15.540787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:15.674760 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:15.682299 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be3258c5-c100-4c06-81df-19fe3fee2352 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1561 microversion: 2.1 time: 0.155775 Apr 02 21:31:15.683391 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3424/6547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:15 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:15.699399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:15.700016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:15.706768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:15.707167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:15.707938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:15.708384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:15.839638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:15.847233 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b0c1ad6a-ef8f-46ff-84e3-1c834263025a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1561 microversion: 2.1 time: 0.152332 Apr 02 21:31:15.847826 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3124/6548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:15 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:15.914691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:15.915207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:15.921639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:15.922157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:15.922939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:15.923397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:15.948212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:31:16.025837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ec07a432-93df-4142-9eb0-f3a55c0f00ca tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 204 len: 0 microversion: 2.1 time: 0.114516 Apr 02 21:31:16.026587 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3425/6549] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:31:15 2022] DELETE /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:31:16.034530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:16.035149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:16.041386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:16.041840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:16.043127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:16.043547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:16.176685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:16.184774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67a9a34f-ee65-45d0-bea7-e054fade9462 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1567 microversion: 2.1 time: 0.154105 Apr 02 21:31:16.185348 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3125/6550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:16 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:17.202973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:17.203692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:17.210494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:17.210964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:17.211749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:17.212206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:17.350786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:17.360103 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8ec560bd-1b76-4c30-9114-460733da8e41 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1567 microversion: 2.1 time: 0.161316 Apr 02 21:31:17.360789 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3426/6551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:17 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:18.249779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3376e91a-7ca8-4cb1-9222-b1b7adaac09c req-01eb610f-33ad-4142-9861-c0e96ac08faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce5aa87-2667-40ec-ab04-36860f059431", "name": "network-vif-deleted", "tag": "90970c47-5454-4b40-a6cb-def9bb64b673"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:18.259591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3376e91a-7ca8-4cb1-9222-b1b7adaac09c req-01eb610f-33ad-4142-9861-c0e96ac08faa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:18.260301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3376e91a-7ca8-4cb1-9222-b1b7adaac09c req-01eb610f-33ad-4142-9861-c0e96ac08faa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:18.273444 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3376e91a-7ca8-4cb1-9222-b1b7adaac09c req-01eb610f-33ad-4142-9861-c0e96ac08faa service nova] Creating event network-vif-deleted:90970c47-5454-4b40-a6cb-def9bb64b673 for instance 9ce5aa87-2667-40ec-ab04-36860f059431 on nch2-master-1 Apr 02 21:31:18.279876 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3376e91a-7ca8-4cb1-9222-b1b7adaac09c req-01eb610f-33ad-4142-9861-c0e96ac08faa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038780 Apr 02 21:31:18.280740 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3126/6552] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:31:18.377094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:18.378513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:18.385404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:18.385877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:18.386662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:18.387236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:18.454436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:18.462088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-79720081-b7e0-472b-864d-c32941f85ce3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 200 len: 1361 microversion: 2.1 time: 0.089156 Apr 02 21:31:18.462674 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3427/6553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:18 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:19.480534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:19.481251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:19.487570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:19.488032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:19.488840 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:19.489294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:19.502823 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 9ce5aa87-2667-40ec-ab04-36860f059431 could not be found. Apr 02 21:31:19.503426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 9ce5aa87-2667-40ec-ab04-36860f059431 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:31:19.504266 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ddd80e82-4cea-4a4d-8fd9-ecedd97a5c2e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 404 len: 111 microversion: 2.1 time: 0.028953 Apr 02 21:31:19.504834 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3127/6554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:19 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:50.434275 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:50.434909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:50.441428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:50.441932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:50.442719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:50.443166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:50.473005 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:31:50.555938 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e7e5942-cc53-4e82-b44a-fbda947dafaa tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 204 len: 0 microversion: 2.1 time: 0.125226 Apr 02 21:31:50.556652 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3428/6555] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:31:50 2022] DELETE /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:31:50.566978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:50.567703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:50.575254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:50.575710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:50.576557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:50.577182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:50.723039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:50.731759 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fda72ef-d87f-4f40-863d-e14c5bbde8f5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1409 microversion: 2.1 time: 0.169722 Apr 02 21:31:50.732396 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3128/6556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:50 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:51.749676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:51.750372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:51.757312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:51.757781 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:51.758566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:51.759022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:51.893584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:51.901700 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-01a64023-89a9-4fa3-ae67-fb340ef40f00 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1409 microversion: 2.1 time: 0.156440 Apr 02 21:31:51.902282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3429/6557] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:51 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:52.753801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f39dc41f-e425-475c-89c9-63662519a324 req-49160325-53f3-4cb6-8b40-34737600ee15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda83762-1f41-4f9a-b100-ea1becc147d7", "name": "network-vif-deleted", "tag": "e89078bf-5c7c-4354-a7ab-cccf80a19328"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:52.763842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f39dc41f-e425-475c-89c9-63662519a324 req-49160325-53f3-4cb6-8b40-34737600ee15 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:52.764298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f39dc41f-e425-475c-89c9-63662519a324 req-49160325-53f3-4cb6-8b40-34737600ee15 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:52.776353 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f39dc41f-e425-475c-89c9-63662519a324 req-49160325-53f3-4cb6-8b40-34737600ee15 service nova] Creating event network-vif-deleted:e89078bf-5c7c-4354-a7ab-cccf80a19328 for instance fda83762-1f41-4f9a-b100-ea1becc147d7 on nch2-master-1 Apr 02 21:31:52.781446 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f39dc41f-e425-475c-89c9-63662519a324 req-49160325-53f3-4cb6-8b40-34737600ee15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031338 Apr 02 21:31:52.782052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3129/6558] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:31:52.918648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:52.919280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:52.925981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:52.926457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:52.927243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:52.927696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:52.992279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:53.002209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2f93421f-64d3-41be-8b39-b607c9fd7bb8 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 200 len: 1202 microversion: 2.1 time: 0.087229 Apr 02 21:31:53.011820 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3430/6559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:52 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:54.020904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:54.021530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:54.028325 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.028802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.029560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.029996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.043732 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance fda83762-1f41-4f9a-b100-ea1becc147d7 could not be found. Apr 02 21:31:54.044316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance fda83762-1f41-4f9a-b100-ea1becc147d7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:31:54.045173 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13c6acd4-1b81-45bb-956b-cd1764f5fc0a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 404 len: 111 microversion: 2.1 time: 0.029524 Apr 02 21:31:54.045687 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3130/6560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:54 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:54.074205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:54.074747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:54.081426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.081888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.082663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.083115 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.096479 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 9ce5aa87-2667-40ec-ab04-36860f059431 could not be found. Apr 02 21:31:54.097080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 9ce5aa87-2667-40ec-ab04-36860f059431 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:31:54.097909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0ea0ab67-f467-451a-bf29-ef73356128f0 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 404 len: 111 microversion: 2.1 time: 0.027657 Apr 02 21:31:54.098431 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3431/6561] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:31:54 2022] DELETE /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:54.106921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:54.107548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9ce5aa87-2667-40ec-ab04-36860f059431] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:54.113494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.113954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.114729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.115179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.128125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 9ce5aa87-2667-40ec-ab04-36860f059431 could not be found. Apr 02 21:31:54.128783 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 9ce5aa87-2667-40ec-ab04-36860f059431 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:31:54.129605 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ea104c4b-75fc-492d-b27f-3e402ba21fc2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431" status: 404 len: 111 microversion: 2.1 time: 0.027231 Apr 02 21:31:54.130120 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3131/6562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:54 2022] GET /compute/v2.1/servers/9ce5aa87-2667-40ec-ab04-36860f059431 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:54.488059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:54.488599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:54.494541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.495006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.495783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.496232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.509391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance fda83762-1f41-4f9a-b100-ea1becc147d7 could not be found. Apr 02 21:31:54.510550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance fda83762-1f41-4f9a-b100-ea1becc147d7 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:31:54.511379 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e323cc9-4479-41cd-bfe1-648926554b1e tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 404 len: 111 microversion: 2.1 time: 0.027254 Apr 02 21:31:54.511905 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3432/6563] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:31:54 2022] DELETE /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:54.519838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:54.520555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: fda83762-1f41-4f9a-b100-ea1becc147d7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:54.527392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.527786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.528579 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:54.529022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:54.542274 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance fda83762-1f41-4f9a-b100-ea1becc147d7 could not be found. Apr 02 21:31:54.542864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance fda83762-1f41-4f9a-b100-ea1becc147d7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:31:54.543690 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fc628297-0ec9-41c5-b373-9d9139e74662 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7" status: 404 len: 111 microversion: 2.1 time: 0.027720 Apr 02 21:31:54.544212 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3132/6564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:54 2022] GET /compute/v2.1/servers/fda83762-1f41-4f9a-b100-ea1becc147d7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:31:54.608202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a5418e6-4829-43c0-8f00-1d62126f4fde tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: .version_select at 0x7f54c7a910d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1112547345"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:54.622543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7a5418e6-4829-43c0-8f00-1d62126f4fde tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:31:54.627766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7a5418e6-4829-43c0-8f00-1d62126f4fde tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:31:54.852174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7a5418e6-4829-43c0-8f00-1d62126f4fde tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:31:54.857285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-7a5418e6-4829-43c0-8f00-1d62126f4fde tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:31:54.871997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a5418e6-4829-43c0-8f00-1d62126f4fde tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.267650 Apr 02 21:31:54.872679 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3433/6565] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:31:54 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:31:58.293888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-213814060", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1112547345", "security_groups": [{"name": "tempest-secgroup-smoke-711613502"}], "block_device_mapping_v2": [{"uuid": "ae9ad986-858e-4b1e-97f8-0338ac2a0ffc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "42da5f51-4ee8-4338-9167-b7fb170cce38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:31:58.542666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] validate_networks() for [('42da5f51-4ee8-4338-9167-b7fb170cce38', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:31:59.002329 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:31:59.002762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:31:59.003246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:31:59.003672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:31:59.004093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:31:59.012830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:59.013293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:59.014112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:31:59.014562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:31:59.031520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:31:59.036761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:31:59.093655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:31:59.095766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae9ad986-858e-4b1e-97f8-0338ac2a0ffc',volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:31:59.221886 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b41b226b-5070-4d74-b952-441030471063 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.931793 Apr 02 21:31:59.222587 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3133/6566] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:31:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:31:59.234324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-36a968c1-7127-4bcb-929e-5a9be24a4efd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:31:59.235626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-36a968c1-7127-4bcb-929e-5a9be24a4efd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:31:59.357045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-36a968c1-7127-4bcb-929e-5a9be24a4efd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:31:59.366267 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-36a968c1-7127-4bcb-929e-5a9be24a4efd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1094 microversion: 2.1 time: 0.137368 Apr 02 21:31:59.366854 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3434/6567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:31:59 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:32:00.386633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:00.387264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:00.393847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:00.394309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:00.395113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:00.395553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:00.462764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:00.474511 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c1d4db5c-a11d-461e-b20a-fab134ee694f tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1210 microversion: 2.1 time: 0.094812 Apr 02 21:32:00.475301 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3134/6568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:00 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:01.491295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:01.491926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:01.498829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:01.499306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:01.500103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:01.500586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:01.642176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:01.652935 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06fe9659-06c2-458d-8c30-f6d058226653 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.165597 Apr 02 21:32:01.654110 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3435/6569] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:01 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:01.878641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ca0e4ea7-f292-4637-abf1-d616cfb07a0b req-b9915055-2c2b-4ffb-98cc-ef5cfabe086e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3829fe-5817-4f16-a2ea-7f3045e7577a", "tag": "b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:32:01.891120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ca0e4ea7-f292-4637-abf1-d616cfb07a0b req-b9915055-2c2b-4ffb-98cc-ef5cfabe086e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:01.891705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ca0e4ea7-f292-4637-abf1-d616cfb07a0b req-b9915055-2c2b-4ffb-98cc-ef5cfabe086e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:01.916484 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ca0e4ea7-f292-4637-abf1-d616cfb07a0b req-b9915055-2c2b-4ffb-98cc-ef5cfabe086e service nova] Creating event network-changed:b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675 for instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a on nch2-master-1 Apr 02 21:32:01.924073 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ca0e4ea7-f292-4637-abf1-d616cfb07a0b req-b9915055-2c2b-4ffb-98cc-ef5cfabe086e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051910 Apr 02 21:32:01.924737 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3135/6570] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:32:02.670630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:02.671303 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:02.678187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:02.678666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:02.679464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:02.679929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:02.820887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:02.828992 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-88c4f2f4-483f-4e29-b092-90d7bcce43c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.162373 Apr 02 21:32:02.829575 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3436/6571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:02 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:03.846349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:03.846974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:03.854020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:03.855091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:03.855867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:03.856348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:03.992882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:04.000211 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d243f85-ed78-4224-a7cb-c667393211ff tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.158290 Apr 02 21:32:04.000817 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3136/6572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:03 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:05.017833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:05.018467 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:05.025318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:05.025794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:05.027258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:05.027715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:05.161974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:05.169757 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f3998bf6-c177-4db7-98e6-f9f66fcce449 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.156133 Apr 02 21:32:05.170329 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3437/6573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:05 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:06.187240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:06.187873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:06.195648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:06.196112 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:06.196929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:06.197377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:06.339287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:06.346780 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d5a4074f-4377-4606-93d4-47c76dffe56a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.164139 Apr 02 21:32:06.347362 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3137/6574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:06 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:07.363674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:07.364255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:07.371673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:07.372162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:07.372969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:07.373419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:07.512529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:07.519944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69952ffe-92cb-45b2-87fa-17f2c60b69b6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.160261 Apr 02 21:32:07.520542 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3438/6575] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:07 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:08.223439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f1adf350-5260-4850-9ad0-a7ec273a95a1 req-81aaa2f6-0b2a-4c62-b66a-e983a01ff7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3829fe-5817-4f16-a2ea-7f3045e7577a", "name": "network-vif-plugged", "status": "completed", "tag": "b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:32:08.233919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f1adf350-5260-4850-9ad0-a7ec273a95a1 req-81aaa2f6-0b2a-4c62-b66a-e983a01ff7d5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:08.234367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f1adf350-5260-4850-9ad0-a7ec273a95a1 req-81aaa2f6-0b2a-4c62-b66a-e983a01ff7d5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:08.246296 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f1adf350-5260-4850-9ad0-a7ec273a95a1 req-81aaa2f6-0b2a-4c62-b66a-e983a01ff7d5 service nova] Creating event network-vif-plugged:b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675 for instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a on nch2-master-1 Apr 02 21:32:08.251099 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f1adf350-5260-4850-9ad0-a7ec273a95a1 req-81aaa2f6-0b2a-4c62-b66a-e983a01ff7d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Apr 02 21:32:08.251693 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3138/6576] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:32:08.536943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:08.537578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:08.544697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:08.545172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:08.545957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:08.546417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:08.678554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:08.686236 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-58bca243-fa7b-4827-b170-22ff632d7ef5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1265 microversion: 2.1 time: 0.153264 Apr 02 21:32:08.686806 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3439/6577] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:08 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:09.703473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:09.704178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:09.711549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:09.711958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:09.712758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:09.713208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:09.849392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:09.856794 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c32c7dee-0ced-453d-88c8-cf35ae2ed393 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1450 microversion: 2.1 time: 0.157546 Apr 02 21:32:09.857446 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3139/6578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:09 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:09.873941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:32:09.874597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:32:09.881425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:09.881897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:09.882717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:09.883195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:10.021797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:32:10.029329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cb57ed29-f410-4337-be3f-ebe80d89271c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1450 microversion: 2.1 time: 0.160308 Apr 02 21:32:10.029896 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3440/6579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:32:09 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:32:12.086105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-09121f37-8d36-4f29-ad9a-68cf05e9fde7 req-17dd8fac-de1a-48f9-a922-dbafcd569aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3829fe-5817-4f16-a2ea-7f3045e7577a", "tag": "b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:32:12.094398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-09121f37-8d36-4f29-ad9a-68cf05e9fde7 req-17dd8fac-de1a-48f9-a922-dbafcd569aaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:32:12.094851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-09121f37-8d36-4f29-ad9a-68cf05e9fde7 req-17dd8fac-de1a-48f9-a922-dbafcd569aaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:32:12.106123 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-09121f37-8d36-4f29-ad9a-68cf05e9fde7 req-17dd8fac-de1a-48f9-a922-dbafcd569aaf service nova] Creating event network-changed:b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675 for instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a on nch2-master-1 Apr 02 21:32:12.111139 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-09121f37-8d36-4f29-ad9a-68cf05e9fde7 req-17dd8fac-de1a-48f9-a922-dbafcd569aaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110753 Apr 02 21:32:12.111803 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3140/6580] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:33:13.671668 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:33:13.672321 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:33:14.086389 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:33:14.086983 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:34:19.415817 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 21:34:19.419924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:19.420432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:19.426510 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:19.426980 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:19.427757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:19.428748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:19.453553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:34:19.532387 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0fef676c-f7f6-419d-a066-5130172f7fa6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 204 len: 0 microversion: 2.1 time: 0.126839 Apr 02 21:34:19.533030 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3441/6581] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:34:19 2022] DELETE /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:34:19.540967 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 21:34:19.541886 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:34:19.546396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:19.547102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:19.553306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:19.553769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:19.554544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:19.554989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:19.691813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:19.699797 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71cf8c23-0d0e-4308-8fa7-229aa523185c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1575 microversion: 2.1 time: 0.161062 Apr 02 21:34:19.700372 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3141/6582] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:19 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:20.717625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:20.718255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:20.728421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:20.729536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:20.730632 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:20.731163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:20.738183 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38986. Apr 02 21:34:20.868729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:20.876891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29b2b132-83f7-4f8b-a330-783afaf5cc3c tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1575 microversion: 2.1 time: 0.163610 Apr 02 21:34:20.877646 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3442/6583] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:20 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:21.894464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:21.895119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:21.905140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:21.905655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:21.906420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:21.906794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:21.912858 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38998. Apr 02 21:34:21.926834 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 38994. Apr 02 21:34:21.990792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:21.998344 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad1a2f3d-791e-40f3-943d-d143db3effbc tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 200 len: 1508 microversion: 2.1 time: 0.107881 Apr 02 21:34:21.998924 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3142/6584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:21 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 1508 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:22.257190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-427e0b83-079e-4741-a9b1-32b43bbc2518 req-c4d3ceec-441d-4218-9de9-6b3ac24680b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3829fe-5817-4f16-a2ea-7f3045e7577a", "name": "network-vif-deleted", "tag": "b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:34:22.267126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-427e0b83-079e-4741-a9b1-32b43bbc2518 req-c4d3ceec-441d-4218-9de9-6b3ac24680b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:22.267599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-427e0b83-079e-4741-a9b1-32b43bbc2518 req-c4d3ceec-441d-4218-9de9-6b3ac24680b9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:22.280114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-427e0b83-079e-4741-a9b1-32b43bbc2518 req-c4d3ceec-441d-4218-9de9-6b3ac24680b9 service nova] Creating event network-vif-deleted:b28ca5b9-0f03-45c7-b50a-3b0dc9ed2675 for instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a on nch2-master-1 Apr 02 21:34:22.286197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-427e0b83-079e-4741-a9b1-32b43bbc2518 req-c4d3ceec-441d-4218-9de9-6b3ac24680b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032781 Apr 02 21:34:22.287157 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3443/6585] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:34:23.015157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:23.015871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:23.023199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:23.023660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:23.024435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:23.024910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:23.039787 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a could not be found. Apr 02 21:34:23.040404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:34:23.041332 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8e835d50-97cc-45b0-be0d-080cbaad02a5 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 404 len: 111 microversion: 2.1 time: 0.030129 Apr 02 21:34:23.042351 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3143/6586] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:23 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:34:23.103281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-870581749", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1112547345", "security_groups": [{"name": "tempest-secgroup-smoke-711613502"}], "block_device_mapping_v2": [{"uuid": "ae9ad986-858e-4b1e-97f8-0338ac2a0ffc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "42da5f51-4ee8-4338-9167-b7fb170cce38"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:34:23.234983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] validate_networks() for [('42da5f51-4ee8-4338-9167-b7fb170cce38', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:34:23.666796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:34:23.667638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:34:23.667955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:34:23.668376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:34:23.668827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:34:23.678387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:23.678863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:23.679692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:23.680153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:23.696883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:34:23.702206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:34:23.764352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:34:23.766659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae9ad986-858e-4b1e-97f8-0338ac2a0ffc',volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:34:23.887144 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788753 Apr 02 21:34:23.887798 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3444/6587] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:34:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:34:23.898385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f236726-43a8-47b6-ac28-95d6196d0cea tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:23.899130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f236726-43a8-47b6-ac28-95d6196d0cea tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:23.950243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f236726-43a8-47b6-ac28-95d6196d0cea tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:23.956799 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f236726-43a8-47b6-ac28-95d6196d0cea tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1094 microversion: 2.1 time: 0.062840 Apr 02 21:34:23.957383 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3144/6588] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:23 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:24.975081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:24.975934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:24.983480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:24.984030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:24.984870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:24.985361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:25.052178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:25.060609 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d21e3a36-c9ed-4df1-9ddf-af3261d3c4df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1210 microversion: 2.1 time: 0.090343 Apr 02 21:34:25.068157 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3445/6589] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:24 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:26.077710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:26.078442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:26.088365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:26.088863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:26.089715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:26.090309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:26.560723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:26.568134 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-183293c7-2ee0-4d6c-8928-b2ab8e438e38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.494486 Apr 02 21:34:26.568814 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3145/6590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:26 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:26.639847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5ec92d2e-e262-4b00-8a4f-dede214d7bf1 req-16093f9f-3880-4b79-b8e1-93ddfb69b0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f8f1eb-8e27-49bc-99a5-bd106f9b2650", "tag": "38865bb9-b28c-4570-a64f-959d0a4cc48c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:34:26.653491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5ec92d2e-e262-4b00-8a4f-dede214d7bf1 req-16093f9f-3880-4b79-b8e1-93ddfb69b0c2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:26.653960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5ec92d2e-e262-4b00-8a4f-dede214d7bf1 req-16093f9f-3880-4b79-b8e1-93ddfb69b0c2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:26.670368 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5ec92d2e-e262-4b00-8a4f-dede214d7bf1 req-16093f9f-3880-4b79-b8e1-93ddfb69b0c2 service nova] Creating event network-changed:38865bb9-b28c-4570-a64f-959d0a4cc48c for instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 on nch2-master-1 Apr 02 21:34:26.675837 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5ec92d2e-e262-4b00-8a4f-dede214d7bf1 req-16093f9f-3880-4b79-b8e1-93ddfb69b0c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039604 Apr 02 21:34:26.676568 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3446/6591] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:34:27.585978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:27.586524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:27.593284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:27.593740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:27.594516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:27.594957 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:27.749585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:27.756883 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f84c2852-dc60-49f2-b79a-467c82437328 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.174833 Apr 02 21:34:27.757509 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3146/6592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:27 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:28.775149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:28.775785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:28.782044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:28.782508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:28.783283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:28.783735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:28.918514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:28.925925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd0cb762-1055-4edc-bdee-33f2e23d9d54 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.156124 Apr 02 21:34:28.926495 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3447/6593] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:28 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:29.945527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:29.946147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:29.952932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:29.953389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:29.954167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:29.954611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:30.087625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:30.096058 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-29f94ba5-ba84-4bcc-981c-41afca920cb6 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.155042 Apr 02 21:34:30.096681 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3147/6594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:29 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:31.113326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:31.113954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:31.121584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:31.122053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:31.122863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:31.123317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:31.260710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:31.268382 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a100e2db-fc2a-4c77-97e9-4d88245eddf1 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.159057 Apr 02 21:34:31.268985 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3448/6595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:31 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:32.285779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:32.286301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:32.293935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:32.294400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:32.295209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:32.295658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:32.434202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:32.441758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6aad0657-c4f5-4214-a2e1-c9b8c36d8259 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.159901 Apr 02 21:34:32.442332 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3148/6596] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:32 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:33.020013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c8760eda-78fa-46e5-a1b8-e9ff69e39b62 req-945b381f-4053-4c22-a0c0-77cf30ad8a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f8f1eb-8e27-49bc-99a5-bd106f9b2650", "name": "network-vif-plugged", "status": "completed", "tag": "38865bb9-b28c-4570-a64f-959d0a4cc48c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:34:33.029751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c8760eda-78fa-46e5-a1b8-e9ff69e39b62 req-945b381f-4053-4c22-a0c0-77cf30ad8a1d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:33.030334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c8760eda-78fa-46e5-a1b8-e9ff69e39b62 req-945b381f-4053-4c22-a0c0-77cf30ad8a1d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:33.041915 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c8760eda-78fa-46e5-a1b8-e9ff69e39b62 req-945b381f-4053-4c22-a0c0-77cf30ad8a1d service nova] Creating event network-vif-plugged:38865bb9-b28c-4570-a64f-959d0a4cc48c for instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 on nch2-master-1 Apr 02 21:34:33.047043 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c8760eda-78fa-46e5-a1b8-e9ff69e39b62 req-945b381f-4053-4c22-a0c0-77cf30ad8a1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030770 Apr 02 21:34:33.047645 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3449/6597] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:34:33.459756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:33.460410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:33.466477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:33.466940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:33.467743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:33.468192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:33.602009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:33.609466 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b5e372e-1913-46ab-a217-cf2b6f8fce01 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1265 microversion: 2.1 time: 0.154813 Apr 02 21:34:33.610036 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3149/6598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:33 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:34.628105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:34.628956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:34.635749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:34.636221 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:34.637033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:34.637494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:34.771052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:34.779345 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-82771f9f-dec9-47d1-9718-494daf6c8945 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1450 microversion: 2.1 time: 0.156363 Apr 02 21:34:34.779930 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3450/6599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:34 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:34.795912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:34:34.796573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:34:34.803280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:34.803768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:34.805188 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:34.805634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:34.947953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:34:34.955472 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ecfe4553-0d11-443e-a121-4c2f80a9475a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1450 microversion: 2.1 time: 0.163601 Apr 02 21:34:34.956056 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3150/6600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:34:34 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:34:36.598050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-48e2fde1-3b8a-47e4-ac50-18af40206ef6 req-682c8863-f4a5-49de-b8b5-712131c30c13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f8f1eb-8e27-49bc-99a5-bd106f9b2650", "tag": "38865bb9-b28c-4570-a64f-959d0a4cc48c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:34:36.608639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-48e2fde1-3b8a-47e4-ac50-18af40206ef6 req-682c8863-f4a5-49de-b8b5-712131c30c13 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:34:36.609111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-48e2fde1-3b8a-47e4-ac50-18af40206ef6 req-682c8863-f4a5-49de-b8b5-712131c30c13 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:34:36.620233 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-48e2fde1-3b8a-47e4-ac50-18af40206ef6 req-682c8863-f4a5-49de-b8b5-712131c30c13 service nova] Creating event network-changed:38865bb9-b28c-4570-a64f-959d0a4cc48c for instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 on nch2-master-1 Apr 02 21:34:36.625160 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-48e2fde1-3b8a-47e4-ac50-18af40206ef6 req-682c8863-f4a5-49de-b8b5-712131c30c13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030792 Apr 02 21:34:36.625802 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3451/6601] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:34:53.545126 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:34:53.545798 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:34:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:34:54.200792 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 02 21:34:54.200792 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:34:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:35:18.972342 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:35:18.973105 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:35:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:36:30.998295 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-655017866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1112547345", "security_groups": [{"name": "tempest-secgroup-smoke-711613502"}], "block_device_mapping_v2": [{"uuid": "6e0ec8ec-31b4-49d4-bec3-03a987dba0ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "42da5f51-4ee8-4338-9167-b7fb170cce38"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:36:31.105582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] validate_networks() for [('42da5f51-4ee8-4338-9167-b7fb170cce38', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:36:31.475779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:36:31.476216 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:36:31.476789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:36:31.477210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:36:31.477681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:36:31.492519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:31.493008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:31.493868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:31.494306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:31.510493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:36:31.515612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Getting quotas for user 9390a098b4d846a2b7dd2dad99d00d76 and project d612578d899f4a889190a04840ffa2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:36:31.572310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:36:31.574474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e0ec8ec-31b4-49d4-bec3-03a987dba0ce',volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:36:31.696696 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-118f2c7e-ba37-4c63-8735-f53041295f53 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.703516 Apr 02 21:36:31.697338 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3151/6602] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:36:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:36:31.707258 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 21:36:31.708959 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 21:36:31.715264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5b914a2-06a0-4e09-8a72-1e0c68af3d84 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:31.715983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5b914a2-06a0-4e09-8a72-1e0c68af3d84 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:31.769829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5b914a2-06a0-4e09-8a72-1e0c68af3d84 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:31.779991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5b914a2-06a0-4e09-8a72-1e0c68af3d84 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1094 microversion: 2.1 time: 0.075962 Apr 02 21:36:31.780587 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3452/6603] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:31 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:36:32.797866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:32.798500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:32.806286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:32.806796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:32.807634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:32.808320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:32.879838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:32.887576 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46415377-9377-4ad2-a9cc-e43ececf96f4 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1210 microversion: 2.1 time: 0.094126 Apr 02 21:36:32.888148 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3152/6604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:32 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:33.907253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:33.908142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:33.922558 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39266. Apr 02 21:36:33.930295 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39268. Apr 02 21:36:33.935891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:33.936743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:33.937758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:33.938216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:34.090225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:34.094675 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:36:34.095186 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:36:34.104831 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd50073a-f666-4d84-8aa1-cc5389165dfd tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.202272 Apr 02 21:36:34.105678 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3453/6605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:33 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:34.219959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e27a2113-a1a9-4bf2-b8e9-422962a90381 req-b6306b3f-fb4a-4c34-9cb7-8f303ad1c3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e580f13-a334-4433-8040-5f5768ba1366", "tag": "8125c219-48a4-49b6-8929-1aaae94fc71d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:36:34.232049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e27a2113-a1a9-4bf2-b8e9-422962a90381 req-b6306b3f-fb4a-4c34-9cb7-8f303ad1c3d4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:34.232536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e27a2113-a1a9-4bf2-b8e9-422962a90381 req-b6306b3f-fb4a-4c34-9cb7-8f303ad1c3d4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:34.248379 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e27a2113-a1a9-4bf2-b8e9-422962a90381 req-b6306b3f-fb4a-4c34-9cb7-8f303ad1c3d4 service nova] Creating event network-changed:8125c219-48a4-49b6-8929-1aaae94fc71d for instance 7e580f13-a334-4433-8040-5f5768ba1366 on nch2-master-1 Apr 02 21:36:34.254965 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e27a2113-a1a9-4bf2-b8e9-422962a90381 req-b6306b3f-fb4a-4c34-9cb7-8f303ad1c3d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121531 Apr 02 21:36:34.255581 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3153/6606] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:36:35.123424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:35.124059 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:35.131837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:35.132343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:35.133172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:35.133673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:35.270900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:35.278873 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-35674ce5-3367-4937-ba22-7b977d87ba38 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.160401 Apr 02 21:36:35.279443 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3454/6607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:35 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:36.297640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:36.298368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:36.304535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:36.304986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:36.306399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:36.306839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:36.443896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:36.451412 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81d7dd7e-6bc3-48c4-b403-b7ef4be79c97 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.159138 Apr 02 21:36:36.451982 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3154/6608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:36 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:37.468445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:37.469148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:37.475933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:37.476402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:37.477214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:37.478480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:37.609879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:37.617293 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-268117f6-3053-4514-9d1c-cb95353ab8c9 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.152741 Apr 02 21:36:37.617868 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3455/6609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:37 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:38.633275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:38.634430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:38.641488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:38.641944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:38.642785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:38.643229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:39.043399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:39.051179 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3418f840-590a-4549-9322-e01f5fd141c2 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.422007 Apr 02 21:36:39.051744 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3155/6610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:38 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:40.068333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:40.069001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:40.075699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:40.076168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:40.076978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:40.077436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:40.214028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:40.223351 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0fee706d-2821-4fd9-b7c4-96ccde18d4d3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.158734 Apr 02 21:36:40.223951 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3456/6611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:40 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:41.240606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:41.241219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:41.248514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:41.248926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:41.249684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:41.250121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:41.387178 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:41.394665 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5d154196-a857-4787-b8d2-24cd56b716ed tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.157975 Apr 02 21:36:41.395233 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3156/6612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:41 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:41.762605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e65b6257-7821-4df8-a6a8-1705985f6ade req-14201274-ab9a-4dc0-971f-7aabf205f7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e580f13-a334-4433-8040-5f5768ba1366", "name": "network-vif-plugged", "status": "completed", "tag": "8125c219-48a4-49b6-8929-1aaae94fc71d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:36:41.770816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e65b6257-7821-4df8-a6a8-1705985f6ade req-14201274-ab9a-4dc0-971f-7aabf205f7be service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:41.771274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e65b6257-7821-4df8-a6a8-1705985f6ade req-14201274-ab9a-4dc0-971f-7aabf205f7be service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:41.782062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e65b6257-7821-4df8-a6a8-1705985f6ade req-14201274-ab9a-4dc0-971f-7aabf205f7be service nova] Creating event network-vif-plugged:8125c219-48a4-49b6-8929-1aaae94fc71d for instance 7e580f13-a334-4433-8040-5f5768ba1366 on nch2-master-1 Apr 02 21:36:41.787075 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e65b6257-7821-4df8-a6a8-1705985f6ade req-14201274-ab9a-4dc0-971f-7aabf205f7be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088863 Apr 02 21:36:41.787649 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3457/6613] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:36:42.411284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:42.411941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:42.418988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:42.419450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:42.420223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:42.420701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:42.551891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:42.559257 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e2d0c52a-8ed8-43f3-99c0-41e8f718b028 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1265 microversion: 2.1 time: 0.151965 Apr 02 21:36:42.559816 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3157/6614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:42 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:43.577515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:43.578179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:43.584487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:43.584967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:43.585751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:43.586210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:43.719700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:43.727346 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-39e1e789-3ef9-463c-8e04-5f364d47d224 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1450 microversion: 2.1 time: 0.155027 Apr 02 21:36:43.727923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3458/6615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:43 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:43.743813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:36:43.744438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:36:43.751174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:43.751674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:43.752467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:43.752919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:43.888319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:36:43.895871 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-87cecbb9-5ad5-4a2e-8356-896e3eeb904a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1450 microversion: 2.1 time: 0.155869 Apr 02 21:36:43.896445 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3158/6616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:36:43 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:36:45.829289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-540d2fe4-0493-4974-aa65-4da96ec1c23c req-ef175852-ac72-41ae-a694-0a2a430b6313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e580f13-a334-4433-8040-5f5768ba1366", "tag": "8125c219-48a4-49b6-8929-1aaae94fc71d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:36:45.838343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-540d2fe4-0493-4974-aa65-4da96ec1c23c req-ef175852-ac72-41ae-a694-0a2a430b6313 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:36:45.838807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-540d2fe4-0493-4974-aa65-4da96ec1c23c req-ef175852-ac72-41ae-a694-0a2a430b6313 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:36:45.852355 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-540d2fe4-0493-4974-aa65-4da96ec1c23c req-ef175852-ac72-41ae-a694-0a2a430b6313 service nova] Creating event network-changed:8125c219-48a4-49b6-8929-1aaae94fc71d for instance 7e580f13-a334-4433-8040-5f5768ba1366 on nch2-master-1 Apr 02 21:36:45.857884 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-540d2fe4-0493-4974-aa65-4da96ec1c23c req-ef175852-ac72-41ae-a694-0a2a430b6313 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032669 Apr 02 21:36:45.858691 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3459/6617] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:38:13.553841 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:38:13.554511 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:38:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:38:38.585431 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 21:38:38.586648 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 21:38:38.588121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:38:38.588672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:38:38.596103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:38.596717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:38.597529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:38.597974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:38.623630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:38:38.649735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-cb668258-fdad-48a3-8cfb-6119daa42bbb req-c8fce852-5f41-45f5-b37e-80d9b2cec83d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e580f13-a334-4433-8040-5f5768ba1366", "tag": "8125c219-48a4-49b6-8929-1aaae94fc71d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:38:38.658416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cb668258-fdad-48a3-8cfb-6119daa42bbb req-c8fce852-5f41-45f5-b37e-80d9b2cec83d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:38.658870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-cb668258-fdad-48a3-8cfb-6119daa42bbb req-c8fce852-5f41-45f5-b37e-80d9b2cec83d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:38.671209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-cb668258-fdad-48a3-8cfb-6119daa42bbb req-c8fce852-5f41-45f5-b37e-80d9b2cec83d service nova] Creating event network-changed:8125c219-48a4-49b6-8929-1aaae94fc71d for instance 7e580f13-a334-4433-8040-5f5768ba1366 on nch2-master-1 Apr 02 21:38:38.676617 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-cb668258-fdad-48a3-8cfb-6119daa42bbb req-c8fce852-5f41-45f5-b37e-80d9b2cec83d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092967 Apr 02 21:38:38.677350 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3460/6618] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:38:38.716105 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 204 len: 0 microversion: 2.1 time: 0.134856 Apr 02 21:38:38.719979 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3159/6619] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:38:38 2022] DELETE /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:38:38.726508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:38:38.727947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:38:38.734389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:38.734870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:38.735683 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:38.736154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:38.943332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:38:38.951562 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8c54f20-a53a-417a-b6b5-2d7050528596 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1574 microversion: 2.1 time: 0.229668 Apr 02 21:38:38.952148 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3461/6620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:38:38 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:38:39.969873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:38:39.970576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:38:39.978338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:39.978793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:39.979557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:39.979994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:40.170749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:38:40.178342 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2fa641aa-ba52-41f4-8e80-4cb7ea34e9df tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1456 microversion: 2.1 time: 0.212734 Apr 02 21:38:40.178912 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3160/6621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:38:39 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1456 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:38:41.195372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:38:41.196009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:38:41.206509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:41.206982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:41.207794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:41.208258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:41.215695 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39406. Apr 02 21:38:41.226463 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39404. Apr 02 21:38:41.276701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:38:41.285254 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-195294be-7e54-475b-9cde-bc99b2881335 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 200 len: 1389 microversion: 2.1 time: 0.093780 Apr 02 21:38:41.286160 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3462/6622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:38:41 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:38:41.336519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-59dc689b-31d5-4d3e-983d-e0df26942025 req-2b29be1c-0e24-40bf-9309-1619edfc72b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e580f13-a334-4433-8040-5f5768ba1366", "name": "network-vif-deleted", "tag": "8125c219-48a4-49b6-8929-1aaae94fc71d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:38:41.346442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-59dc689b-31d5-4d3e-983d-e0df26942025 req-2b29be1c-0e24-40bf-9309-1619edfc72b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:41.346956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-59dc689b-31d5-4d3e-983d-e0df26942025 req-2b29be1c-0e24-40bf-9309-1619edfc72b5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:41.362138 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-59dc689b-31d5-4d3e-983d-e0df26942025 req-2b29be1c-0e24-40bf-9309-1619edfc72b5 service nova] Creating event network-vif-deleted:8125c219-48a4-49b6-8929-1aaae94fc71d for instance 7e580f13-a334-4433-8040-5f5768ba1366 on nch2-master-1 Apr 02 21:38:41.369522 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-59dc689b-31d5-4d3e-983d-e0df26942025 req-2b29be1c-0e24-40bf-9309-1619edfc72b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036709 Apr 02 21:38:41.370140 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3161/6623] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:38:42.303007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:38:42.303642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 7e580f13-a334-4433-8040-5f5768ba1366] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:38:42.311239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:42.311721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:42.312555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:38:42.313027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:38:42.327197 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 7e580f13-a334-4433-8040-5f5768ba1366 could not be found. Apr 02 21:38:42.327866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 7e580f13-a334-4433-8040-5f5768ba1366 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:38:42.328755 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a5d0d5f0-9cb2-459b-b32d-d439e061bc4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366" status: 404 len: 111 microversion: 2.1 time: 0.029720 Apr 02 21:38:42.329310 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3463/6624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:38:42 2022] GET /compute/v2.1/servers/7e580f13-a334-4433-8040-5f5768ba1366 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:39:15.173469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:15.174041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:15.175128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-aee1ec11-a0c2-4bf5-b85d-c65c0220c149 req-fed0712c-36a7-46ae-8d4a-8b4062424cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4f8f1eb-8e27-49bc-99a5-bd106f9b2650", "tag": "38865bb9-b28c-4570-a64f-959d0a4cc48c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:15.181149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:15.181641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:15.182378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:15.182818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:15.183465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-aee1ec11-a0c2-4bf5-b85d-c65c0220c149 req-fed0712c-36a7-46ae-8d4a-8b4062424cfb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:15.184509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-aee1ec11-a0c2-4bf5-b85d-c65c0220c149 req-fed0712c-36a7-46ae-8d4a-8b4062424cfb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:15.196912 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-aee1ec11-a0c2-4bf5-b85d-c65c0220c149 req-fed0712c-36a7-46ae-8d4a-8b4062424cfb service nova] Creating event network-changed:38865bb9-b28c-4570-a64f-959d0a4cc48c for instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 on nch2-master-1 Apr 02 21:39:15.204352 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-aee1ec11-a0c2-4bf5-b85d-c65c0220c149 req-fed0712c-36a7-46ae-8d4a-8b4062424cfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Apr 02 21:39:15.205725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3464/6625] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:15.212663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:39:15.297469 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cd218ebe-76d4-4772-8e20-e586983bca2d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 204 len: 0 microversion: 2.1 time: 0.129156 Apr 02 21:39:15.298859 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3162/6626] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:39:15 2022] DELETE /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:39:15.307918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:15.308687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:15.315972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:15.316517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:15.317397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:15.317854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:15.471343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:15.479295 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e4e989bc-3846-4825-b31d-417db9fc2173 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1574 microversion: 2.1 time: 0.175964 Apr 02 21:39:15.479884 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3465/6627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:15 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:16.497556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:16.498261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:16.504981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:16.505434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:16.506206 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:16.506642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:16.641820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:16.649779 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-507eed32-dabc-4a00-b581-36bf0335ca4a tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1456 microversion: 2.1 time: 0.156509 Apr 02 21:39:16.650346 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3163/6628] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:16 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1456 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:17.533675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-96e064ef-aa47-49ad-8b1e-f03d54350eec req-5a08bf06-12d1-4aa5-bf95-ea7240dcfac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4f8f1eb-8e27-49bc-99a5-bd106f9b2650", "name": "network-vif-deleted", "tag": "38865bb9-b28c-4570-a64f-959d0a4cc48c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:17.543207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96e064ef-aa47-49ad-8b1e-f03d54350eec req-5a08bf06-12d1-4aa5-bf95-ea7240dcfac5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:17.543668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-96e064ef-aa47-49ad-8b1e-f03d54350eec req-5a08bf06-12d1-4aa5-bf95-ea7240dcfac5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:17.556266 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-96e064ef-aa47-49ad-8b1e-f03d54350eec req-5a08bf06-12d1-4aa5-bf95-ea7240dcfac5 service nova] Creating event network-vif-deleted:38865bb9-b28c-4570-a64f-959d0a4cc48c for instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 on nch2-master-1 Apr 02 21:39:17.561826 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-96e064ef-aa47-49ad-8b1e-f03d54350eec req-5a08bf06-12d1-4aa5-bf95-ea7240dcfac5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031964 Apr 02 21:39:17.562425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3466/6629] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:17.667083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:17.668298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:17.675220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:17.675680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:17.676482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:17.676930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:17.739344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9390a098b4d846a2b7dd2dad99d00d76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd612578d899f4a889190a04840ffa2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:17.747740 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13e42efa-717e-4aa1-945b-79b4991846e3 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 200 len: 1225 microversion: 2.1 time: 0.085008 Apr 02 21:39:17.748323 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3164/6630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:17 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:18.767268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:18.767906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: b4f8f1eb-8e27-49bc-99a5-bd106f9b2650] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:18.774086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:18.774554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:18.775334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:18.775788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:18.788902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 could not be found. Apr 02 21:39:18.789529 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:39:18.790371 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8f4f5273-52e0-433f-b9a6-588ac93569bf tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650" status: 404 len: 111 microversion: 2.1 time: 0.028393 Apr 02 21:39:18.790914 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3467/6631] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:18 2022] GET /compute/v2.1/servers/b4f8f1eb-8e27-49bc-99a5-bd106f9b2650 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:39:19.229873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:19.230371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:19.237186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:19.237641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:19.238404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:19.238845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:19.252429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a could not be found. Apr 02 21:39:19.253046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:39:19.254152 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8b42326-c701-4975-9b29-27279ed43c22 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 404 len: 111 microversion: 2.1 time: 0.028829 Apr 02 21:39:19.254675 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3165/6632] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:39:19 2022] DELETE /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:39:19.262747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:19.263399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] [instance: 9a3829fe-5817-4f16-a2ea-7f3045e7577a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:19.269450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:19.269923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:19.270711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:19.271168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:19.284187 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] HTTP exception thrown: Instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a could not be found. Apr 02 21:39:19.284816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Returning 404 to user: Instance 9a3829fe-5817-4f16-a2ea-7f3045e7577a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:39:19.285646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-abf3d5ca-1b7d-475c-b1d8-195d179d1818 tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a" status: 404 len: 111 microversion: 2.1 time: 0.026869 Apr 02 21:39:19.286162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3468/6633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:19 2022] GET /compute/v2.1/servers/9a3829fe-5817-4f16-a2ea-7f3045e7577a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:39:21.620199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a44368f4-6282-4e2c-a303-d542aba90a7d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] Calling method '.version_select at 0x7f54c787ce50>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:21.650908 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a44368f4-6282-4e2c-a303-d542aba90a7d tempest-TestVolumeBootPattern-1833101236 tempest-TestVolumeBootPattern-1833101236-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1112547345" status: 202 len: 0 microversion: 2.1 time: 0.034354 Apr 02 21:39:21.651472 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3166/6634] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Apr 2 21:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1112547345 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:39:40.259413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-416933177", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:40.314782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] validate_networks() for None {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:39:40.504097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:39:40.504646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:39:40.505143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:39:40.505579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:39:40.506039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:39:40.515561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:40.516048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:40.516932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:40.517419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:40.533870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Getting quotas for project 418951f01874458e878a1db4c046e79f. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:39:40.539094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Getting quotas for user 93772fc5e1f1440e9e1134c492ba9a16 and project 418951f01874458e878a1db4c046e79f. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:39:40.551651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:39:40.553895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:39:40.594790 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [83abd5d2-476e-4140-a209-bac59856a25e] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:39:41.602841 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [83abd5d2-476e-4140-a209-bac59856a25e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 39684. Apr 02 21:39:41.607477 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2890f818-ac27-4ab2-9aab-4e0617b2ea5c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.471397 Apr 02 21:39:41.608299 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3469/6635] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:39:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:39:41.620394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6e5f04e5-cfae-437e-a303-7884fc3684fb tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:41.621039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6e5f04e5-cfae-437e-a303-7884fc3684fb tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:41.671639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6e5f04e5-cfae-437e-a303-7884fc3684fb tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:41.678250 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6e5f04e5-cfae-437e-a303-7884fc3684fb tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1221 microversion: 2.1 time: 0.063758 Apr 02 21:39:41.678810 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3167/6636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:41 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1221 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:42.696751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-da2a9af3-75bf-4f61-84a6-7ef43a48f12f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:42.697386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-da2a9af3-75bf-4f61-84a6-7ef43a48f12f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:42.749554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-da2a9af3-75bf-4f61-84a6-7ef43a48f12f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:42.756269 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-da2a9af3-75bf-4f61-84a6-7ef43a48f12f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1221 microversion: 2.1 time: 0.065036 Apr 02 21:39:42.756946 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3470/6637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:42 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1221 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:43.773350 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7027e2b5-cd31-4449-903b-056b6a591208 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:43.773943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7027e2b5-cd31-4449-903b-056b6a591208 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:43.828414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7027e2b5-cd31-4449-903b-056b6a591208 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:43.835124 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7027e2b5-cd31-4449-903b-056b6a591208 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1221 microversion: 2.1 time: 0.065663 Apr 02 21:39:43.835971 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3168/6638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:43 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:44.852645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1ef6fa3-f26d-412a-a714-3d49abc17ef3 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:44.853281 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1ef6fa3-f26d-412a-a714-3d49abc17ef3 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:44.906368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f1ef6fa3-f26d-412a-a714-3d49abc17ef3 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:44.915874 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1ef6fa3-f26d-412a-a714-3d49abc17ef3 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1221 microversion: 2.1 time: 0.067074 Apr 02 21:39:44.916501 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3471/6639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:44 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:45.935478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:45.936101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:45.943498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:45.943961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:45.944771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:45.945225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:46.004886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:46.012304 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72ed9588-8dba-4650-b7d5-a3b7a47b2af1 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1225 microversion: 2.1 time: 0.081340 Apr 02 21:39:46.013640 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3169/6640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:45 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:47.030120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:47.030744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:47.038237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:47.038720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:47.039534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:47.039978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:47.102426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:47.110582 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a132066b-765d-4824-9f7b-cf51e2fec12c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1279 microversion: 2.1 time: 0.084987 Apr 02 21:39:47.111162 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3472/6641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:47 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:48.129158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:48.129837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:48.135881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0679f871-bf37-486b-8272-586bad6bac07 req-3199e737-24e5-497d-b40f-78ce069ccba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5fe0570-ed90-4a9b-aadd-615e140b9f9b", "tag": "51b391c7-1c21-4594-9b4b-43366dbb0bbc"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:48.149270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:48.149733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:48.150533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:48.150986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:48.156983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0679f871-bf37-486b-8272-586bad6bac07 req-3199e737-24e5-497d-b40f-78ce069ccba2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:48.157429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0679f871-bf37-486b-8272-586bad6bac07 req-3199e737-24e5-497d-b40f-78ce069ccba2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:48.181610 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0679f871-bf37-486b-8272-586bad6bac07 req-3199e737-24e5-497d-b40f-78ce069ccba2 service nova] Creating event network-changed:51b391c7-1c21-4594-9b4b-43366dbb0bbc for instance e5fe0570-ed90-4a9b-aadd-615e140b9f9b on nch2-master-1 Apr 02 21:39:48.187702 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0679f871-bf37-486b-8272-586bad6bac07 req-3199e737-24e5-497d-b40f-78ce069ccba2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072055 Apr 02 21:39:48.188976 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3170/6642] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:39:48.315369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:48.322988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e1f7e3b-a38a-4dae-8fe6-793e3907098b tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1321 microversion: 2.1 time: 0.198149 Apr 02 21:39:48.323859 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3473/6643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:48 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:49.341335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:49.342068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:49.349014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:49.349466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:49.350229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:49.350671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:49.488855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:49.500274 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa5e8431-211a-4655-a1d1-a4f67bf57a8c tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1321 microversion: 2.1 time: 0.163794 Apr 02 21:39:49.500885 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3171/6644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:49 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:50.517956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:50.518559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:50.525294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:50.525761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:50.526545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:50.526993 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:50.663251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:50.671001 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43f3cc27-0c0c-4c1c-8692-0be030f4ad3e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1321 microversion: 2.1 time: 0.157015 Apr 02 21:39:50.671586 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3474/6645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:50 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:51.687895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:51.688539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:51.695318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:51.695801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:51.696596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:51.697038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:51.827302 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:51.834688 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-30a3780c-50b1-457b-959f-561794f1db87 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1321 microversion: 2.1 time: 0.151286 Apr 02 21:39:51.835262 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3172/6646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:51 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:52.511885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3040574e-61cb-4219-ab10-1a81e3cc457c req-1faafac5-0680-4f1b-9238-011fbb3b1044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fe0570-ed90-4a9b-aadd-615e140b9f9b", "name": "network-vif-plugged", "status": "completed", "tag": "51b391c7-1c21-4594-9b4b-43366dbb0bbc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:52.521603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3040574e-61cb-4219-ab10-1a81e3cc457c req-1faafac5-0680-4f1b-9238-011fbb3b1044 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:52.522147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3040574e-61cb-4219-ab10-1a81e3cc457c req-1faafac5-0680-4f1b-9238-011fbb3b1044 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:52.534350 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3040574e-61cb-4219-ab10-1a81e3cc457c req-1faafac5-0680-4f1b-9238-011fbb3b1044 service nova] Creating event network-vif-plugged:51b391c7-1c21-4594-9b4b-43366dbb0bbc for instance e5fe0570-ed90-4a9b-aadd-615e140b9f9b on nch2-master-1 Apr 02 21:39:52.539554 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3040574e-61cb-4219-ab10-1a81e3cc457c req-1faafac5-0680-4f1b-9238-011fbb3b1044 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Apr 02 21:39:52.540343 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3475/6647] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:52.851251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:52.851799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:52.858671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:52.859125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:52.859936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:52.860382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:52.993535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:53.001600 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-44e089b4-1b78-4e80-94f6-f71a3ac39c6d tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1321 microversion: 2.1 time: 0.154374 Apr 02 21:39:53.002184 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3173/6648] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:52 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:54.019661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:54.020382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:54.026858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.027331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.028472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.029075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.162511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:54.170186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cadfa3a0-0995-441f-b7cc-65c9b45efe7f tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1471 microversion: 2.1 time: 0.155654 Apr 02 21:39:54.170768 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3476/6649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:54 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:54.243143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dd60af41-7b9b-463b-9008-4d8da1a49e65 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Calling method '.version_select at 0x7f54c76479d0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:54.308965 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dd60af41-7b9b-463b-9008-4d8da1a49e65 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/6c6ddf25a4ea467abc05869d42055282" status: 200 len: 371 microversion: 2.1 time: 0.123899 Apr 02 21:39:54.310133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3174/6650] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:39:54 2022] GET /compute/v2.1/os-quota-sets/6c6ddf25a4ea467abc05869d42055282 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:54.320297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9fd3ac5e-872f-4d65-9e04-a5372100fb61 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1860764819", "id": 1092917520, "os-flavor-access:is_public": "True"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:54.322010 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:39:54.322010 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:39:54.336390 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9fd3ac5e-872f-4d65-9e04-a5372100fb61 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.019767 Apr 02 21:39:54.336996 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3477/6651] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:39:54 2022] POST /compute/v2.1/flavors => generated 438 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:54.347369 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1092917520"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:54.348352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:54.354404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.354867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.355633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.356608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.581582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'acfcfa1246b347e983e7a78786b705e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6ddf25a4ea467abc05869d42055282', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:54.587944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1860764819 {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:39:54.594888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.595346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.596149 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.596629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.619010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Getting quotas for project 418951f01874458e878a1db4c046e79f. Resources: {'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:39:54.624055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Getting quotas for user 93772fc5e1f1440e9e1134c492ba9a16 and project 418951f01874458e878a1db4c046e79f. Resources: {'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:39:54.637146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.compute.api [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] ram quota exceeded for 6c6ddf25a4ea467abc05869d42055282, tried to resize instance. Apr 02 21:39:54.637699 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Apr 02 21:39:54.638296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:39:54.639147 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e24b0bf2-6b0e-4b82-8350-76f7caa540bd tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b/action" status: 403 len: 118 microversion: 2.1 time: 0.295676 Apr 02 21:39:54.639715 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3175/6652] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:39:54 2022] POST /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b/action => generated 118 bytes in 297 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:39:54.648184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22cb2880-a3f3-4a41-89c9-7ff259ae9c37 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:54.649013 ncdv-master-1 devstack@n-api.service[136518]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:39:54.649013 ncdv-master-1 devstack@n-api.service[136518]: warnings.warn(msg) Apr 02 21:39:54.665388 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22cb2880-a3f3-4a41-89c9-7ff259ae9c37 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1092917520" status: 202 len: 0 microversion: 2.1 time: 0.020921 Apr 02 21:39:54.665955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3478/6653] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Apr 2 21:39:54 2022] DELETE /compute/v2.1/flavors/1092917520 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:39:54.674416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1dd1e7c2-996d-47eb-bc0e-3327ef388f23 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:54.695368 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1dd1e7c2-996d-47eb-bc0e-3327ef388f23 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024542 Apr 02 21:39:54.695928 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3176/6654] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:39:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:54.712527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6379ae6c-643e-418c-97c7-ca4ce017e76f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Calling method '.version_select at 0x7f54c7765c10>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:54.782463 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6379ae6c-643e-418c-97c7-ca4ce017e76f tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/6c6ddf25a4ea467abc05869d42055282" status: 200 len: 371 microversion: 2.1 time: 0.073555 Apr 02 21:39:54.782986 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3479/6655] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Apr 2 21:39:54 2022] GET /compute/v2.1/os-quota-sets/6c6ddf25a4ea467abc05869d42055282 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:54.793180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d25aea9-7627-4b27-bbbc-9f12a15e0958 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1791117533", "id": 243566540, "os-flavor-access:is_public": "True"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:54.795606 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:39:54.795606 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:39:54.810089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d25aea9-7627-4b27-bbbc-9f12a15e0958 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.020720 Apr 02 21:39:54.810661 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3177/6656] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:39:54 2022] POST /compute/v2.1/flavors => generated 434 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:54.821216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "243566540"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:54.822228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:54.828139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.828651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.829438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:54.829893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:54.995459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'acfcfa1246b347e983e7a78786b705e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6ddf25a4ea467abc05869d42055282', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:55.002116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1791117533 {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:39:55.008661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:55.009135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:55.009961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:55.010420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:55.032047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Getting quotas for project 418951f01874458e878a1db4c046e79f. Resources: {'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:39:55.037153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Getting quotas for user 93772fc5e1f1440e9e1134c492ba9a16 and project 418951f01874458e878a1db4c046e79f. Resources: {'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:39:55.050370 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.compute.api [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] cores quota exceeded for 6c6ddf25a4ea467abc05869d42055282, tried to resize instance. Apr 02 21:39:55.050929 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Apr 02 21:39:55.051545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:39:55.052418 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c31bb867-c666-44b8-8d03-f02fe9a4af18 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b/action" status: 403 len: 113 microversion: 2.1 time: 0.235189 Apr 02 21:39:55.053024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3480/6657] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:39:54 2022] POST /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b/action => generated 113 bytes in 236 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:39:55.061167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9dd53246-6e5b-4cda-88e4-e74e0dc7a20a tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:55.061936 ncdv-master-1 devstack@n-api.service[136517]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 02 21:39:55.061936 ncdv-master-1 devstack@n-api.service[136517]: warnings.warn(msg) Apr 02 21:39:55.078741 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9dd53246-6e5b-4cda-88e4-e74e0dc7a20a tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/243566540" status: 202 len: 0 microversion: 2.1 time: 0.021225 Apr 02 21:39:55.079313 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3178/6658] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Apr 2 21:39:55 2022] DELETE /compute/v2.1/flavors/243566540 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:39:55.087173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-08f263de-4e32-4728-9f4f-bbc31456afc2 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:55.106702 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-08f263de-4e32-4728-9f4f-bbc31456afc2 tempest-ServersAdminNegativeTestJSON-317473222 tempest-ServersAdminNegativeTestJSON-317473222-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023174 Apr 02 21:39:55.107270 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3481/6659] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Apr 2 21:39:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:55.123538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:55.124048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:55.130027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:55.130484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:55.131250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:55.131695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:55.156618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:39:55.233595 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-48614d44-4200-40c5-bc0f-cc8f3b18e297 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 204 len: 0 microversion: 2.1 time: 0.113762 Apr 02 21:39:55.234318 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3179/6660] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:39:55 2022] DELETE /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:39:55.242931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:55.243586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:55.249694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:55.250161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:55.250937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:55.251386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:55.392048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:55.399668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6630ddae-f6dc-415d-97d7-4dfa7213281e tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1477 microversion: 2.1 time: 0.161057 Apr 02 21:39:55.400211 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3482/6661] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:55 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:56.417303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:56.418016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:56.425834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:56.426296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:56.427065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:56.427512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:56.560288 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:56.567910 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a6e62047-0bd3-4a2b-a2ed-1593805522c7 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1477 microversion: 2.1 time: 0.154924 Apr 02 21:39:56.568503 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3180/6662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:56 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:57.127466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9b065ac3-2fd3-4bd7-8f6a-e9416377323a req-5344288f-35c1-4fa9-8d9b-04a658c5187c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fe0570-ed90-4a9b-aadd-615e140b9f9b", "name": "network-vif-deleted", "tag": "51b391c7-1c21-4594-9b4b-43366dbb0bbc"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:39:57.138566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9b065ac3-2fd3-4bd7-8f6a-e9416377323a req-5344288f-35c1-4fa9-8d9b-04a658c5187c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:57.139032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9b065ac3-2fd3-4bd7-8f6a-e9416377323a req-5344288f-35c1-4fa9-8d9b-04a658c5187c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:57.152430 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9b065ac3-2fd3-4bd7-8f6a-e9416377323a req-5344288f-35c1-4fa9-8d9b-04a658c5187c service nova] Creating event network-vif-deleted:51b391c7-1c21-4594-9b4b-43366dbb0bbc for instance e5fe0570-ed90-4a9b-aadd-615e140b9f9b on nch2-master-1 Apr 02 21:39:57.158307 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9b065ac3-2fd3-4bd7-8f6a-e9416377323a req-5344288f-35c1-4fa9-8d9b-04a658c5187c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 Apr 02 21:39:57.158929 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3483/6663] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:39:57.585137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:57.585675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:57.593006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:57.593466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:57.594240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:57.594685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:57.626273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:57.626727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:57.627210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lazy-loading 'fault' on Instance uuid e5fe0570-ed90-4a9b-aadd-615e140b9f9b {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:39:57.666578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93772fc5e1f1440e9e1134c492ba9a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418951f01874458e878a1db4c046e79f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:39:57.674769 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-21a28d23-4b8a-4d72-9872-26c756aaf802 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 200 len: 1311 microversion: 2.1 time: 0.093675 Apr 02 21:39:57.675353 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3181/6664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:57 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:39:58.692556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:39:58.693285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] [instance: e5fe0570-ed90-4a9b-aadd-615e140b9f9b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:39:58.700148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:58.700670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:58.701462 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:39:58.701921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:39:58.714914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] HTTP exception thrown: Instance e5fe0570-ed90-4a9b-aadd-615e140b9f9b could not be found. Apr 02 21:39:58.715482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] Returning 404 to user: Instance e5fe0570-ed90-4a9b-aadd-615e140b9f9b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:39:58.716320 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-57961ab1-a87e-4310-8083-1f1b39bb0131 tempest-ServersAdminNegativeTestJSON-45869640 tempest-ServersAdminNegativeTestJSON-45869640-project] 10.222.0.18 "GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b" status: 404 len: 111 microversion: 2.1 time: 0.028973 Apr 02 21:39:58.716876 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3484/6665] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:39:58 2022] GET /compute/v2.1/servers/e5fe0570-ed90-4a9b-aadd-615e140b9f9b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:40:01.295143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1009311175", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "a3888c2a-8da7-4845-9ff3-2bb18183852f"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:01.345679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] validate_networks() for [('a3888c2a-8da7-4845-9ff3-2bb18183852f', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:40:01.678913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:40:01.679337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:40:01.679848 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:40:01.680264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:40:01.680710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:40:01.689533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:01.689988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:01.690791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:01.691228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:01.708138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Getting quotas for project efe9ec8143784104a9a9b2ecd97615da. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:40:01.713361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Getting quotas for user 583f2e33282f483e9b97db0ac6e42226 and project efe9ec8143784104a9a9b2ecd97615da. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:40:01.726284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:40:01.728620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:40:01.773076 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8dc63922-1875-44c3-b30e-7da108234f62 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593700 Apr 02 21:40:01.773744 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3182/6666] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:40:01.784624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e159408-50a3-4ff4-a1ec-69e608ded63b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:01.785259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e159408-50a3-4ff4-a1ec-69e608ded63b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:01.839393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e159408-50a3-4ff4-a1ec-69e608ded63b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:01.846736 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e159408-50a3-4ff4-a1ec-69e608ded63b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1215 microversion: 2.1 time: 0.066241 Apr 02 21:40:01.847311 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3485/6667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:01 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:40:02.864097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:02.864771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:02.870955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:02.871423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:02.872194 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:02.872680 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:02.933157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:02.940564 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-419eaa87-9972-4588-a550-2bb54625cab7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1267 microversion: 2.1 time: 0.081260 Apr 02 21:40:02.941139 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3183/6668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:02 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:03.957771 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:03.958539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:03.966999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:03.967472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:03.968269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:03.968753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:04.120055 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:04.128041 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-102da103-5117-44b3-ab60-66c0a926cd6d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1315 microversion: 2.1 time: 0.174068 Apr 02 21:40:04.128665 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3486/6669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:03 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:04.597710 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-60264db6-9915-4da6-8f3e-a27b00e6bf6c req-13f6ca94-4c9f-42d0-a799-39339cc50b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5f7c7c-e331-4df2-bbaa-668ab4edcf74", "tag": "1b33ed42-7ae3-44ae-a751-74bfa1317c1d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:04.609512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-60264db6-9915-4da6-8f3e-a27b00e6bf6c req-13f6ca94-4c9f-42d0-a799-39339cc50b7d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:04.610066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-60264db6-9915-4da6-8f3e-a27b00e6bf6c req-13f6ca94-4c9f-42d0-a799-39339cc50b7d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:04.626856 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-60264db6-9915-4da6-8f3e-a27b00e6bf6c req-13f6ca94-4c9f-42d0-a799-39339cc50b7d service nova] Creating event network-changed:1b33ed42-7ae3-44ae-a751-74bfa1317c1d for instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 on nch2-master-1 Apr 02 21:40:04.632257 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-60264db6-9915-4da6-8f3e-a27b00e6bf6c req-13f6ca94-4c9f-42d0-a799-39339cc50b7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038404 Apr 02 21:40:04.632925 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3184/6670] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:40:05.145828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:05.146458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:05.153950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:05.154426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:05.155244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:05.155703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:05.289319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:05.297966 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2a790b45-266d-4f6e-a037-8beee4e8caee tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1315 microversion: 2.1 time: 0.156031 Apr 02 21:40:05.298558 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3487/6671] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:05 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:06.316921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:06.317634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:06.323813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:06.324268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:06.325060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:06.325503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:06.466966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:06.474416 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eb8100dc-00a8-4ca4-bb99-4d8365db5b77 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1315 microversion: 2.1 time: 0.162746 Apr 02 21:40:06.475008 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3185/6672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:06 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:07.491031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:07.491662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:07.499058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:07.499521 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:07.500293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:07.500808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:07.631890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:07.639811 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2abb6bce-7c56-4fda-b087-6ca2252c6d1c tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1315 microversion: 2.1 time: 0.152593 Apr 02 21:40:07.640386 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3488/6673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:07 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:08.519486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8f7b8c8b-91dd-425a-8d4b-b46e106f7e3a req-fe7998d4-0758-4f12-9630-e5e80bbd3cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5f7c7c-e331-4df2-bbaa-668ab4edcf74", "name": "network-vif-plugged", "status": "completed", "tag": "1b33ed42-7ae3-44ae-a751-74bfa1317c1d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:08.528868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8f7b8c8b-91dd-425a-8d4b-b46e106f7e3a req-fe7998d4-0758-4f12-9630-e5e80bbd3cbf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:08.529331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8f7b8c8b-91dd-425a-8d4b-b46e106f7e3a req-fe7998d4-0758-4f12-9630-e5e80bbd3cbf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:08.540699 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8f7b8c8b-91dd-425a-8d4b-b46e106f7e3a req-fe7998d4-0758-4f12-9630-e5e80bbd3cbf service nova] Creating event network-vif-plugged:1b33ed42-7ae3-44ae-a751-74bfa1317c1d for instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 on nch2-master-1 Apr 02 21:40:08.546262 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8f7b8c8b-91dd-425a-8d4b-b46e106f7e3a req-fe7998d4-0758-4f12-9630-e5e80bbd3cbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030733 Apr 02 21:40:08.546898 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3186/6674] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:40:08.656628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:08.657290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:08.664034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:08.664540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:08.665331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:08.665823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:08.801553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:08.811865 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea0dfe17-e54e-4049-8097-e5c0638f047d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1315 microversion: 2.1 time: 0.158706 Apr 02 21:40:08.813120 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3489/6675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:08 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:09.830408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:09.831117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:09.837311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:09.837769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:09.838543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:09.838989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:09.978940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:09.986424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85920818-5780-4aae-b5ec-f8d52045e846 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1315 microversion: 2.1 time: 0.161185 Apr 02 21:40:09.987015 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3187/6676] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:09 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:11.003345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:11.003912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:11.010625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:11.011100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:11.011889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:11.012350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:11.148091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:11.157597 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-38bd25fb-3a6d-438b-ac75-a18b444d2b2f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1502 microversion: 2.1 time: 0.158169 Apr 02 21:40:11.158209 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3490/6677] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:10 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:11.174404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:11.175394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:11.183723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:11.184187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:11.185516 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:11.185967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:11.213429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:11.219132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Old instance type m1.heat2, new instance type m1.heat {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:40:11.225419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:40:11.225852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:40:11.226342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:40:11.226762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:40:11.227186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:40:11.288184 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eea73281-e148-41f8-8e70-3ec0bb1a2e74 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "POST /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74/action" status: 202 len: 0 microversion: 2.1 time: 0.117582 Apr 02 21:40:11.288942 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3188/6678] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:40:11 2022] POST /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:40:11.297545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:11.298182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:11.304758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:11.305248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:11.306048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:11.306511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:11.448163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:11.456352 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f49eb7ed-9241-4571-b0f9-2569363e4629 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1511 microversion: 2.1 time: 0.163129 Apr 02 21:40:11.456990 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3491/6679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:11 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:12.473931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:12.474588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:12.482040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:12.482512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:12.483284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:12.483737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:12.646284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:12.654401 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09cbee97-91dd-4c95-a58a-d877f110664e tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1511 microversion: 2.1 time: 0.185303 Apr 02 21:40:12.654983 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3189/6680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:12 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:13.671651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:13.672278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:13.679103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:13.679577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:13.680375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:13.680863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:13.814048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:13.821472 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dfaba72e-e0d1-416e-8f59-c12d8609c387 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.154298 Apr 02 21:40:13.822053 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3492/6681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:13 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:14.840072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:14.840761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:14.848210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:14.848711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:14.849498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:14.849947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:14.989895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:14.997279 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8731e1a8-2deb-4fd9-8827-719f33c88856 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.161259 Apr 02 21:40:14.997868 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3190/6682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:14 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:16.014359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:16.014978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:16.021881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:16.022352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:16.023139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:16.023596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:16.158954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:16.166287 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4223d57c-d255-430e-b112-3271ac1f7af4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.155845 Apr 02 21:40:16.166852 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3493/6683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:16 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:17.184011 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:17.185191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:17.191975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:17.192435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:17.193238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:17.193688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:17.324160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:17.332207 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08c78aef-acab-4105-9702-e4bf611066a1 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.152129 Apr 02 21:40:17.332816 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3191/6684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:17 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:18.349150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:18.349787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:18.356601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:18.357079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:18.357902 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:18.358362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:18.497714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:18.505394 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-244c8dd3-95f7-4eed-a431-256dd2af617d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.160081 Apr 02 21:40:18.505978 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3494/6685] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:18 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:19.523132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:19.523781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:19.530767 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:19.531243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:19.532023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:19.532496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:19.665642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:19.673892 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8fe99b72-99d2-4725-bfa0-30da33bec3a7 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.154909 Apr 02 21:40:19.674466 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3192/6686] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:19 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:20.691487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:20.692112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:20.698881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:20.699347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:20.700120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:20.700613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:20.832611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:20.840000 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1b644e44-39d4-4260-86d6-7eb98fce27b4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.152512 Apr 02 21:40:20.840584 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3495/6687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:20 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:21.857060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:21.857689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:21.864507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:21.864967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:21.865737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:21.866177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:21.997677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:22.005084 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cec6dd20-6c60-4ded-95cc-767bf3f8f676 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.151906 Apr 02 21:40:22.005669 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3193/6688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:21 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:23.021773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:23.022405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:23.029789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:23.030259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:23.031046 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:23.031503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:23.166928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:23.174902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d4e3c27b-1b50-4534-8efe-531cf1e0f0da tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.156987 Apr 02 21:40:23.175481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3496/6689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:23 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:24.191811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:24.192431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:24.199502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:24.199991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:24.200825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:24.201273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:24.335912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:24.343429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-abe518f0-11fd-426f-beb1-39792f531308 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.155622 Apr 02 21:40:24.344010 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3194/6690] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:24 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:25.360293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:25.360952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:25.367712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:25.368182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:25.369086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:25.369989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:25.503975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:25.511391 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f9150522-e4e0-411c-b557-c796763a20ce tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.155037 Apr 02 21:40:25.511965 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3497/6691] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:25 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:26.529604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:26.530231 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:26.537031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:26.537498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:26.538271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:26.538721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:26.671791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:26.679224 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-29994085-579b-4595-a07a-5cd52d1287d0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.154210 Apr 02 21:40:26.679800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3195/6692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:26 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:27.696063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:27.696741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:27.703546 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:27.704014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:27.704845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:27.705305 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:27.839551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:27.847590 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3577a09-f5b7-46bb-98c4-4331cf31f5f4 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.155277 Apr 02 21:40:27.848163 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3498/6693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:27 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:28.863951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:28.864596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:28.871335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:28.871793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:28.872590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:28.873034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:29.007165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:29.015151 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-332fd895-3d50-40e9-b189-5270b7177538 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.155186 Apr 02 21:40:29.015720 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3196/6694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:28 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:30.031454 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:30.032217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:30.039306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:30.039779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:30.040593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:30.041054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:30.178997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:30.187095 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3eced5f8-829e-4214-b9f0-7d068bc04301 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.159644 Apr 02 21:40:30.187673 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3499/6695] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:30 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:31.204784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:31.205399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:31.212162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:31.212661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:31.213436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:31.213882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:31.349890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:31.357322 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dfacf74b-b045-41d6-8dc5-3a38dc580904 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.157147 Apr 02 21:40:31.357897 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3197/6696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:31 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:32.375154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:32.375789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:32.382617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:32.383090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:32.383880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:32.384342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:32.519327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:32.526959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab8dd287-2dbd-466d-ab84-3200b28fb681 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.156260 Apr 02 21:40:32.527543 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3500/6697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:32 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:33.543221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:33.543844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:33.550983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:33.551447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:33.552218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:33.552695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:33.684725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:33.692680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-402c6620-b652-4a44-bc1e-9325649e9801 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.153487 Apr 02 21:40:33.693261 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3198/6698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:33 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:34.710284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:34.710851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:34.717581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:34.718050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:34.718833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:34.719289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:34.854849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:34.862708 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e5d60d4-4065-42ba-b822-ee5e7cef91f0 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.156392 Apr 02 21:40:34.863306 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3501/6699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:34 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:35.879628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:35.880238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:35.887044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:35.887497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:35.888260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:35.888729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:36.022991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:36.030499 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74e4af68-8b0c-434b-9226-d80f66f4340a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.154829 Apr 02 21:40:36.031066 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3199/6700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:35 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:37.047669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:37.048293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:37.055074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:37.055539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:37.056315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:37.056803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:37.185640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:37.193052 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d65ff24-f2ff-4be2-a962-4aca99064b6b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.149572 Apr 02 21:40:37.193626 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3502/6701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:37 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:38.210525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:38.211150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:38.218591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:38.219056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:38.219836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:38.220289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:38.352500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:38.360508 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e96a1f2d-3060-43fd-a5ed-4292172d692f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.153867 Apr 02 21:40:38.361095 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3200/6702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:38 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:39.378101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:39.378769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:39.385523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:39.385992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:39.386770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:39.387224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:39.523739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:39.531725 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2d55236c-22ac-439d-9669-0e1b7000bc3f tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.158135 Apr 02 21:40:39.532314 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3503/6703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:39 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:40.549725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:40.550348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:40.557482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:40.557948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:40.558727 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:40.559175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:40.687654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:40.695495 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aefbcbb9-18fc-4aaf-b624-44fe500d1ecf tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.150294 Apr 02 21:40:40.696071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3201/6704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:40 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:41.713145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:41.713770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:41.719769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:41.720233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:41.721037 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:41.721492 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:41.853861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:41.861240 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-12ba0ef4-2151-4ccc-9ff6-162fda7a49bd tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.152221 Apr 02 21:40:41.861818 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3504/6705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:41 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:42.878976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:42.879514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:42.886418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:42.886874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:42.887640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:42.888081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:43.026883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:43.034382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-55da0ade-27ec-4251-bde9-1dd954f1a11b tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.159527 Apr 02 21:40:43.034974 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3202/6706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:42 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:44.051878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:44.052526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:44.059332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:44.059805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:44.060625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:44.061084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:44.189102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:44.196684 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fd58b011-f1d5-435a-a8e6-c76d52962950 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.148674 Apr 02 21:40:44.197263 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3505/6707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:44 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:45.213683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:45.214368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:45.221801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:45.222255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:45.223058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:45.223500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:45.398909 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:45.410649 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67941b5e-427c-4354-886d-4b78f63dcab2 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1516 microversion: 2.1 time: 0.200849 Apr 02 21:40:45.411239 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3203/6708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:45 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:46.428299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:46.429078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:46.435775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:46.436246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:46.437058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:46.437518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:46.578653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:46.586221 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-345c82e6-3d26-47a4-a14d-f7a5abd584dc tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1513 microversion: 2.1 time: 0.161829 Apr 02 21:40:46.586804 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3506/6709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:46 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:47.603981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:47.604596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:47.611368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:47.611827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:47.612623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:47.613066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:47.762214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:47.769659 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e25969c2-fd6d-4474-94b1-3fec3a7e91c9 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1513 microversion: 2.1 time: 0.170610 Apr 02 21:40:47.770236 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3204/6710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:47 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:48.786698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:48.787327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:48.794036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:48.794772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:48.795600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:48.796054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:48.833207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-87f8248f-76f3-40c4-8417-57e7ef4cb0a4 req-fca19d5d-1ad1-443a-ac8b-7ddc1ddce660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5f7c7c-e331-4df2-bbaa-668ab4edcf74", "name": "network-vif-unplugged", "status": "completed", "tag": "1b33ed42-7ae3-44ae-a751-74bfa1317c1d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:48.844064 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-87f8248f-76f3-40c4-8417-57e7ef4cb0a4 req-fca19d5d-1ad1-443a-ac8b-7ddc1ddce660 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:48.844951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-87f8248f-76f3-40c4-8417-57e7ef4cb0a4 req-fca19d5d-1ad1-443a-ac8b-7ddc1ddce660 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:48.859329 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-87f8248f-76f3-40c4-8417-57e7ef4cb0a4 req-fca19d5d-1ad1-443a-ac8b-7ddc1ddce660 service nova] Creating event network-vif-unplugged:1b33ed42-7ae3-44ae-a751-74bfa1317c1d for instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 on nch2-master-1 Apr 02 21:40:48.864421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-87f8248f-76f3-40c4-8417-57e7ef4cb0a4 req-fca19d5d-1ad1-443a-ac8b-7ddc1ddce660 service nova] Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:40:48.871625 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-87f8248f-76f3-40c4-8417-57e7ef4cb0a4 req-fca19d5d-1ad1-443a-ac8b-7ddc1ddce660 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042708 Apr 02 21:40:48.872431 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3205/6711] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:40:48.934053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:48.942116 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ed9bd71-af5c-48ba-9f0e-6ed510888be8 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1510 microversion: 2.1 time: 0.159329 Apr 02 21:40:48.942684 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3507/6712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:48 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:48.958480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:48.959077 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:48.965290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:48.965760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:48.966513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:48.966999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:48.992814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:40:49.040995 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.compute.api [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Found an unconfirmed migration during delete, id: 16, status: finished Apr 02 21:40:50.274097 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-802f57b6-fc24-41fa-9323-f18e0492413a tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 204 len: 0 microversion: 2.1 time: 1.319214 Apr 02 21:40:50.274909 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3206/6713] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:40:48 2022] DELETE /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 0 bytes in 1321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:40:50.282955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:50.283601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:50.290445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:50.290922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:50.291721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:50.292186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:50.431033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:50.439218 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d38f3e97-3499-4a95-8bb1-b8afabc68694 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1502 microversion: 2.1 time: 0.160181 Apr 02 21:40:50.439767 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3508/6714] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:50 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:51.456713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:51.457421 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:51.464198 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:51.464698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:51.465470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:51.465921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:51.601731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '583f2e33282f483e9b97db0ac6e42226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe9ec8143784104a9a9b2ecd97615da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:51.610032 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-72f96ad9-f312-49ce-be73-a84a7d1029b6 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 200 len: 1502 microversion: 2.1 time: 0.157718 Apr 02 21:40:51.610614 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3207/6715] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:51 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:52.092413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-17f72a35-2e3f-498b-84f6-4268646c0a63 req-86dafdfb-8851-40b8-a54c-64507830c4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5f7c7c-e331-4df2-bbaa-668ab4edcf74", "name": "network-vif-deleted", "tag": "1b33ed42-7ae3-44ae-a751-74bfa1317c1d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:52.102846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-17f72a35-2e3f-498b-84f6-4268646c0a63 req-86dafdfb-8851-40b8-a54c-64507830c4fd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.103505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-17f72a35-2e3f-498b-84f6-4268646c0a63 req-86dafdfb-8851-40b8-a54c-64507830c4fd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.115350 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-17f72a35-2e3f-498b-84f6-4268646c0a63 req-86dafdfb-8851-40b8-a54c-64507830c4fd service nova] Creating event network-vif-deleted:1b33ed42-7ae3-44ae-a751-74bfa1317c1d for instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 on nch2-master-1 Apr 02 21:40:52.121824 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-17f72a35-2e3f-498b-84f6-4268646c0a63 req-86dafdfb-8851-40b8-a54c-64507830c4fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Apr 02 21:40:52.122576 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3509/6716] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:40:52.628703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:52.629511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:52.642146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.642599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.643477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.643995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.661124 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] HTTP exception thrown: Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 could not be found. Apr 02 21:40:52.661739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Returning 404 to user: Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:40:52.662600 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bbb4214c-1953-4e73-a05a-3498370cd039 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 404 len: 111 microversion: 2.1 time: 0.039582 Apr 02 21:40:52.663167 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3208/6717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:52 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:40:52.679530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:52.680247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:52.687413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.687966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.688930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.689440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.703504 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] HTTP exception thrown: Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 could not be found. Apr 02 21:40:52.704416 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Returning 404 to user: Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:40:52.705519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f15ff5f-0282-47ac-8389-06ab3f6de05d tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 404 len: 111 microversion: 2.1 time: 0.031385 Apr 02 21:40:52.706021 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3510/6718] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:40:52 2022] DELETE /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:40:52.717641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:52.718624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] [instance: 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:52.727561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.728275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.729518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:52.730244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:52.750132 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] HTTP exception thrown: Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 could not be found. Apr 02 21:40:52.751037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] Returning 404 to user: Instance 4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:40:52.752354 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2380ba1f-38e2-4a3a-827e-65a260184be3 tempest-DeleteServersTestJSON-207145193 tempest-DeleteServersTestJSON-207145193-project] 10.222.0.18 "GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74" status: 404 len: 111 microversion: 2.1 time: 0.040995 Apr 02 21:40:52.753521 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3209/6719] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:52 2022] GET /compute/v2.1/servers/4f5f7c7c-e331-4df2-bbaa-668ab4edcf74 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:40:55.132323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1221548182", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "b708ed11-cbd7-4ab2-b833-27e932c28165"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:55.182776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] validate_networks() for [('b708ed11-cbd7-4ab2-b833-27e932c28165', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:40:55.846215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:40:55.846657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:40:55.847174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:40:55.847600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:40:55.848026 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:40:55.857032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:55.858086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:55.858931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:55.859384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:55.876320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Getting quotas for project eec749d6a2ca48f7b17c3d2aaa3f5c67. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:40:55.881533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Getting quotas for user 036baf67847140d8842f877f1e42ea32 and project eec749d6a2ca48f7b17c3d2aaa3f5c67. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:40:55.893620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:40:55.895909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:40:55.940329 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a246655e-110e-469d-b168-1573525b7aaa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932181 Apr 02 21:40:55.941003 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3511/6720] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:40:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:40:55.950993 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b71e2c6f-0804-49f5-a717-0719ec1d649d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:55.951605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b71e2c6f-0804-49f5-a717-0719ec1d649d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:56.008412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b71e2c6f-0804-49f5-a717-0719ec1d649d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:56.015758 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b71e2c6f-0804-49f5-a717-0719ec1d649d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1218 microversion: 2.1 time: 0.068641 Apr 02 21:40:56.016757 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3210/6721] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:55 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:57.034019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:57.035403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:57.042386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:57.042861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:57.043657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:57.044117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:57.108245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:57.116525 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9c290f1a-d90a-4d19-b53f-fb30d3223b56 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1278 microversion: 2.1 time: 0.087399 Apr 02 21:40:57.117298 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3512/6722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:57 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:58.134507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:58.135130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:58.143338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:58.143803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:58.144618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:58.145066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:58.335532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-df96ff26-31db-4824-a10b-fff0bb0b1ec7 req-c5ef43df-4d40-485e-b57f-4cf78a08eb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4155331c-9baa-411d-a91f-659675bb47da", "tag": "5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:40:58.345180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-df96ff26-31db-4824-a10b-fff0bb0b1ec7 req-c5ef43df-4d40-485e-b57f-4cf78a08eb5b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:58.345542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-df96ff26-31db-4824-a10b-fff0bb0b1ec7 req-c5ef43df-4d40-485e-b57f-4cf78a08eb5b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:58.357711 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-df96ff26-31db-4824-a10b-fff0bb0b1ec7 req-c5ef43df-4d40-485e-b57f-4cf78a08eb5b service nova] Creating event network-changed:5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6 for instance 4155331c-9baa-411d-a91f-659675bb47da on nch2-master-1 Apr 02 21:40:58.362598 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-df96ff26-31db-4824-a10b-fff0bb0b1ec7 req-c5ef43df-4d40-485e-b57f-4cf78a08eb5b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030971 Apr 02 21:40:58.363622 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3513/6723] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:40:58.407771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:58.415106 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-85b9b5ce-0f8d-4f4a-b469-1a22436a5c22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.284667 Apr 02 21:40:58.415716 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3211/6724] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:58 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:40:59.434230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:40:59.434887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:40:59.441841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:59.442258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:59.443050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:40:59.443508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:40:59.585574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:40:59.593003 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8b989161-6013-4a4c-ab47-90e4d66c5ed3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.163955 Apr 02 21:40:59.593594 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3514/6725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:40:59 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:00.609789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:00.610414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:00.617197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:00.617652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:00.618417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:00.618857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:00.752367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:00.760438 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f6dc562-3bad-426d-88ee-b7e6bfb7b7e2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.154569 Apr 02 21:41:00.761212 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3212/6726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:00 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:41:01.778606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:01.779895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:01.786774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:01.787249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:01.788022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:01.788497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:01.918082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:01.925704 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab4901c1-e064-40c2-9b24-e667f93e1192 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.151016 Apr 02 21:41:01.926271 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3515/6727] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:01 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:02.942527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:02.943146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:02.950026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:02.950490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:02.951887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:02.952335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:03.406752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:03.414121 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56148c22-20b4-4715-941c-f91719a6b16c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.475526 Apr 02 21:41:03.414771 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3213/6728] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:02 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:04.433113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:04.433746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:04.439691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:04.440162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:04.440989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:04.441449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:04.576690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:04.584054 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebf3c82d-13a9-40d4-ad51-b8033f3713bf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.156703 Apr 02 21:41:04.584917 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3516/6729] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:04 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:04.871267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-efa9b471-2ec1-4eea-b37f-b9252278be41 req-086e99ca-e55a-44b1-962f-06ac2ddc92c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4155331c-9baa-411d-a91f-659675bb47da", "name": "network-vif-plugged", "status": "completed", "tag": "5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:04.882392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-efa9b471-2ec1-4eea-b37f-b9252278be41 req-086e99ca-e55a-44b1-962f-06ac2ddc92c1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:04.882825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-efa9b471-2ec1-4eea-b37f-b9252278be41 req-086e99ca-e55a-44b1-962f-06ac2ddc92c1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:04.894578 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-efa9b471-2ec1-4eea-b37f-b9252278be41 req-086e99ca-e55a-44b1-962f-06ac2ddc92c1 service nova] Creating event network-vif-plugged:5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6 for instance 4155331c-9baa-411d-a91f-659675bb47da on nch2-master-1 Apr 02 21:41:04.899533 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-efa9b471-2ec1-4eea-b37f-b9252278be41 req-086e99ca-e55a-44b1-962f-06ac2ddc92c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Apr 02 21:41:04.900129 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3214/6730] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:41:05.601408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:05.602034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:05.610701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:05.611121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:05.611918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:05.612380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:05.745803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:05.753812 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a69700f5-856f-481c-ad64-071bb3b4d6f7 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1318 microversion: 2.1 time: 0.156296 Apr 02 21:41:05.754389 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3517/6731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:05 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:06.772141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:06.772822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:06.778996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:06.779450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:06.780211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:06.780687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:06.914882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:06.923146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46210bad-9705-4ea0-b5e4-8222660ef43c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1509 microversion: 2.1 time: 0.156404 Apr 02 21:41:06.923724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3215/6732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:06 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:06.940023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:06.940731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:06.947447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:06.947917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:06.948741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:06.949202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.083544 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:07.091017 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c65042e7-5d64-4b17-b8a9-02a9d06ee92c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1509 microversion: 2.1 time: 0.155545 Apr 02 21:41:07.091589 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3518/6733] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:06 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:07.106827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:07.108529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:07.114411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.114870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.115643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.116090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.178455 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9e86cfb6-e45c-45d2-8db9-4627bec61a7a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "PUT /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1081 microversion: 2.1 time: 0.075573 Apr 02 21:41:07.179085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3216/6734] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Apr 2 21:41:07 2022] PUT /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1081 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:07.193307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:07.193935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:07.199922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.200388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.201232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.201691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.332229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:07.339631 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fa908259-2766-41d1-9116-e8c650196faa tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1507 microversion: 2.1 time: 0.150161 Apr 02 21:41:07.340207 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3519/6735] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:07 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:41:07.355885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:07.356522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:07.363370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.363822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.364627 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.365106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.494269 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:07.501743 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ec120a14-efe8-41c4-bf0e-374e852140f8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1507 microversion: 2.1 time: 0.149765 Apr 02 21:41:07.502318 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3217/6736] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:07 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:07.518088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:07.519120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:07.525136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.525613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.526401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.526945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.556848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:07.562470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Old instance type m1.heat2, new instance type m1.heat {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:41:07.568672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:41:07.569147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:41:07.569643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:41:07.570079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:41:07.570519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:41:07.631158 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e2350985-099d-4a8d-aa6c-f19def1233ef tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "POST /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da/action" status: 202 len: 0 microversion: 2.1 time: 0.116920 Apr 02 21:41:07.632083 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3520/6737] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:41:07 2022] POST /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:41:07.640635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:07.641263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:07.647119 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.647581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.648386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:07.648833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:07.813540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:07.821044 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0c8a72e-6f2c-4598-a350-287d6c90da9e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1518 microversion: 2.1 time: 0.184931 Apr 02 21:41:07.821627 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3218/6738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:07 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:08.839666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:08.840317 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:08.846940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:08.847402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:08.848470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:08.848928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:08.989423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:08.997427 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-646d0047-fb31-4dfc-af96-35617c567188 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1518 microversion: 2.1 time: 0.162439 Apr 02 21:41:08.998104 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3521/6739] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:08 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:10.014634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:10.015301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:10.022243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:10.022641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:10.023404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:10.023853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:10.156063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:10.163610 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4c3a781d-6b0a-4d92-bb4a-38190edcd6fe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.152997 Apr 02 21:41:10.164190 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3219/6740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:10 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:11.181218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:11.181845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:11.189253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:11.189725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:11.190508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:11.190968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:11.325976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:11.334035 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-700884aa-8f4f-4a9e-aad3-b6f219fe5b3f tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.156740 Apr 02 21:41:11.334615 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3522/6741] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:11 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:12.350700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:12.351226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:12.358508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:12.358961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:12.359734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:12.360174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:12.496858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:12.505370 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-83e867e9-3a2a-4dcc-a53f-a897a3cf9c14 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.158689 Apr 02 21:41:12.506005 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3220/6742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:12 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:13.522609 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:13.523247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:13.530124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:13.530594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:13.531378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:13.531836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:13.663829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:13.673267 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b18dfa3d-8db7-4741-88e5-779d577d4fdc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.154566 Apr 02 21:41:13.673848 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3523/6743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:13 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:14.691169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:14.691825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:14.698790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:14.699253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:14.700026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:14.700489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:14.831818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:14.839304 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6ae486d0-6649-4157-a612-447ee2c3c1a5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.152100 Apr 02 21:41:14.839883 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3221/6744] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:14 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:15.855943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:15.856580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:15.863792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:15.864256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:15.865067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:15.865522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:16.001450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:16.008975 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ecd22590-e896-4673-ba4d-0171c3a94d9a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.157010 Apr 02 21:41:16.009547 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3524/6745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:15 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:17.026186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:17.026837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:17.033698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:17.034161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:17.034939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:17.035387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:17.164187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:17.171886 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2ffd2f83-0442-4228-a3bc-856c0afd2707 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.149651 Apr 02 21:41:17.172489 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3222/6746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:17 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:18.188852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:18.189480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:18.196904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:18.197409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:18.198233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:18.198692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:18.338589 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:18.347122 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e3631b94-2f4b-46b1-8ded-67903a3e1861 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.162265 Apr 02 21:41:18.347703 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3525/6747] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:18 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:19.364075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:19.364742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:19.371608 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:19.372063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:19.372870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:19.373816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:19.513142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:19.521258 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aa2446f3-d75e-411c-9c84-9e18ad28bb22 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.161148 Apr 02 21:41:19.521836 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3223/6748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:19 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:20.537824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:20.538465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:20.545527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:20.545994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:20.546769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:20.547215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:20.678801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:20.686417 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6caa9ffa-1eea-4511-ad2b-e2bb4a23a0ee tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.152441 Apr 02 21:41:20.687035 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3526/6749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:20 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:21.704031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:21.704688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:21.711440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:21.711893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:21.712719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:21.713161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:21.843563 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:21.851028 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5fe583ee-a780-417b-9eec-c21d3ab4b42d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.151527 Apr 02 21:41:21.851604 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3224/6750] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:21 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:22.868772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:22.869327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:22.876146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:22.876654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:22.877469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:22.877931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:23.012674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:23.020924 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-385d7646-cfde-42e8-bfd1-3340e46c5508 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.156205 Apr 02 21:41:23.021502 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3527/6751] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:22 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:24.037980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:24.038611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:24.045800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:24.046262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:24.047041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:24.047489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:24.180020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:24.187436 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3b4e5613-2701-415c-870b-0477de88b403 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.153457 Apr 02 21:41:24.188005 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3225/6752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:24 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:25.205405 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:25.206063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:25.212808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:25.213270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:25.214043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:25.214496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:25.345188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:25.352664 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4250fe13-579c-4736-b4d1-9ac7de49e4d9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.151570 Apr 02 21:41:25.353246 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3528/6753] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:25 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:26.369688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:26.370311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:26.378171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:26.378666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:26.380048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:26.380620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:26.516053 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:26.523836 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-65e11fc1-f112-483c-bc64-4ccd0a3adc02 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.158113 Apr 02 21:41:26.524421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3226/6754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:26 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:41:27.541469 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:27.542129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:27.549804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:27.550278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:27.551067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:27.551528 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:27.686412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:27.693847 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f03625bf-72b0-41dd-9177-538971b4f505 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.156334 Apr 02 21:41:27.694439 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3529/6755] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:27 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:28.711087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:28.711633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:28.718446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:28.718906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:28.719679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:28.720127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:28.851857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:28.860194 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-64e5b854-f21c-42f1-afbe-72a15ced49e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.153024 Apr 02 21:41:28.860895 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3227/6756] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:28 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:29.876848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:29.877459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:29.884148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:29.884654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:29.885449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:29.885884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:30.018598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:30.026239 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a642a3b-e33c-4ae3-b3b3-c1d0c469a944 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.153428 Apr 02 21:41:30.026816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3530/6757] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:29 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:31.046496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:31.047127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:31.054113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:31.054574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:31.055358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:31.055807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:31.190132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:31.197613 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49ce973f-e447-4ace-86dc-fddc6f1cd9b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.155304 Apr 02 21:41:31.198187 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3228/6758] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:31 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:32.215045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:32.215705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:32.222475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:32.222935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:32.223708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:32.224157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:32.366960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:32.374921 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07bbd1bc-3c9b-4eac-9aaf-a50cef4c754a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.163772 Apr 02 21:41:32.375494 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3531/6759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:32 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:33.392296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:33.392951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:33.399791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:33.400254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:33.401079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:33.401536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:33.535371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:33.542791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a7d6964d-4e44-4f24-a2ed-10a64c02af7e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.154950 Apr 02 21:41:33.543363 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3229/6760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:33 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:33.562383 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:41:33.562862 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:41:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:41:34.105767 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:41:34.105998 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:41:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:41:34.559912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:34.560593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:34.567617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:34.568218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:34.569038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:34.569522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:34.706140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:34.713619 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-356f7aac-a8ea-4ecb-a625-37eba4532e17 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.157633 Apr 02 21:41:34.714195 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3532/6761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:34 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:35.731227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:35.731845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:35.738726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:35.739181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:35.739948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:35.740389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:35.882384 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:35.890470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1991af03-eecb-4f62-a57b-2837e0d570cb tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1523 microversion: 2.1 time: 0.163227 Apr 02 21:41:35.891040 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3230/6762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:35 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:36.907091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:36.907706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:36.914507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:36.914960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:36.915735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:36.916186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:37.052192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:37.059890 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-397d8a3e-cff6-4d98-a94d-01d654756091 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1522 microversion: 2.1 time: 0.156607 Apr 02 21:41:37.060513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3533/6763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:36 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:38.078364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:38.078975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:38.085799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:38.086255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:38.087050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:38.087492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:38.217310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:38.224653 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71d7281a-7e89-457a-9773-bc7946ae31dd tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1520 microversion: 2.1 time: 0.150815 Apr 02 21:41:38.225222 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3231/6764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:38 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:39.019818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-5f62df2c-f8be-4622-a2ed-932b4e7753d5 req-4b512859-8d97-4662-a39b-7c787253e247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4155331c-9baa-411d-a91f-659675bb47da", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:39.028774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5f62df2c-f8be-4622-a2ed-932b4e7753d5 req-4b512859-8d97-4662-a39b-7c787253e247 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.029779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-5f62df2c-f8be-4622-a2ed-932b4e7753d5 req-4b512859-8d97-4662-a39b-7c787253e247 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.041701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-5f62df2c-f8be-4622-a2ed-932b4e7753d5 req-4b512859-8d97-4662-a39b-7c787253e247 service nova] Creating event network-vif-unplugged:5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6 for instance 4155331c-9baa-411d-a91f-659675bb47da on nch2-master-1 Apr 02 21:41:39.048008 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-5f62df2c-f8be-4622-a2ed-932b4e7753d5 req-4b512859-8d97-4662-a39b-7c787253e247 service nova] Instance 4155331c-9baa-411d-a91f-659675bb47da is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:41:39.054348 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-5f62df2c-f8be-4622-a2ed-932b4e7753d5 req-4b512859-8d97-4662-a39b-7c787253e247 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038155 Apr 02 21:41:39.055022 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3534/6765] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:41:39.241971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:39.242524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:39.249351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.249814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.250588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.251036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.386063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:39.394170 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3ce8ee3-35d4-4241-a487-b3792e1869e4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1517 microversion: 2.1 time: 0.156260 Apr 02 21:41:39.394746 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3232/6766] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:39 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:39.411422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:39.412064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:39.418189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.418661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.419711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.420175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.476016 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bd83c85c-1dd0-499e-a91b-2b6632dae158 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "POST /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da/action" status: 204 len: 0 microversion: 2.1 time: 0.068609 Apr 02 21:41:39.476814 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3535/6767] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:41:39 2022] POST /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:41:39.486431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:39.487050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:39.493196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.493701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.494803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:39.495361 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:39.672431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:39.680098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-63ace61f-99bb-482f-b51a-2328def16c79 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1517 microversion: 2.1 time: 0.198938 Apr 02 21:41:39.680718 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3233/6768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:39 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:40.699010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:40.699735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:40.706365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:40.706783 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:40.707575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:40.708056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:40.846012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:40.853349 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8454f943-0a56-4498-add6-ef0a9785c8ec tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1509 microversion: 2.1 time: 0.159772 Apr 02 21:41:40.853914 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3536/6769] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:40 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:40.869893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:40.870762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:40.878083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:40.878527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:40.879292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:40.879731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.014090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:41.021641 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09c19132-91ab-4dff-bf18-b849d69c9d58 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1509 microversion: 2.1 time: 0.155635 Apr 02 21:41:41.022219 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3234/6770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:40 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:41.038749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:41.039410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:41.046274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:41.046744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.047572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:41.048030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.180113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:41.187551 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3ae43769-7f3c-4672-bd5e-9e0930e65721 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 200 len: 1509 microversion: 2.1 time: 0.152989 Apr 02 21:41:41.188113 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3537/6771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:41 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:41.203125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:41.203630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:41.209602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:41.210060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.210826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:41.211346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.235897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:41:41.309688 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-086635c8-376a-4d2c-ac83-bd04cd3b90b6 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 204 len: 0 microversion: 2.1 time: 0.110187 Apr 02 21:41:41.310584 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3235/6772] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:41:41 2022] DELETE /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:41:41.364978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1379745243", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "b708ed11-cbd7-4ab2-b833-27e932c28165"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:41.417135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] validate_networks() for [('b708ed11-cbd7-4ab2-b833-27e932c28165', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:41:41.777864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:41:41.778464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:41:41.778956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:41:41.779386 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:41:41.779812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:41:41.788642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:41.789105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.789930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:41.790380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:41.807763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Getting quotas for project eec749d6a2ca48f7b17c3d2aaa3f5c67. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:41:41.813461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Getting quotas for user 036baf67847140d8842f877f1e42ea32 and project eec749d6a2ca48f7b17c3d2aaa3f5c67. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:41:41.825450 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:41:41.828342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:41:41.870978 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-402458c3-0d76-4fbe-83ba-37ac048d9fcf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509959 Apr 02 21:41:41.871654 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3538/6773] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 02 21:41:41.882815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8b53e4e-16e7-492a-a4d2-963ec797cf10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:41.883554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8b53e4e-16e7-492a-a4d2-963ec797cf10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:41.938699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8b53e4e-16e7-492a-a4d2-963ec797cf10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:41.948850 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8b53e4e-16e7-492a-a4d2-963ec797cf10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1218 microversion: 2.1 time: 0.070310 Apr 02 21:41:41.949703 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3236/6774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:41 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:42.968226 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:42.968935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:42.976912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:42.977387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:42.978716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:42.979515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:43.049881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:43.059077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f2a63944-0cff-4f00-bed7-d5a19cc54260 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1276 microversion: 2.1 time: 0.095721 Apr 02 21:41:43.061866 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3539/6775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:42 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:43.180105 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-fd142faa-0fb7-4e0b-8867-ab177ab10f1d req-d86bd3f6-b0c6-4a23-bf81-4ee1ad4107f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4155331c-9baa-411d-a91f-659675bb47da", "name": "network-vif-plugged", "status": "completed", "tag": "5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:43.188687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fd142faa-0fb7-4e0b-8867-ab177ab10f1d req-d86bd3f6-b0c6-4a23-bf81-4ee1ad4107f7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:43.189151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-fd142faa-0fb7-4e0b-8867-ab177ab10f1d req-d86bd3f6-b0c6-4a23-bf81-4ee1ad4107f7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:43.200543 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-fd142faa-0fb7-4e0b-8867-ab177ab10f1d req-d86bd3f6-b0c6-4a23-bf81-4ee1ad4107f7 service nova] Creating event network-vif-plugged:5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6 for instance 4155331c-9baa-411d-a91f-659675bb47da on nch2-master-1 Apr 02 21:41:43.205737 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-fd142faa-0fb7-4e0b-8867-ab177ab10f1d req-d86bd3f6-b0c6-4a23-bf81-4ee1ad4107f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105405 Apr 02 21:41:43.206541 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3237/6776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:41:43.770439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-75466009-fe9d-45f5-9649-98a1c22395d0 req-2259b42d-2a30-432e-902d-fb61982e4060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4155331c-9baa-411d-a91f-659675bb47da", "name": "network-vif-deleted", "tag": "5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:43.778874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-75466009-fe9d-45f5-9649-98a1c22395d0 req-2259b42d-2a30-432e-902d-fb61982e4060 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:43.781007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-75466009-fe9d-45f5-9649-98a1c22395d0 req-2259b42d-2a30-432e-902d-fb61982e4060 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:43.798061 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-75466009-fe9d-45f5-9649-98a1c22395d0 req-2259b42d-2a30-432e-902d-fb61982e4060 service nova] Creating event network-vif-deleted:5fc5cf40-fe6e-4306-a8d8-0e6bd0f9abb6 for instance 4155331c-9baa-411d-a91f-659675bb47da on nch2-master-1 Apr 02 21:41:43.803115 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-75466009-fe9d-45f5-9649-98a1c22395d0 req-2259b42d-2a30-432e-902d-fb61982e4060 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124995 Apr 02 21:41:43.803735 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3540/6777] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:41:44.078014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:44.078747 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:44.085147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:44.085607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:44.086387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:44.086834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:44.319907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:44.328477 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fdce9ba4-a923-4d5c-bad2-75078808fad8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.255387 Apr 02 21:41:44.329076 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3238/6778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:44 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:45.347331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:45.348040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:45.354241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:45.354704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:45.355474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:45.355929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:45.494240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:45.502141 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5a33fc07-195f-4217-af32-ae0c80690a0b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.160539 Apr 02 21:41:45.502714 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3541/6779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:45 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:45.820391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-49a4d507-0a7c-427b-a307-4804f43e06f9 req-9082b047-a691-4ea5-b45a-d42d08868425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f72cd45-eb1d-406f-a20d-1c58872161bf", "tag": "6da77808-57aa-44b7-9b4f-3d9a27329f71"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:45.830035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-49a4d507-0a7c-427b-a307-4804f43e06f9 req-9082b047-a691-4ea5-b45a-d42d08868425 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:45.830488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-49a4d507-0a7c-427b-a307-4804f43e06f9 req-9082b047-a691-4ea5-b45a-d42d08868425 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:45.841675 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-49a4d507-0a7c-427b-a307-4804f43e06f9 req-9082b047-a691-4ea5-b45a-d42d08868425 service nova] Creating event network-changed:6da77808-57aa-44b7-9b4f-3d9a27329f71 for instance 8f72cd45-eb1d-406f-a20d-1c58872161bf on nch2-master-1 Apr 02 21:41:45.846853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-49a4d507-0a7c-427b-a307-4804f43e06f9 req-9082b047-a691-4ea5-b45a-d42d08868425 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030147 Apr 02 21:41:45.847544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3239/6780] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:41:46.520123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:46.520936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:46.528122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:46.528725 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:46.529572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:46.530099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:46.666920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:46.675545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc3550ee-0245-4d34-8b17-0bc0d6ca8ffe tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.159955 Apr 02 21:41:46.676210 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3542/6781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:46 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:47.693291 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:47.693997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:47.701602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:47.702056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:47.702816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:47.703263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:47.837529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:47.844893 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c46d4e13-6ea4-47fc-be0d-7741121443da tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.155973 Apr 02 21:41:47.845470 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3240/6782] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:47 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:48.862152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:48.862779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:48.870080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:48.870552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:48.871327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:48.871779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:49.009274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:49.016644 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c976bcb1-e392-473f-bfd3-95f02c3f4531 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.158361 Apr 02 21:41:49.017222 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3543/6783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:48 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:50.033330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:50.033954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:50.040876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:50.041344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:50.042132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:50.042580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:50.176447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:50.183803 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f24be36d-2132-4155-a39c-2cc4c565e8b2 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.154397 Apr 02 21:41:50.184384 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3241/6784] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:50 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:51.158722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f7fcab22-4af6-472a-97ac-f2bad3a2f6f6 req-793acbb2-5f65-482c-a4ec-27e00c190176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f72cd45-eb1d-406f-a20d-1c58872161bf", "name": "network-vif-plugged", "status": "completed", "tag": "6da77808-57aa-44b7-9b4f-3d9a27329f71"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:51.168205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f7fcab22-4af6-472a-97ac-f2bad3a2f6f6 req-793acbb2-5f65-482c-a4ec-27e00c190176 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:51.168780 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f7fcab22-4af6-472a-97ac-f2bad3a2f6f6 req-793acbb2-5f65-482c-a4ec-27e00c190176 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:51.181816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f7fcab22-4af6-472a-97ac-f2bad3a2f6f6 req-793acbb2-5f65-482c-a4ec-27e00c190176 service nova] Creating event network-vif-plugged:6da77808-57aa-44b7-9b4f-3d9a27329f71 for instance 8f72cd45-eb1d-406f-a20d-1c58872161bf on nch2-master-1 Apr 02 21:41:51.187493 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f7fcab22-4af6-472a-97ac-f2bad3a2f6f6 req-793acbb2-5f65-482c-a4ec-27e00c190176 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Apr 02 21:41:51.188103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3544/6785] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:41:51.201255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:51.202568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:51.209923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:51.210467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:51.211327 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:51.211851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:51.400890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:51.408501 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5adc8f96-56fc-4c35-a258-2c05c34bf53b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.211595 Apr 02 21:41:51.409090 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3242/6786] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:51 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:52.426866 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:52.427583 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:52.434584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:52.435056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:52.435837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:52.436299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:52.573284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:52.580646 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2dce34d-82ba-4759-a96f-6934fb8cd550 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1318 microversion: 2.1 time: 0.158070 Apr 02 21:41:52.581223 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3545/6787] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:52 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:53.597426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:53.598042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:53.604317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:53.604809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:53.605566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:53.606007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:53.738413 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:53.745746 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c3e567b-4740-4c97-897b-cc37a7e4acc1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1508 microversion: 2.1 time: 0.152296 Apr 02 21:41:53.746322 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3243/6788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:53 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:53.762035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:53.762659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:53.769346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:53.769807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:53.770586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:53.771034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:53.903489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:53.912272 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f585d2d1-e594-4f0b-aa5f-568c5f227484 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1508 microversion: 2.1 time: 0.154081 Apr 02 21:41:53.912898 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3546/6789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:53 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:53.931270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:41:53.933176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:53.939540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:53.940005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:53.940819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:53.941268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:53.972551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:53.978319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Old instance type m1.heat2, new instance type m1.heat {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:41:53.985243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:41:53.985677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:41:53.986214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:41:53.986583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:41:53.987008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:41:54.050917 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-39d2fa49-c164-43af-8b44-17940fad9107 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "POST /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf/action" status: 202 len: 0 microversion: 2.1 time: 0.125957 Apr 02 21:41:54.051545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3244/6790] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:41:53 2022] POST /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:41:54.059721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:54.060358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:54.066586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:54.067061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:54.067865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:54.068326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:54.214097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:54.222359 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b4b2cde-28de-401d-9613-f66507a01ef1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1515 microversion: 2.1 time: 0.166565 Apr 02 21:41:54.222947 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3547/6791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:54 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:55.240422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:55.241214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:55.247123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:55.247577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:55.249014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:55.249460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:55.477968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:55.486111 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-706495c5-4cc8-4398-9ee8-8a7986fd2f83 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1515 microversion: 2.1 time: 0.250422 Apr 02 21:41:55.486702 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3245/6792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:55 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1515 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:56.503870 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:56.504540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:56.511676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:56.512150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:56.512964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:56.513551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:56.646063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:56.653484 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd4bf57e-15e2-4421-83b7-09b071ab59e1 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.153503 Apr 02 21:41:56.654071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3548/6793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:56 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:57.670914 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:57.671543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:57.678405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:57.678871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:57.679655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:57.680107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:57.811488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:57.818997 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b012fb23-c2bb-44e2-8ac0-1d31baa1c54b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.152933 Apr 02 21:41:57.819577 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3246/6794] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:57 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:41:58.836108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:41:58.836698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:41:58.843577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:58.844052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:58.844883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:41:58.845339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:41:58.981891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:41:58.990399 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8dc60ccb-7e05-4601-83b5-51c60c71a5c3 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.157947 Apr 02 21:41:58.991424 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3549/6795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:41:58 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:00.008320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:00.009103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:00.016860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:00.017318 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:00.018094 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:00.018565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:00.154068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:00.161436 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4e574c8-d08c-4bea-8004-83f8dea00460 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.157056 Apr 02 21:42:00.162014 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3247/6796] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:00 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:01.179316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:01.179945 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:01.186940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:01.187439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:01.188240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:01.188724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:01.319794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:01.327854 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c946ecb-29c4-4bac-8cb5-cba9ec73ee65 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.152499 Apr 02 21:42:01.328433 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3550/6797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:01 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:02.345330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:02.345953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:02.352771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:02.353233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:02.354009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:02.354454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:02.490868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:02.498427 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ed38c333-9bf9-45fd-86ba-865dd687c1e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.157561 Apr 02 21:42:02.499007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3248/6798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:02 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:03.515758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:03.516389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:03.523383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:03.523843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:03.524655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:03.525106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:03.660968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:03.668328 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2bff75c1-40e5-4cf5-9d14-a607d69822e8 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.157092 Apr 02 21:42:03.669203 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3551/6799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:03 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:04.685898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:04.686519 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:04.693346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:04.693807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:04.694581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:04.695032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:04.836736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:04.844284 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ac43a60e-d21c-4ab3-990b-4dfddfbc80b4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.163012 Apr 02 21:42:04.844896 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3249/6800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:04 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:05.861829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:05.862542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:05.869558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:05.870022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:05.870799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:05.871250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:06.003909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:06.011255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00e1ff04-867c-40bc-8ff7-244e8f03ad9d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.154028 Apr 02 21:42:06.011829 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3552/6801] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:05 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:07.027643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:07.028313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:07.035864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:07.036322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:07.037127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:07.037607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:07.166709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:07.174377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84bc6fec-217d-435e-bf94-07fdc58d793e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.150738 Apr 02 21:42:07.174949 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3250/6802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:07 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:08.191712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:08.192344 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:08.199310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:08.199782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:08.201185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:08.201650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:08.334860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:08.342767 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-29030364-8221-4a4b-8626-6d79fc50611c tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.154969 Apr 02 21:42:08.343372 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3553/6803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:08 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:09.360257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:09.360895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:09.367720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:09.368185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:09.368990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:09.369440 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:09.500923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:09.508343 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0caab55-887c-40e0-be93-a3650642996a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.152556 Apr 02 21:42:09.508945 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3251/6804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:09 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:10.525592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:10.526298 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:10.533149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:10.533624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:10.534812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:10.535270 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:10.683452 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:10.691458 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9f9e78f7-5804-4d1f-a65f-173439653dcc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.169810 Apr 02 21:42:10.692024 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3554/6805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:10 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:11.707685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:11.708301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:11.715482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:11.715939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:11.717347 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:11.717792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:11.933459 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:11.941654 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e151bce-1b41-49e9-bfd5-df8171de168e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.237890 Apr 02 21:42:11.942239 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3252/6806] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:11 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:12.959496 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:12.960118 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:12.966143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:12.966605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:12.967378 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:12.967828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:13.098249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:13.105766 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18cda95d-4462-4d77-ae04-82a63642cf4a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.150432 Apr 02 21:42:13.106345 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3555/6807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:12 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:14.123798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:14.124422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:14.131290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:14.131754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:14.132560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:14.133014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:14.266493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:14.273856 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-771a40d9-f429-4cd3-a922-fe5f42d4454e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.154565 Apr 02 21:42:14.274431 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3253/6808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:14 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:15.291411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:15.292040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:15.299153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:15.299620 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:15.300407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:15.300887 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:15.441463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:15.448958 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8fa927d1-00e2-4166-ad5f-897bc8d42adf tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.161558 Apr 02 21:42:15.453953 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3556/6809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:15 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:16.466599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:16.467223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:16.474173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:16.474630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:16.475412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:16.475867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:16.607590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:16.615021 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bf675174-cd2d-45c5-aac1-c550ada53af5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.152369 Apr 02 21:42:16.615598 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3254/6810] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:16 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:17.632471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:17.633110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:17.639901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:17.640376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:17.641193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:17.641651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:17.774111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:17.782388 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28186887-22ed-4d16-bc49-8da4716bb12a tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.153807 Apr 02 21:42:17.782972 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3557/6811] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:17 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:18.799450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:18.800071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:18.806952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:18.807414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:18.808187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:18.808665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:18.948733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:18.956517 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9f9c51ca-5b35-4319-9c90-14107dd5b911 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.160938 Apr 02 21:42:18.957121 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3255/6812] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:18 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:19.974368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:19.975000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:19.981892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:19.982357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:19.983143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:19.983585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:20.115706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:20.123602 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1f084697-8e4c-42ea-939f-52f8d447da89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.153994 Apr 02 21:42:20.124175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3558/6813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:19 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:21.140239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:21.140869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:21.147605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:21.148229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:21.149035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:21.149482 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:21.285641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:21.293211 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47274ecf-25d7-4c4e-adf8-104c6fa217c5 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.157488 Apr 02 21:42:21.294539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3256/6814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:21 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:22.311691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:22.312318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:22.319078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:22.319550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:22.320365 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:22.320851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:22.458311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:22.465766 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a75ef856-20e5-4d2b-844a-5cc5b4485541 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1520 microversion: 2.1 time: 0.158532 Apr 02 21:42:22.466344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3559/6815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:22 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:23.483652 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:23.484376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:23.490604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:23.491062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:23.491834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:23.492275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:23.761405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:23.769695 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-38ab1c95-7c4e-4577-849e-434cd530a7cc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1519 microversion: 2.1 time: 0.290850 Apr 02 21:42:23.770282 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3257/6816] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:23 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1519 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:24.787330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:24.787896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:24.795627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:24.796101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:24.796947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:24.797409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:24.930956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:24.938453 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fdec3196-b629-4a8d-b919-89c4213cb278 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1517 microversion: 2.1 time: 0.155066 Apr 02 21:42:24.939036 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3560/6817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:24 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:25.955842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:25.956578 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:25.963359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:25.963816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:25.964617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:25.965060 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:26.102336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:26.109888 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-93ffeb8a-008d-4737-83d4-e5f53515a6e9 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1514 microversion: 2.1 time: 0.158025 Apr 02 21:42:26.110470 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3258/6818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:25 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:26.126601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:26.127152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:26.133906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:26.134375 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:26.135185 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:26.135644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:26.192442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e9436d91-cc95-41e1-a350-cf8aff531852 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "POST /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf/action" status: 204 len: 0 microversion: 2.1 time: 0.070206 Apr 02 21:42:26.193318 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3561/6819] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:42:26 2022] POST /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:42:26.202132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:26.203000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:26.209455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:26.209918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:26.210839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:26.211333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:26.384763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:26.392765 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ba84b625-ec3d-44b5-bdef-8c3ad2cf886e tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1514 microversion: 2.1 time: 0.195339 Apr 02 21:42:26.393359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3259/6820] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:26 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:27.413307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:27.414107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:27.428415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.428927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.429839 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.430802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.562693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b149407c-0aa1-4a5f-b787-ddec9956fbec req-50f4f2d2-9e7e-4aa8-9f64-ae296519e667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f72cd45-eb1d-406f-a20d-1c58872161bf", "name": "network-vif-unplugged", "status": "completed", "tag": "6da77808-57aa-44b7-9b4f-3d9a27329f71"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:27.572619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b149407c-0aa1-4a5f-b787-ddec9956fbec req-50f4f2d2-9e7e-4aa8-9f64-ae296519e667 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.573151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b149407c-0aa1-4a5f-b787-ddec9956fbec req-50f4f2d2-9e7e-4aa8-9f64-ae296519e667 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.576731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:27.585104 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-560cf2fc-3c85-4522-9f4e-6b9490207b10 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1506 microversion: 2.1 time: 0.176955 Apr 02 21:42:27.585946 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3562/6821] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:27 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:27.586541 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b149407c-0aa1-4a5f-b787-ddec9956fbec req-50f4f2d2-9e7e-4aa8-9f64-ae296519e667 service nova] Creating event network-vif-unplugged:6da77808-57aa-44b7-9b4f-3d9a27329f71 for instance 8f72cd45-eb1d-406f-a20d-1c58872161bf on nch2-master-1 Apr 02 21:42:27.592316 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b149407c-0aa1-4a5f-b787-ddec9956fbec req-50f4f2d2-9e7e-4aa8-9f64-ae296519e667 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033937 Apr 02 21:42:27.593140 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3260/6822] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:42:27.601772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:27.602410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:27.609009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.609484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.610273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.610729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.746047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:27.754253 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df7a9fb7-f8e3-464f-b8f9-4b417355dadc tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1506 microversion: 2.1 time: 0.156208 Apr 02 21:42:27.754927 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3563/6823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:27 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:27.771587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:27.772299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:27.778635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.779099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.779874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.780322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.917479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:27.925816 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7b08fec-7da0-4765-b7af-318a12fcdc96 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1506 microversion: 2.1 time: 0.158737 Apr 02 21:42:27.926397 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3261/6824] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:27 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:27.942177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:27.942698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:27.948543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.949017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.949803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:27.950363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:27.974750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:42:28.053608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4788b1f9-84a8-462d-8b92-cae4ff1021f4 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 204 len: 0 microversion: 2.1 time: 0.114773 Apr 02 21:42:28.054533 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3564/6825] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:42:27 2022] DELETE /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:42:28.069407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:28.070173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:28.077067 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:28.077601 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:28.078453 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:28.078902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:28.103319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:42:28.145542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.compute.api [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Instance is already in deleting state, ignoring this request Apr 02 21:42:28.146363 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ecc6d1c-fcb3-4b83-b1d5-24347eac7a89 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 204 len: 0 microversion: 2.1 time: 0.081616 Apr 02 21:42:28.146949 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3262/6826] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:42:28 2022] DELETE /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:42:28.156471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:28.157250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:28.163504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:28.163979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:28.164820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:28.165279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:28.300182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:28.308084 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72ffd0b5-d8db-4ab5-9d3f-883bf0d1a428 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1512 microversion: 2.1 time: 0.156543 Apr 02 21:42:28.308630 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3565/6827] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:28 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:29.325817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:29.326528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:29.334222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:29.334677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:29.335457 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:29.335898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:29.483860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036baf67847140d8842f877f1e42ea32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec749d6a2ca48f7b17c3d2aaa3f5c67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:29.492409 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-307077a2-c914-4243-9c00-65277b12c875 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 200 len: 1512 microversion: 2.1 time: 0.170545 Apr 02 21:42:29.493151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3263/6828] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:29 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:29.617128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b37a8bcf-14a3-4f2a-a8a4-678c9bbe49ee req-b4f3b3ec-6346-4856-a0f3-d829dce40581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f72cd45-eb1d-406f-a20d-1c58872161bf", "name": "network-vif-plugged", "status": "completed", "tag": "6da77808-57aa-44b7-9b4f-3d9a27329f71"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:29.626729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b37a8bcf-14a3-4f2a-a8a4-678c9bbe49ee req-b4f3b3ec-6346-4856-a0f3-d829dce40581 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:29.627191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b37a8bcf-14a3-4f2a-a8a4-678c9bbe49ee req-b4f3b3ec-6346-4856-a0f3-d829dce40581 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:29.640806 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b37a8bcf-14a3-4f2a-a8a4-678c9bbe49ee req-b4f3b3ec-6346-4856-a0f3-d829dce40581 service nova] Creating event network-vif-plugged:6da77808-57aa-44b7-9b4f-3d9a27329f71 for instance 8f72cd45-eb1d-406f-a20d-1c58872161bf on nch2-master-1 Apr 02 21:42:29.645696 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b37a8bcf-14a3-4f2a-a8a4-678c9bbe49ee req-b4f3b3ec-6346-4856-a0f3-d829dce40581 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Apr 02 21:42:29.646486 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3566/6829] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:42:30.000782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-98ec1f63-3251-4fc4-96da-55f32f8fc7be req-5decd603-6ccc-450f-97b1-dfddcc8c721d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f72cd45-eb1d-406f-a20d-1c58872161bf", "name": "network-vif-deleted", "tag": "6da77808-57aa-44b7-9b4f-3d9a27329f71"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:30.010576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-98ec1f63-3251-4fc4-96da-55f32f8fc7be req-5decd603-6ccc-450f-97b1-dfddcc8c721d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.010961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-98ec1f63-3251-4fc4-96da-55f32f8fc7be req-5decd603-6ccc-450f-97b1-dfddcc8c721d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.023973 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-98ec1f63-3251-4fc4-96da-55f32f8fc7be req-5decd603-6ccc-450f-97b1-dfddcc8c721d service nova] Creating event network-vif-deleted:6da77808-57aa-44b7-9b4f-3d9a27329f71 for instance 8f72cd45-eb1d-406f-a20d-1c58872161bf on nch2-master-1 Apr 02 21:42:30.029950 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-98ec1f63-3251-4fc4-96da-55f32f8fc7be req-5decd603-6ccc-450f-97b1-dfddcc8c721d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033269 Apr 02 21:42:30.030887 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3264/6830] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:42:30.511324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:30.512152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 8f72cd45-eb1d-406f-a20d-1c58872161bf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:30.518804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.519329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.520312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.520838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.536045 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] HTTP exception thrown: Instance 8f72cd45-eb1d-406f-a20d-1c58872161bf could not be found. Apr 02 21:42:30.536688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Returning 404 to user: Instance 8f72cd45-eb1d-406f-a20d-1c58872161bf could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:42:30.537543 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b6ddd19f-6163-4314-b5b3-70e5f1b0459d tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf" status: 404 len: 111 microversion: 2.1 time: 0.031155 Apr 02 21:42:30.538103 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3567/6831] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:30 2022] GET /compute/v2.1/servers/8f72cd45-eb1d-406f-a20d-1c58872161bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:42:30.548839 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:30.549726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:30.557157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.557906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.558761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.559277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.572686 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] HTTP exception thrown: Instance 4155331c-9baa-411d-a91f-659675bb47da could not be found. Apr 02 21:42:30.573290 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Returning 404 to user: Instance 4155331c-9baa-411d-a91f-659675bb47da could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:42:30.574314 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5042f3bb-1be0-441f-b228-4ae48ff5f15b tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 404 len: 111 microversion: 2.1 time: 0.031711 Apr 02 21:42:30.574867 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3265/6832] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:42:30 2022] DELETE /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:42:30.582869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:30.583490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] [instance: 4155331c-9baa-411d-a91f-659675bb47da] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:30.589491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.589955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.591254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:30.591737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:30.604821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] HTTP exception thrown: Instance 4155331c-9baa-411d-a91f-659675bb47da could not be found. Apr 02 21:42:30.605406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] Returning 404 to user: Instance 4155331c-9baa-411d-a91f-659675bb47da could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:42:30.606227 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-395c675c-e803-452a-b437-fcbe2cc0cc20 tempest-ServerDiskConfigTestJSON-611276295 tempest-ServerDiskConfigTestJSON-611276295-project] 10.222.0.18 "GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da" status: 404 len: 111 microversion: 2.1 time: 0.027291 Apr 02 21:42:30.607360 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3568/6833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:30 2022] GET /compute/v2.1/servers/4155331c-9baa-411d-a91f-659675bb47da => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:42:36.175831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-aadc1642-8ab0-4c5a-91d4-d2298f085b59 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'create', calling method: .version_select at 0x7f54d4219c10>, body: {"keypair": {"name": "tempest-keypair-192104428"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:36.190154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-aadc1642-8ab0-4c5a-91d4-d2298f085b59 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:42:36.196554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-aadc1642-8ab0-4c5a-91d4-d2298f085b59 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:42:36.291048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-aadc1642-8ab0-4c5a-91d4-d2298f085b59 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:42:36.296937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-aadc1642-8ab0-4c5a-91d4-d2298f085b59 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:42:36.312623 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-aadc1642-8ab0-4c5a-91d4-d2298f085b59 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.256687 Apr 02 21:42:36.313241 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3266/6834] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:42:36 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:37.886687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1371940236", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5d1da61-b7b6-4e0c-9bae-dde4dea39176"}], "security_groups": [{"name": "tempest-securitygroup--1657421586"}], "key_name": "tempest-keypair-192104428", "user_data": "}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:38.020335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] validate_networks() for [('b5d1da61-b7b6-4e0c-9bae-dde4dea39176', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:42:38.409460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:42:38.409967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:42:38.410653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:42:38.411397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:42:38.411738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:42:38.423596 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:38.424205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:38.425211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:38.425825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:38.446308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:42:38.452930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:42:38.473906 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:42:38.475904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:42:38.524357 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33f3dfbd-282b-44d3-8293-3aaaaaf1ec2a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.642093 Apr 02 21:42:38.531117 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3569/6835] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:42:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:42:38.536616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-03decd95-a3c2-40b7-9964-0b7b53907dac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:38.537871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03decd95-a3c2-40b7-9964-0b7b53907dac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:38.594375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-03decd95-a3c2-40b7-9964-0b7b53907dac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:38.602348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-03decd95-a3c2-40b7-9964-0b7b53907dac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1238 microversion: 2.1 time: 0.070434 Apr 02 21:42:38.603717 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3267/6836] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:38 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:39.620319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:39.621229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:39.630096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:39.630567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:39.634688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:39.636398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:39.730690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:39.740271 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-03c9ac74-833a-4d47-8758-a52854053c20 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1298 microversion: 2.1 time: 0.124697 Apr 02 21:42:39.741513 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3570/6837] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:39 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:40.758702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:40.759320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:40.769936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:40.770617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:40.771604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:40.772049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:40.970408 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:40.977982 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-972db412-989e-4dc3-9b47-dee260f293ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.224063 Apr 02 21:42:40.978572 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3268/6838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:40 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:41.058339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-eab49147-0b5b-4f9b-809d-2cec145a0ff3 req-01b1dde9-f3ff-44cf-b4c1-30a576d6c173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0", "tag": "4d77bd18-7f11-44e2-a3eb-81d269e12b22"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:41.072766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-eab49147-0b5b-4f9b-809d-2cec145a0ff3 req-01b1dde9-f3ff-44cf-b4c1-30a576d6c173 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:41.073554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-eab49147-0b5b-4f9b-809d-2cec145a0ff3 req-01b1dde9-f3ff-44cf-b4c1-30a576d6c173 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:41.093576 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-eab49147-0b5b-4f9b-809d-2cec145a0ff3 req-01b1dde9-f3ff-44cf-b4c1-30a576d6c173 service nova] Creating event network-changed:4d77bd18-7f11-44e2-a3eb-81d269e12b22 for instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 on nch2-master-1 Apr 02 21:42:41.101260 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-eab49147-0b5b-4f9b-809d-2cec145a0ff3 req-01b1dde9-f3ff-44cf-b4c1-30a576d6c173 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047648 Apr 02 21:42:41.102154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3571/6839] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:42:41.995370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:41.995921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:42.002873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:42.003335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:42.004127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:42.004604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:42.144071 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:42.151440 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-82342b1c-1b61-4913-ab98-57a1a9ffd8a7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.160171 Apr 02 21:42:42.152018 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3269/6840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:41 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:43.170937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:43.171645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:43.178166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:43.178643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:43.179457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:43.179919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:43.311237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:43.318572 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23fdff3c-614d-4f74-9057-0b1569289fdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.153450 Apr 02 21:42:43.319153 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3572/6841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:43 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:44.335161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:44.335776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:44.343153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:44.343613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:44.344381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:44.344852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:44.486983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:44.494478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d1f6aa9d-a8f5-47b4-b29b-c168c9bb1821 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.163296 Apr 02 21:42:44.495059 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3270/6842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:44 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:45.511385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:45.512095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:45.519024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:45.519493 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:45.520295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:45.520801 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:45.651634 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:45.659105 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-365e0245-2735-4355-9bdd-20631e5aded4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.151791 Apr 02 21:42:45.659680 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3573/6843] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:45 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:46.675766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:46.676386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:46.683301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:46.683760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:46.685187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:46.685637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:46.825199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:46.832824 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d3a1a605-d762-49aa-95ae-a25057fc012b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.160980 Apr 02 21:42:46.833418 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3271/6844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:46 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:47.391161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-58a222c0-0045-4492-bd52-21426fb5e24d req-aa8134e4-7dc2-407b-af62-d5478317b73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0", "name": "network-vif-plugged", "status": "completed", "tag": "4d77bd18-7f11-44e2-a3eb-81d269e12b22"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:47.400796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-58a222c0-0045-4492-bd52-21426fb5e24d req-aa8134e4-7dc2-407b-af62-d5478317b73c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:47.401848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-58a222c0-0045-4492-bd52-21426fb5e24d req-aa8134e4-7dc2-407b-af62-d5478317b73c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:47.414596 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-58a222c0-0045-4492-bd52-21426fb5e24d req-aa8134e4-7dc2-407b-af62-d5478317b73c service nova] Creating event network-vif-plugged:4d77bd18-7f11-44e2-a3eb-81d269e12b22 for instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 on nch2-master-1 Apr 02 21:42:47.420303 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-58a222c0-0045-4492-bd52-21426fb5e24d req-aa8134e4-7dc2-407b-af62-d5478317b73c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Apr 02 21:42:47.421009 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3574/6845] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:42:47.848877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:47.849400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:47.856099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:47.856587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:47.857351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:47.857793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:47.989911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:47.998314 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f9473d5e-39cd-4d6f-b1d4-fc0d79a2368b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1364 microversion: 2.1 time: 0.153472 Apr 02 21:42:47.998896 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3272/6846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:47 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:49.016243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:49.017021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:49.023200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:49.023673 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:49.024472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:49.024972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:49.164098 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:49.172069 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06b126a4-e767-4bd1-bbeb-f70a9d79d237 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1549 microversion: 2.1 time: 0.161422 Apr 02 21:42:49.172772 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3575/6847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:49 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:49.188757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:49.189277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:49.196085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:49.196589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:49.197372 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:49.197824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:49.280981 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d64540b3-f3b5-4a86-a14d-02e21abad391 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096656 Apr 02 21:42:49.281765 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3273/6848] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:42:49 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:42:50.228961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:50.229964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:50.231272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-f92a996e-03f0-47c4-bb0a-144d19cee26c req-67c03c88-2133-4779-ae7b-45bb274e38b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0", "tag": "4d77bd18-7f11-44e2-a3eb-81d269e12b22"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:50.237019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:50.237554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:50.238587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:50.239112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:50.239243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f92a996e-03f0-47c4-bb0a-144d19cee26c req-67c03c88-2133-4779-ae7b-45bb274e38b7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:50.239642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-f92a996e-03f0-47c4-bb0a-144d19cee26c req-67c03c88-2133-4779-ae7b-45bb274e38b7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:50.252061 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-f92a996e-03f0-47c4-bb0a-144d19cee26c req-67c03c88-2133-4779-ae7b-45bb274e38b7 service nova] Creating event network-changed:4d77bd18-7f11-44e2-a3eb-81d269e12b22 for instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 on nch2-master-1 Apr 02 21:42:50.263016 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-f92a996e-03f0-47c4-bb0a-144d19cee26c req-67c03c88-2133-4779-ae7b-45bb274e38b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035673 Apr 02 21:42:50.264320 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3274/6849] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:42:50.397858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:50.406225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e5b16cd0-c029-4246-a2df-1bb50e3055dd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1549 microversion: 2.1 time: 0.181301 Apr 02 21:42:50.407027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3576/6850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:50 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:50.425187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:50.426243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:50.432849 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:50.433315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:50.434907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:50.435359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:50.677196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:50.685435 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0345a33e-b07f-43dd-8459-aea8520edc5c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1549 microversion: 2.1 time: 0.264750 Apr 02 21:42:50.686238 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3275/6851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:50 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:51.703159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:51.703790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:51.710762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:51.711228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:51.712012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:51.712485 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:51.847552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:51.855232 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a195a436-48da-4e39-86ec-835dd57bafde tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1668 microversion: 2.1 time: 0.156603 Apr 02 21:42:51.855811 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3577/6852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:51 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:51.871382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:51.872569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:51.879433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:51.879887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:51.880679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:51.881124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:52.010906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:52.018347 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4599cd7-3d4d-480d-a11a-e9e67a5cfc2f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1668 microversion: 2.1 time: 0.150835 Apr 02 21:42:52.018938 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3276/6853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:51 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:52.034187 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:42:52.035174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:52.041077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:52.041547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:52.042334 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:52.042791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:52.070020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:52.075590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Old instance type m1.heat2, new instance type m1.heat {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:42:52.081736 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:42:52.082171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:42:52.082658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:42:52.083081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:42:52.083520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:42:52.145127 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b8dfc095-7a21-4675-9979-55a9c22ea3fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0/action" status: 202 len: 0 microversion: 2.1 time: 0.114768 Apr 02 21:42:52.145916 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3578/6854] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:42:52 2022] POST /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:42:52.153878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:52.154502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:52.160493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:52.160979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:52.161760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:52.162209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:52.329947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:52.337454 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-562f7749-e2d4-4154-8bf7-73e06cfbbb83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1677 microversion: 2.1 time: 0.187490 Apr 02 21:42:52.338219 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3277/6855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:52 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:53.357427 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:53.358175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:53.365122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:53.365597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:53.366664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:53.367174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:53.508542 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:53.516212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18f11fe7-860b-4bd7-a395-c055cc8c92b0 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1677 microversion: 2.1 time: 0.164594 Apr 02 21:42:53.516827 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3579/6856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:53 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:54.533898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:54.534515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:54.541370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:54.541819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:54.542586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:54.543033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:54.674257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:54.681776 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84b5f334-8d90-4426-8c95-49b7046762c4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.152250 Apr 02 21:42:54.682350 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3278/6857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:54 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:55.724708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:55.725339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:55.732113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:55.732621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:55.733407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:55.733865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:55.870289 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:55.878177 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-622f7450-f25f-4ce2-bb46-28e6d0918030 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.157369 Apr 02 21:42:55.878755 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3580/6858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:55 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:56.895442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:56.896114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:56.903850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:56.904309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:56.905126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:56.905571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:57.056495 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:57.064257 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d3b352f-afd1-48b8-a27a-d89117258e92 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.172785 Apr 02 21:42:57.064883 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3279/6859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:56 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:58.081871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:58.082498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:58.089738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:58.090753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:58.091532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:58.091986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:58.487392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:58.494972 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b354f83e-d242-412c-9859-151928e6e222 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.416929 Apr 02 21:42:58.495548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3581/6860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:58 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:42:59.511162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:42:59.511773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:42:59.518538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:59.518992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:59.519760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:42:59.520205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:42:59.653746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:42:59.661136 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d3ff90cb-83d9-4efa-b232-ebf2c4038e40 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.153945 Apr 02 21:42:59.661743 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3280/6861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:42:59 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:00.678848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:00.679512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:00.686905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:00.687374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:00.688158 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:00.688648 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:00.822159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:00.829916 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a097ab1d-12ad-4c6c-b6ec-25ecbfa30074 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.154888 Apr 02 21:43:00.830612 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3582/6862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:00 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:01.847449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:01.847987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:01.854768 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:01.855221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:01.856661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:01.857108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:01.991200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:01.998545 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-670146f8-4e11-41db-b290-41f172b34532 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.155102 Apr 02 21:43:01.999122 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3281/6863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:01 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:03.017170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:03.017803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:03.024647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:03.025124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:03.025915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:03.026376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:03.160160 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:03.167589 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d8dde99-3b73-4728-87cb-0475f35b69e5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.154325 Apr 02 21:43:03.168924 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3583/6864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:03 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:04.186268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:04.186906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:04.193705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:04.194161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:04.194925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:04.195362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:04.332658 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:04.340553 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67f45fd3-23b9-47db-95eb-dd216c236f7c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.158198 Apr 02 21:43:04.341130 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3282/6865] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:04 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:05.356810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:05.357431 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:05.364153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:05.364656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:05.365428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:05.365876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:05.497886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:05.505339 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1c89c2df-4d0c-4e1c-a29d-3e7767701c54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.152608 Apr 02 21:43:05.505902 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3584/6866] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:05 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:06.522944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:06.523596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:06.530529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:06.530988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:06.531808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:06.532208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:06.666476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:06.674686 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-22ee9065-de24-402b-832d-5eb1f760618d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.155712 Apr 02 21:43:06.675271 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3283/6867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:06 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:07.692503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:07.693084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:07.700759 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:07.701228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:07.702012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:07.702463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:07.837750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:07.845799 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1971202f-1d8b-48db-a975-d73468861bb8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.157415 Apr 02 21:43:07.846364 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3585/6868] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:07 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:08.862866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:08.863490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:08.870322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:08.870782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:08.872107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:08.872582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:09.002103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:09.009562 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f3624590-3b13-4198-84e6-16fd2f94968f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.150730 Apr 02 21:43:09.010133 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3284/6869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:08 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:10.028494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:10.029132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:10.036070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:10.036740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:10.037610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:10.038228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:10.174508 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:10.182327 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aeef82a1-bfc8-4051-bcd8-e85a03e1978c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.159114 Apr 02 21:43:10.182900 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3586/6870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:10 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:11.199275 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:11.199894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:11.206775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:11.207237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:11.208008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:11.208479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:11.341368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:11.348801 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7485a809-0f66-45c5-9c00-3ed1a01da9b5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.153560 Apr 02 21:43:11.349380 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3285/6871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:11 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:12.366627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:12.367188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:12.373787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:12.374259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:12.375050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:12.375507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:12.508145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:12.516248 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c582e677-094f-4e3b-9a2b-97a77da8dcbd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.153811 Apr 02 21:43:12.516874 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3587/6872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:12 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:13.533915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:13.534534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:13.541409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:13.541866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:13.542634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:13.543069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:13.997701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:14.005249 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-705d13f4-50ef-43fb-8e86-e4ccd75d0687 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.475240 Apr 02 21:43:14.005818 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3286/6873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:13 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:15.022651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:15.023279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:15.030739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:15.031209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:15.031996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:15.032479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:15.166627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:15.174868 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eec5e04b-f0ee-4d1d-8b37-5b9c07a3cd2e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.156193 Apr 02 21:43:15.175451 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3588/6874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:15 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:16.192754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:16.193400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:16.200812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:16.201272 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:16.202039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:16.202510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:16.333427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:16.340897 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-794cb0ba-95da-444c-8cd7-7b11df8f8a56 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.152017 Apr 02 21:43:16.341474 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3287/6875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:16 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:17.359295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:17.365414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:17.368308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:17.368808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:17.369607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:17.370067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:17.502201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:17.509723 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ebdbd827-7c09-4496-958a-64a5da065da8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.155245 Apr 02 21:43:17.510321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3589/6876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:17 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:18.526974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:18.527507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:18.534423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:18.534878 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:18.535641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:18.536090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:18.669356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:18.676744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9a68b80-977a-4304-a2fe-e9e9f1d3f454 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.153753 Apr 02 21:43:18.677315 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3288/6877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:18 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:19.694551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:19.695092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:19.702359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:19.702827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:19.703607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:19.704061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:19.839051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:19.846465 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f2f37ee6-cc89-49be-b651-1d79444ff8bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.155986 Apr 02 21:43:19.847038 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3590/6878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:19 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:20.863712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:20.864346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:20.871713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:20.872212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:20.873035 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:20.874180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:21.016069 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:21.023600 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-028e04a2-7ec3-4c2d-a683-2bafcb98217f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1682 microversion: 2.1 time: 0.163831 Apr 02 21:43:21.024194 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3289/6879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:20 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:22.041371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:22.041919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:22.049461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:22.049930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:22.050709 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:22.051163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:22.181990 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:22.189846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b66590fb-8279-4beb-b850-74d3246bb5d6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1679 microversion: 2.1 time: 0.152575 Apr 02 21:43:22.190420 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3591/6880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:22 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:23.207195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:23.207818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:23.214174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:23.214632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:23.215403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:23.216426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:23.351473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:23.360554 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3e2020ba-f4ab-4770-b361-ff60a3f8e346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1679 microversion: 2.1 time: 0.157310 Apr 02 21:43:23.361154 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3290/6881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:23 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:23.527829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a930f854-9c0d-4074-83bf-47856d10402a req-284b78a5-bd90-4ef3-bbce-3e1b222dd6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0", "name": "network-vif-unplugged", "status": "completed", "tag": "4d77bd18-7f11-44e2-a3eb-81d269e12b22"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:23.538951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a930f854-9c0d-4074-83bf-47856d10402a req-284b78a5-bd90-4ef3-bbce-3e1b222dd6c9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:23.539420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a930f854-9c0d-4074-83bf-47856d10402a req-284b78a5-bd90-4ef3-bbce-3e1b222dd6c9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:23.551798 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a930f854-9c0d-4074-83bf-47856d10402a req-284b78a5-bd90-4ef3-bbce-3e1b222dd6c9 service nova] Creating event network-vif-unplugged:4d77bd18-7f11-44e2-a3eb-81d269e12b22 for instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 on nch2-master-1 Apr 02 21:43:23.557257 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-a930f854-9c0d-4074-83bf-47856d10402a req-284b78a5-bd90-4ef3-bbce-3e1b222dd6c9 service nova] Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:43:23.564194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a930f854-9c0d-4074-83bf-47856d10402a req-284b78a5-bd90-4ef3-bbce-3e1b222dd6c9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040194 Apr 02 21:43:23.565066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3592/6882] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:43:24.378143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:24.378757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:24.385583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:24.386037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:24.386809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:24.387253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:24.522183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:24.530491 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2df7734b-c684-4aa3-901f-3369d19715ce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1676 microversion: 2.1 time: 0.156560 Apr 02 21:43:24.531052 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3291/6883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:24 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:24.549415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:24.550053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:24.556094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:24.556595 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:24.557374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:24.557826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:24.612553 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e394a46-22b0-4a90-afb1-49710448577e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0/action" status: 204 len: 0 microversion: 2.1 time: 0.068989 Apr 02 21:43:24.613203 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3593/6884] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:43:24 2022] POST /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:43:24.622376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:24.623000 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:24.629056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:24.629467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:24.630227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:24.630674 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:24.823102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:24.831080 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32c1199e-95c0-4e67-aabc-f6592bccd9ab tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1676 microversion: 2.1 time: 0.213670 Apr 02 21:43:24.831659 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3292/6885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:24 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:25.850861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:25.851732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:25.858699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:25.859174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:25.859976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:25.860432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.001072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:26.008876 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e6b01ae8-dfe7-40f8-b554-b8418f0d5a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1668 microversion: 2.1 time: 0.163521 Apr 02 21:43:26.009481 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3594/6886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:25 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:26.025138 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:26.025762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:26.033095 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.033558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.034341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.034799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.166303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:26.173962 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-37e33af5-1a60-42ad-8c0c-4b444575603d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1668 microversion: 2.1 time: 0.152674 Apr 02 21:43:26.174540 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3293/6887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:26 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:26.189910 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:26.190551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:26.196422 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.196929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.197723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.198183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.327775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:26.335266 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a82aa2b9-53ae-4341-94bb-a1839aff9093 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1668 microversion: 2.1 time: 0.149249 Apr 02 21:43:26.335837 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3595/6888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:26 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:26.351780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:26.352286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:26.358232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.358690 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.359448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.359890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.383062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:43:26.458162 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f7d0334-5192-494b-a34a-1927a524dddf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 204 len: 0 microversion: 2.1 time: 0.109853 Apr 02 21:43:26.459407 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3294/6889] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:43:26 2022] DELETE /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:43:26.469175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:26.469893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:26.476088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.476602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.477425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:26.477889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:26.608354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:26.615737 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-efb07c73-ece3-4c9f-9a0e-63e5023ab91d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1674 microversion: 2.1 time: 0.151644 Apr 02 21:43:26.616311 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3596/6890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:26 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:27.592284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-9065efbb-1d77-41a4-9325-197ce2d19ab5 req-876bf0b5-4ad9-4cda-a1db-e8f7e9c8cc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0", "name": "network-vif-plugged", "status": "completed", "tag": "4d77bd18-7f11-44e2-a3eb-81d269e12b22"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:27.601045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9065efbb-1d77-41a4-9325-197ce2d19ab5 req-876bf0b5-4ad9-4cda-a1db-e8f7e9c8cc6b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:27.601493 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9065efbb-1d77-41a4-9325-197ce2d19ab5 req-876bf0b5-4ad9-4cda-a1db-e8f7e9c8cc6b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:27.613446 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-9065efbb-1d77-41a4-9325-197ce2d19ab5 req-876bf0b5-4ad9-4cda-a1db-e8f7e9c8cc6b service nova] Creating event network-vif-plugged:4d77bd18-7f11-44e2-a3eb-81d269e12b22 for instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 on nch2-master-1 Apr 02 21:43:27.618223 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-9065efbb-1d77-41a4-9325-197ce2d19ab5 req-876bf0b5-4ad9-4cda-a1db-e8f7e9c8cc6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030232 Apr 02 21:43:27.618823 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3295/6891] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:43:27.633482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:27.634108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:27.641382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:27.641848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:27.642637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:27.643092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:27.780924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:27.788441 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f1f6cb98-c0be-4b50-a628-3bf0b4a0c12f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1674 microversion: 2.1 time: 0.158836 Apr 02 21:43:27.789272 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3597/6892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:27 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:43:28.738244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-8b338138-be03-4be4-8186-36e9e6cfd982 req-0e51b393-f62e-4f65-9c83-f61944ff1522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0", "name": "network-vif-deleted", "tag": "4d77bd18-7f11-44e2-a3eb-81d269e12b22"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:28.749974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8b338138-be03-4be4-8186-36e9e6cfd982 req-0e51b393-f62e-4f65-9c83-f61944ff1522 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:28.749974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-8b338138-be03-4be4-8186-36e9e6cfd982 req-0e51b393-f62e-4f65-9c83-f61944ff1522 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:28.760339 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-8b338138-be03-4be4-8186-36e9e6cfd982 req-0e51b393-f62e-4f65-9c83-f61944ff1522 service nova] Creating event network-vif-deleted:4d77bd18-7f11-44e2-a3eb-81d269e12b22 for instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 on nch2-master-1 Apr 02 21:43:28.765584 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-8b338138-be03-4be4-8186-36e9e6cfd982 req-0e51b393-f62e-4f65-9c83-f61944ff1522 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Apr 02 21:43:28.766449 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3296/6893] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:43:28.806150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:28.806794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:28.814354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:28.814907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:28.815748 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:28.816216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:28.848688 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:28.849171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:28.849655 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lazy-loading 'fault' on Instance uuid 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:43:28.898322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:28.907735 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4ebf84f-8d7e-48f4-a4ec-1a1ac9baccce tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 200 len: 1328 microversion: 2.1 time: 0.105443 Apr 02 21:43:28.908725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3598/6894] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:28 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:29.927089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:29.927724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:29.934237 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:29.934694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:29.935505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:29.935974 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:29.949023 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. Apr 02 21:43:29.949616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:43:29.950991 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb13cc91-7c51-42fb-ba53-9a58228e6639 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 404 len: 111 microversion: 2.1 time: 0.028639 Apr 02 21:43:29.951765 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3297/6895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:29 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:43:29.966797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:29.967438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:29.974354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:29.974830 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:29.975619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:29.976079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:29.989041 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. Apr 02 21:43:29.989645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:43:29.990514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a495b39d-90cf-4909-8888-9038e01c9320 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 404 len: 111 microversion: 2.1 time: 0.028272 Apr 02 21:43:29.991042 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3599/6896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:29 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:43:30.037646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-869806884", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "b5d1da61-b7b6-4e0c-9bae-dde4dea39176"}], "security_groups": [{"name": "tempest-securitygroup--1657421586"}], "key_name": "tempest-keypair-192104428", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:30.139319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] validate_networks() for [('b5d1da61-b7b6-4e0c-9bae-dde4dea39176', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:43:30.496400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:43:30.496851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:43:30.497907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:43:30.498326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:43:30.498742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:43:30.507501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:30.507949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:30.508786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:30.509227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:30.526212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:43:30.531395 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:43:30.543850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:43:30.546175 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:43:30.591449 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-20cd915a-59dd-46c5-bd59-24754ea87cf8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.557887 Apr 02 21:43:30.592103 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3298/6897] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:43:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:43:30.602231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e312c2d-5cf9-4be9-a229-84764ffa25f8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:30.602899 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e312c2d-5cf9-4be9-a229-84764ffa25f8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:30.655788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e312c2d-5cf9-4be9-a229-84764ffa25f8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:30.662531 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e312c2d-5cf9-4be9-a229-84764ffa25f8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1237 microversion: 2.1 time: 0.064363 Apr 02 21:43:30.663293 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3600/6898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:30 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:31.681618 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:31.682379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:31.689082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:31.689540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:31.690315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:31.690756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:31.766133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:31.773453 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6500251a-de92-481d-83ae-9de6ec2bfd03 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1295 microversion: 2.1 time: 0.096648 Apr 02 21:43:31.774031 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3299/6899] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:31 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:32.791468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:32.792109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:32.801627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:32.802484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:32.803567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:32.804274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:32.942319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3425533c-d7a0-43d7-9f5a-0349cb2afb97 req-2686a4ca-14b9-42c7-8d3b-71181dc83592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70e74fe-4037-410d-8d97-264436409ef3", "tag": "2c097458-dd72-4e53-a467-3edecfd591d2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:32.967364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3425533c-d7a0-43d7-9f5a-0349cb2afb97 req-2686a4ca-14b9-42c7-8d3b-71181dc83592 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:32.967815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3425533c-d7a0-43d7-9f5a-0349cb2afb97 req-2686a4ca-14b9-42c7-8d3b-71181dc83592 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:33.001220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:33.009222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b578d93c-f3fc-49bf-82a1-fe661d78a6b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.221814 Apr 02 21:43:33.013461 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3425533c-d7a0-43d7-9f5a-0349cb2afb97 req-2686a4ca-14b9-42c7-8d3b-71181dc83592 service nova] Creating event network-changed:2c097458-dd72-4e53-a467-3edecfd591d2 for instance f70e74fe-4037-410d-8d97-264436409ef3 on nch2-master-1 Apr 02 21:43:33.014138 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3601/6900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:32 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:33.020688 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3425533c-d7a0-43d7-9f5a-0349cb2afb97 req-2686a4ca-14b9-42c7-8d3b-71181dc83592 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081975 Apr 02 21:43:33.020688 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3300/6901] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:43:34.031119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:34.031863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:34.038825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:34.039295 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:34.040078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:34.040570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:34.172533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:34.179855 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fda11714-ed88-435d-a90b-d9f5a8af2f85 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.152633 Apr 02 21:43:34.180429 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3602/6902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:34 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:35.198808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:35.199533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:35.206343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:35.206802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:35.207573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:35.208018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:35.353193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:35.360655 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f01952d0-9fd5-42b6-955d-cf70cd4e0be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.167019 Apr 02 21:43:35.361232 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3301/6903] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:35 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:36.378310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:36.378937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:36.385761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:36.386230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:36.387021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:36.387481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:36.523111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:36.531166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21a96b86-e125-402a-81be-350c4da64f83 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.156752 Apr 02 21:43:36.531748 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3603/6904] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:36 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:37.549321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:37.549934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:37.557057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:37.557524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:37.558307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:37.558826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:37.690240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:37.697701 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-420f513f-abfb-4df7-abad-e4e9c77dde23 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.152299 Apr 02 21:43:37.698287 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3302/6905] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:37 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:38.715376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:38.716512 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:38.723256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:38.723768 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:38.724549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:38.725014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:39.224763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:39.232171 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-259a39a4-71fe-4406-b212-2e6b5a16ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.520911 Apr 02 21:43:39.232779 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3604/6906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:38 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:39.843084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-564dac80-3f81-4203-8933-204d76486cd4 req-4313cb39-50f6-4c5c-a5f6-54b4e515c5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e74fe-4037-410d-8d97-264436409ef3", "name": "network-vif-plugged", "status": "completed", "tag": "2c097458-dd72-4e53-a467-3edecfd591d2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:39.852004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-564dac80-3f81-4203-8933-204d76486cd4 req-4313cb39-50f6-4c5c-a5f6-54b4e515c5a8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:39.852481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-564dac80-3f81-4203-8933-204d76486cd4 req-4313cb39-50f6-4c5c-a5f6-54b4e515c5a8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:39.864658 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-564dac80-3f81-4203-8933-204d76486cd4 req-4313cb39-50f6-4c5c-a5f6-54b4e515c5a8 service nova] Creating event network-vif-plugged:2c097458-dd72-4e53-a467-3edecfd591d2 for instance f70e74fe-4037-410d-8d97-264436409ef3 on nch2-master-1 Apr 02 21:43:39.869678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-564dac80-3f81-4203-8933-204d76486cd4 req-4313cb39-50f6-4c5c-a5f6-54b4e515c5a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030652 Apr 02 21:43:39.870345 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3303/6907] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:43:40.249599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:40.250310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:40.258099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:40.258582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:40.259421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:40.260035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:40.390846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:40.398330 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ba8bb7a6-0e64-4fb4-a9be-9ff180774029 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1363 microversion: 2.1 time: 0.152733 Apr 02 21:43:40.398908 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3605/6908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:40 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:41.417728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:41.418694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:41.425705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:41.426165 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:41.426951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:41.427393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:41.613824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:41.621375 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ea5273b0-557e-4888-9271-753dc47871c2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1548 microversion: 2.1 time: 0.208815 Apr 02 21:43:41.622733 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3304/6909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:41 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1548 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:41.639533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:41.640033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:41.646156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:41.646637 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:41.647433 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:41.647897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:41.730875 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2cf074f9-eb4d-40bd-95e6-70c8287ec27e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096110 Apr 02 21:43:41.731515 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3606/6910] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:43:41 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:43:42.679725 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-26837254-5be6-40d6-9fbf-c7df485f91d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:42.688150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26837254-5be6-40d6-9fbf-c7df485f91d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:42.688648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26837254-5be6-40d6-9fbf-c7df485f91d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:42.712419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-26837254-5be6-40d6-9fbf-c7df485f91d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Going to try to stop instance {{(pid=136517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:43:42.749503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a65ef1e4-a254-4d56-a0a0-66b08b0bf80d req-b3b55ea4-a5c1-4def-b481-4a9f288ad1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f70e74fe-4037-410d-8d97-264436409ef3", "tag": "2c097458-dd72-4e53-a467-3edecfd591d2"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:43:42.756391 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-26837254-5be6-40d6-9fbf-c7df485f91d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action" status: 202 len: 0 microversion: 2.1 time: 0.080759 Apr 02 21:43:42.757712 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3305/6911] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:43:42 2022] POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:43:42.758114 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a65ef1e4-a254-4d56-a0a0-66b08b0bf80d req-b3b55ea4-a5c1-4def-b481-4a9f288ad1ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:42.758784 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a65ef1e4-a254-4d56-a0a0-66b08b0bf80d req-b3b55ea4-a5c1-4def-b481-4a9f288ad1ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:42.767434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:42.768152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:42.772308 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a65ef1e4-a254-4d56-a0a0-66b08b0bf80d req-b3b55ea4-a5c1-4def-b481-4a9f288ad1ca service nova] Creating event network-changed:2c097458-dd72-4e53-a467-3edecfd591d2 for instance f70e74fe-4037-410d-8d97-264436409ef3 on nch2-master-1 Apr 02 21:43:42.775120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:42.775518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:42.776394 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:42.776907 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:42.779287 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a65ef1e4-a254-4d56-a0a0-66b08b0bf80d req-b3b55ea4-a5c1-4def-b481-4a9f288ad1ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100979 Apr 02 21:43:42.780152 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3607/6912] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:43:43.008028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:43.016920 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4ed0ae02-2711-45a3-9b83-58d0f4b40381 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1558 microversion: 2.1 time: 0.254753 Apr 02 21:43:43.017846 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3306/6913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:42 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:44.036022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:44.036776 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:44.043032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:44.043715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:44.044536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:44.045002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:44.177478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:44.185551 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07b52e3d-87ad-4cce-97cb-b6b9355e83d1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.154755 Apr 02 21:43:44.186120 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3608/6914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:44 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:45.202483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:45.203100 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:45.210068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:45.210530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:45.211335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:45.211784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:45.348213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:45.355643 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-464dbf7a-a2e5-485c-b63b-75e75ecc586a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.157092 Apr 02 21:43:45.356893 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3307/6915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:45 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:46.374077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:46.374711 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:46.381616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:46.382092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:46.382880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:46.383447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:46.521845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:46.531080 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7f592fcc-be40-4415-b2fd-4e16b3379ed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.160905 Apr 02 21:43:46.531725 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3609/6916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:46 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:47.549326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:47.549977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:47.556795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:47.557248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:47.558009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:47.558450 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:47.687025 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:47.694744 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ffc398b1-1810-4cc4-8881-9f2b787c3686 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.149219 Apr 02 21:43:47.695327 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3308/6917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:47 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:48.711174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:48.711835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:48.719320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:48.719791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:48.720660 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:48.721105 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:48.853527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:48.860927 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43abb2c0-3355-4009-a694-fd189e550309 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.153655 Apr 02 21:43:48.861498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3610/6918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:48 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:49.878733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:49.879357 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:49.886171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:49.886626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:49.887977 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:49.888438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:50.023319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:50.030773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4fb24546-96a4-4386-b7ce-3808bd20139b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.156215 Apr 02 21:43:50.031347 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3309/6919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:49 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:51.047548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:51.048106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:51.054922 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:51.055395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:51.056176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:51.056674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:51.190489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:51.197863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d7c8c491-a18a-49fa-9b78-3253ae179da7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.154652 Apr 02 21:43:51.198469 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3611/6920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:51 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:52.216336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:52.216978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:52.223385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:52.223844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:52.224634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:52.225075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:52.353989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:52.361956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4253e6fe-f160-4445-899a-eeb9b003cb58 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.150221 Apr 02 21:43:52.362536 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3310/6921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:52 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:53.379064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:53.379690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:53.386659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:53.387125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:53.388399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:53.388878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:53.521729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:53.529154 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-203c7e48-7686-4e17-9d77-af032168b94f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.153992 Apr 02 21:43:53.529727 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3612/6922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:53 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:54.546858 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:54.547477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:54.555227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:54.555689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:54.556484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:54.556928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:54.688341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:54.695812 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-234175fe-9a5a-4278-926a-350215683a49 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.153183 Apr 02 21:43:54.696385 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3311/6923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:54 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:55.712925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:55.713553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:55.720920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:55.721388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:55.722165 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:55.722614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:55.852909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:55.860233 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07440e8b-0a45-4b13-a223-993c1eab66e7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.151291 Apr 02 21:43:55.860833 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3613/6924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:55 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:56.876881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:56.877498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:56.891973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:56.892429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:56.893218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:56.893659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:57.038223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:57.046116 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db1d37d0-22ff-4741-9707-afa78c9b5be7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.173176 Apr 02 21:43:57.046697 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3312/6925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:56 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:58.063671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:58.064307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:58.071131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:58.071598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:58.072377 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:58.072864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:58.216819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:58.224156 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7fd30e2a-c56c-4a37-ac63-7ed7107353bf tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.164974 Apr 02 21:43:58.224753 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3614/6926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:58 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:43:59.241027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:43:59.241647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:43:59.248467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:59.248931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:59.249701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:43:59.250143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:43:59.381368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:43:59.389312 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-05ad1ad5-1b97-4ca4-8835-e9d82a3e25e8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.152234 Apr 02 21:43:59.389881 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3313/6927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:43:59 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:00.406767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:00.407434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:00.414278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:00.414752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:00.415540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:00.415998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:00.550385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:00.557939 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fca2b589-5ccb-44b9-b4f5-f7cfc23de0b6 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.155628 Apr 02 21:44:00.558539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3615/6928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:00 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:01.575938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:01.576577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:01.583678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:01.584125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:01.584930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:01.585370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:02.036444 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:02.044187 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-33642fda-775a-421a-b0e5-f9dc5aae8431 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.472773 Apr 02 21:44:02.044812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3314/6929] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:01 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:03.062077 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:03.062704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:03.069459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:03.069928 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:03.070706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:03.071163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:03.205553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:03.213161 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30e97b13-e9b1-4223-8df8-6ebb215136f3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.155704 Apr 02 21:44:03.213738 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3616/6930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:03 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:04.231085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:04.231711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:04.239130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:04.239591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:04.240373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:04.240850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:04.372435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:04.379926 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eb2a80e0-5a8b-4209-ac50-66daa99a1b95 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.152834 Apr 02 21:44:04.380526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3315/6931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:04 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:05.397069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:05.397723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:05.404537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:05.405013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:05.405805 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:05.406264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:05.551882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:05.559411 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ebb75df-adc4-413b-b387-71c05395548d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.166286 Apr 02 21:44:05.559983 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3617/6932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:05 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:06.577530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:06.578155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:06.585093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:06.585557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:06.586333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:06.586781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:06.718736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:06.726198 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c07f9319-c538-488b-9ced-1fbe168b2b12 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.153263 Apr 02 21:44:06.726777 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3316/6933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:06 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:07.742953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:07.743490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:07.750965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:07.751442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:07.752235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:07.752729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:07.883490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:07.891629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-018713d1-52a1-42cd-9c09-5a48307d491b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.152719 Apr 02 21:44:07.892213 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3618/6934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:07 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:08.908709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:08.909331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:08.916151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:08.916669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:08.917438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:08.917883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:09.048716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:09.056158 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e031eacf-aa19-491c-b84b-50b1c7636754 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1654 microversion: 2.1 time: 0.151405 Apr 02 21:44:09.056773 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3317/6935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:08 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1654 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:09.075258 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:09.076253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:09.083053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:09.083523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:09.084352 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:09.084851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:09.111671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:09.117326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Old instance type m1.heat2, new instance type m1.heat {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:44:09.124085 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:44:09.124552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:44:09.125049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:44:09.125481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:44:09.125912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:44:09.186636 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7ddbe128-b576-4d8a-be5c-d142396f5fac tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action" status: 202 len: 0 microversion: 2.1 time: 0.115333 Apr 02 21:44:09.187469 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3619/6936] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:44:09 2022] POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:44:09.195483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:09.196106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:09.202266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:09.202729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:09.203508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:09.203956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:09.366091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:09.374077 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4e5ce5d-60a9-4e27-b7a6-65407277a022 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.182472 Apr 02 21:44:09.374755 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3318/6937] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:09 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:10.392369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:10.393036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:10.399082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:10.399587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:10.400373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:10.400854 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:10.548754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:10.556351 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6018de48-7189-4ae4-b6dd-e1189711c602 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1677 microversion: 2.1 time: 0.168813 Apr 02 21:44:10.556968 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3620/6938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:10 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:11.574490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:11.575115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:11.582557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:11.583018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:11.583791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:11.584238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:11.716164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:11.723586 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09b47280-bb89-463f-9cfb-5d894f460abe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1682 microversion: 2.1 time: 0.153070 Apr 02 21:44:11.724159 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3319/6939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:11 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:12.741078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:12.741612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:12.748473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:12.748948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:12.749722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:12.750171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:12.887096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:12.895124 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-78dc1282-96c0-4241-8fc1-3c595e76c690 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1682 microversion: 2.1 time: 0.158145 Apr 02 21:44:12.895713 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3621/6940] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:12 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:13.912745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:13.913370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:13.920499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:13.921218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:13.921739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:13.922215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:14.127733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:14.135188 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8d2590d2-500f-4183-bfd6-58fca4680382 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1679 microversion: 2.1 time: 0.226539 Apr 02 21:44:14.135782 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3320/6941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:13 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:15.153242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:15.153878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:15.160858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.161332 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.162123 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.162579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.301606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:15.309159 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8d950a19-06cb-4ca6-bf80-70d474c4c089 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1675 microversion: 2.1 time: 0.159853 Apr 02 21:44:15.309738 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3622/6942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:15 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:15.325399 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:15.325940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:15.332607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.333063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.333830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.334270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.389734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d0727e1f-6e65-448e-ac3c-b0a9ded1eed2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action" status: 204 len: 0 microversion: 2.1 time: 0.068030 Apr 02 21:44:15.390391 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3321/6943] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:44:15 2022] POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:44:15.399658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:15.400299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:15.407247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.407652 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.408440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.409032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.548504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:15.556965 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0847b31c-5a25-4fb8-a7ba-d3e7f6935ec3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1675 microversion: 2.1 time: 0.162224 Apr 02 21:44:15.557628 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3623/6944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:15 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:15.964008 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5953ec20-3981-4016-a212-5469af8af492 req-7dda099f-4e91-44f4-914d-bf43f5717d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e74fe-4037-410d-8d97-264436409ef3", "name": "network-vif-unplugged", "status": "completed", "tag": "2c097458-dd72-4e53-a467-3edecfd591d2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:15.974953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5953ec20-3981-4016-a212-5469af8af492 req-7dda099f-4e91-44f4-914d-bf43f5717d61 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:15.975470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5953ec20-3981-4016-a212-5469af8af492 req-7dda099f-4e91-44f4-914d-bf43f5717d61 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:15.990173 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5953ec20-3981-4016-a212-5469af8af492 req-7dda099f-4e91-44f4-914d-bf43f5717d61 service nova] Creating event network-vif-unplugged:2c097458-dd72-4e53-a467-3edecfd591d2 for instance f70e74fe-4037-410d-8d97-264436409ef3 on nch2-master-1 Apr 02 21:44:15.996872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-5953ec20-3981-4016-a212-5469af8af492 req-7dda099f-4e91-44f4-914d-bf43f5717d61 service nova] Instance f70e74fe-4037-410d-8d97-264436409ef3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:44:16.004679 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5953ec20-3981-4016-a212-5469af8af492 req-7dda099f-4e91-44f4-914d-bf43f5717d61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045127 Apr 02 21:44:16.005933 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3322/6945] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:44:16.574604 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:16.575261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:16.582892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:16.583371 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:16.584173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:16.584667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:16.729803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:16.737859 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4583a5d3-53cd-44ab-9696-be04e76f41fe tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1654 microversion: 2.1 time: 0.167596 Apr 02 21:44:16.738432 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3624/6946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:16 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1654 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:16.755657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:16.756662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:16.763132 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:16.763815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:16.764713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:16.765161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:16.900731 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:16.908752 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-03da26da-ad53-41d2-aba0-d0b475770f29 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1654 microversion: 2.1 time: 0.158156 Apr 02 21:44:16.909338 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3323/6947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:16 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:16.925667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6bf099f3-1f4a-4294-9259-0bb7fa442423 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:16.931653 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bf099f3-1f4a-4294-9259-0bb7fa442423 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:16.932127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bf099f3-1f4a-4294-9259-0bb7fa442423 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:16.953269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6bf099f3-1f4a-4294-9259-0bb7fa442423 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Going to try to start instance {{(pid=136518) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:44:16.993893 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6bf099f3-1f4a-4294-9259-0bb7fa442423 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action" status: 202 len: 0 microversion: 2.1 time: 0.072515 Apr 02 21:44:16.994449 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3625/6948] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:44:16 2022] POST /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:44:17.003913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:17.004555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:17.010649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:17.011195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:17.012171 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:17.012733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:17.214218 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:17.222454 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0e451786-369c-400f-b483-014ba764fbdd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1663 microversion: 2.1 time: 0.223139 Apr 02 21:44:17.223037 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3324/6949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:16 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1663 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:18.242459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:18.243597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:18.250325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:18.250790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:18.251579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:18.252032 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:18.386316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:18.393797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-65de6227-ac09-49ad-9085-5f21b85e6661 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1667 microversion: 2.1 time: 0.156616 Apr 02 21:44:18.394380 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3626/6950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:18 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:18.410586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:18.411173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:18.419234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:18.419939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:18.420846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:18.421267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:18.447286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:44:18.520526 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0a922fd0-b919-42ff-8bec-e37c207ee08b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 204 len: 0 microversion: 2.1 time: 0.113376 Apr 02 21:44:18.521208 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3325/6951] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:44:18 2022] DELETE /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:44:18.529935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:18.530568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:18.537346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:18.537819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:18.538642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:18.539104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:18.669894 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:18.677378 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b40cd5c6-9ef1-4655-acf8-42a087528af2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1673 microversion: 2.1 time: 0.151916 Apr 02 21:44:18.677956 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3627/6952] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:18 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:44:19.695137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:19.695836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:19.703243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:19.703697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:19.704483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:19.704933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:19.846954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:19.854456 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2016bfb7-19fe-4305-90e1-0ec919363d89 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1673 microversion: 2.1 time: 0.163575 Apr 02 21:44:19.855036 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3326/6953] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:19 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:20.024423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f865c4d9-fae3-4186-ab7b-80527f67df53 req-ebff87d5-a1ad-4f0e-ba4e-98573789f34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e74fe-4037-410d-8d97-264436409ef3", "name": "network-vif-plugged", "status": "completed", "tag": "2c097458-dd72-4e53-a467-3edecfd591d2"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:20.033563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f865c4d9-fae3-4186-ab7b-80527f67df53 req-ebff87d5-a1ad-4f0e-ba4e-98573789f34b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:20.034070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f865c4d9-fae3-4186-ab7b-80527f67df53 req-ebff87d5-a1ad-4f0e-ba4e-98573789f34b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:20.053203 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f865c4d9-fae3-4186-ab7b-80527f67df53 req-ebff87d5-a1ad-4f0e-ba4e-98573789f34b service nova] Creating event network-vif-plugged:2c097458-dd72-4e53-a467-3edecfd591d2 for instance f70e74fe-4037-410d-8d97-264436409ef3 on nch2-master-1 Apr 02 21:44:20.060559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f865c4d9-fae3-4186-ab7b-80527f67df53 req-ebff87d5-a1ad-4f0e-ba4e-98573789f34b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040363 Apr 02 21:44:20.061422 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3628/6954] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:44:20.839214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-770a78b8-a4a0-4eb0-8974-82e5654abc35 req-330d6715-9d5c-4b19-a340-30ae571fc5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f70e74fe-4037-410d-8d97-264436409ef3", "name": "network-vif-deleted", "tag": "2c097458-dd72-4e53-a467-3edecfd591d2"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:20.848922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-770a78b8-a4a0-4eb0-8974-82e5654abc35 req-330d6715-9d5c-4b19-a340-30ae571fc5da service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:20.849616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-770a78b8-a4a0-4eb0-8974-82e5654abc35 req-330d6715-9d5c-4b19-a340-30ae571fc5da service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:20.864292 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-770a78b8-a4a0-4eb0-8974-82e5654abc35 req-330d6715-9d5c-4b19-a340-30ae571fc5da service nova] Creating event network-vif-deleted:2c097458-dd72-4e53-a467-3edecfd591d2 for instance f70e74fe-4037-410d-8d97-264436409ef3 on nch2-master-1 Apr 02 21:44:20.869971 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-770a78b8-a4a0-4eb0-8974-82e5654abc35 req-330d6715-9d5c-4b19-a340-30ae571fc5da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035452 Apr 02 21:44:20.870591 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3327/6955] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:44:20.874021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:20.875786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:20.885421 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:20.885917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:20.890359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:20.890879 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:20.969486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:20.978152 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-58a35345-e3c4-42dd-a161-4b4586dc419a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 200 len: 1322 microversion: 2.1 time: 0.110524 Apr 02 21:44:20.980970 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3629/6956] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:20 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:21.996084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:21.996815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:22.003906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:22.004260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:22.005068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:22.005506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:22.019356 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. Apr 02 21:44:22.019948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:44:22.020809 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf22ed8e-eee5-4bdf-b639-f494ecf7a65b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 404 len: 111 microversion: 2.1 time: 0.029352 Apr 02 21:44:22.021336 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3328/6957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:21 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:44:22.039311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:22.039978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:22.047196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:22.047675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:22.048495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:22.048964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:22.062956 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. Apr 02 21:44:22.063767 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:44:22.065149 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-74c54e61-2794-4e6e-adc6-5baef087ec77 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 404 len: 111 microversion: 2.1 time: 0.029640 Apr 02 21:44:22.065967 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3630/6958] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:22 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:44:22.113877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-81465702", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "b5d1da61-b7b6-4e0c-9bae-dde4dea39176"}], "security_groups": [{"name": "tempest-securitygroup--1657421586"}], "key_name": "tempest-keypair-192104428", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:22.216949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] validate_networks() for [('b5d1da61-b7b6-4e0c-9bae-dde4dea39176', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:44:22.587085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:44:22.587514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:44:22.587997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:44:22.588436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:44:22.588880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:44:22.598217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:22.598671 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:22.599476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:22.599921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:22.616346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:44:22.621769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:44:22.634040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:44:22.636344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:44:22.682754 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-851c8538-a48d-4a8d-a1d1-7bd04a39abef tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.572713 Apr 02 21:44:22.683479 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3329/6959] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:44:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:44:22.694104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c03ba788-493b-496a-8cae-a126e1681256 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:22.694764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c03ba788-493b-496a-8cae-a126e1681256 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:22.749262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c03ba788-493b-496a-8cae-a126e1681256 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:22.756540 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c03ba788-493b-496a-8cae-a126e1681256 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1236 microversion: 2.1 time: 0.066308 Apr 02 21:44:22.757126 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3631/6960] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:22 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:23.775371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:23.775989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:23.784956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:23.785554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:23.786416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:23.786893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:23.868968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:23.876513 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8620ab2d-e89d-4a7c-bbcc-3652a653428c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1294 microversion: 2.1 time: 0.105114 Apr 02 21:44:23.877106 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3330/6961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:23 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:24.894755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:24.895479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:24.903975 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:24.904639 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:24.906195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:24.906886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:24.999135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-d47c4177-33cf-4e96-a904-2ebace42a545 req-f4030eda-2e63-4f8f-acc2-c712ba9380fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:25.012336 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d47c4177-33cf-4e96-a904-2ebace42a545 req-f4030eda-2e63-4f8f-acc2-c712ba9380fe service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:25.023603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-d47c4177-33cf-4e96-a904-2ebace42a545 req-f4030eda-2e63-4f8f-acc2-c712ba9380fe service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:25.040786 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-d47c4177-33cf-4e96-a904-2ebace42a545 req-f4030eda-2e63-4f8f-acc2-c712ba9380fe service nova] Creating event network-changed:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:44:25.049710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-d47c4177-33cf-4e96-a904-2ebace42a545 req-f4030eda-2e63-4f8f-acc2-c712ba9380fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056517 Apr 02 21:44:25.051594 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3331/6962] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:44:25.084096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:25.099306 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac123872-c154-4f62-a178-e0510b9cd393 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.208663 Apr 02 21:44:25.100559 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3632/6963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:24 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:26.119046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:26.119763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:26.126521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:26.126980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:26.127751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:26.128195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:26.352346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:26.359912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9942b13-f37a-42e8-82f0-e066ee943920 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.246142 Apr 02 21:44:26.360510 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3332/6964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:26 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:27.376832 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:27.377471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:27.384320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:27.384827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:27.385624 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:27.386091 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:27.521859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:27.529500 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-283be6d0-1175-452c-81ac-85ee8d997f50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.156693 Apr 02 21:44:27.530079 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3633/6965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:27 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:28.547476 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:28.548397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:28.555184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:28.555640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:28.556404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:28.556873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:28.688084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:28.695453 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-63809283-cc84-4bf9-9c9d-05ef2754fbb1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.151938 Apr 02 21:44:28.696033 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3333/6966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:28 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:29.713400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:29.714035 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:29.721482 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:29.721957 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:29.722741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:29.723202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:29.857063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:29.864719 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-94e942af-1d60-4a18-95b5-f1b9d862fd11 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.155198 Apr 02 21:44:29.865335 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3634/6967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:29 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:30.881299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:30.881910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:30.888706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:30.889167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:30.889927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:30.890375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:31.028426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:31.035761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4000b2a-49fe-4988-a96b-8c8b3e6a89ee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.158397 Apr 02 21:44:31.036364 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3334/6968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:30 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:32.054200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:32.054849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:32.061678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:32.062155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:32.063680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:32.064139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:32.077709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3402a6b6-1fd1-4e0d-adf0-75e2a73ec4de req-c8a0bd57-b3b5-4b3f-97c4-66cd86aa2845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "name": "network-vif-plugged", "status": "completed", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:32.087050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3402a6b6-1fd1-4e0d-adf0-75e2a73ec4de req-c8a0bd57-b3b5-4b3f-97c4-66cd86aa2845 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:32.087499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3402a6b6-1fd1-4e0d-adf0-75e2a73ec4de req-c8a0bd57-b3b5-4b3f-97c4-66cd86aa2845 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:32.099630 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3402a6b6-1fd1-4e0d-adf0-75e2a73ec4de req-c8a0bd57-b3b5-4b3f-97c4-66cd86aa2845 service nova] Creating event network-vif-plugged:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:44:32.104746 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3402a6b6-1fd1-4e0d-adf0-75e2a73ec4de req-c8a0bd57-b3b5-4b3f-97c4-66cd86aa2845 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030773 Apr 02 21:44:32.105352 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3335/6969] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:44:32.208675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:32.216041 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3755ee1f-678d-4803-9650-131e2a3c2f24 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.165904 Apr 02 21:44:32.216644 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3635/6970] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:32 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:33.235197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:33.235889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:33.242061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:33.242512 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:33.243271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:33.243709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:33.382477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:33.389994 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8118f5b5-b233-4f2f-b7c7-aed34524e302 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1362 microversion: 2.1 time: 0.159771 Apr 02 21:44:33.391857 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3336/6971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:33 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:34.409524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:34.410155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:34.417057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:34.417527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:34.418568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:34.419023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:34.555692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:34.563102 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-019b61b6-d397-455a-9f31-090e16d2fd67 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1547 microversion: 2.1 time: 0.158264 Apr 02 21:44:34.563680 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3636/6972] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:34 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:34.580059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:34.580612 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:34.587332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:34.587793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:34.588588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:34.589037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:34.670484 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6887dcd1-7a65-407a-ab37-bc6ae962cf81 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094831 Apr 02 21:44:34.671104 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3337/6973] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:44:34 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:44:35.667113 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:35.668566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:35.669782 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-dcf1fdc7-3201-4fbc-8451-e530fb5c76e5 req-fe716f43-766e-4e23-9d7f-cef9eb97b39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:44:35.676080 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:35.676635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:35.677727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:35.678182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:35.678371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dcf1fdc7-3201-4fbc-8451-e530fb5c76e5 req-fe716f43-766e-4e23-9d7f-cef9eb97b39d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:35.679020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dcf1fdc7-3201-4fbc-8451-e530fb5c76e5 req-fe716f43-766e-4e23-9d7f-cef9eb97b39d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:35.690581 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-dcf1fdc7-3201-4fbc-8451-e530fb5c76e5 req-fe716f43-766e-4e23-9d7f-cef9eb97b39d service nova] Creating event network-changed:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:44:35.695773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-dcf1fdc7-3201-4fbc-8451-e530fb5c76e5 req-fe716f43-766e-4e23-9d7f-cef9eb97b39d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030741 Apr 02 21:44:35.697027 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3338/6974] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:44:35.709078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:35.715243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Old instance type m1.heat2, new instance type m1.heat {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:44:35.722320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:44:35.722766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:44:35.723264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:44:35.723692 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:44:35.724122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:44:35.794514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-52067142-53ee-4a16-b542-d8018eb3399d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.131494 Apr 02 21:44:35.798699 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3637/6975] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:44:35 2022] POST /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:44:35.809822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:35.811166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:35.818463 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:35.819326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:35.820429 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:35.822521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:36.111027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:36.121760 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d5576ed-0290-46fa-8126-4b1f7419b751 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1556 microversion: 2.1 time: 0.321012 Apr 02 21:44:36.133987 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3339/6976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:35 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1556 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:44:37.140753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:37.141953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:37.152252 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:37.152753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:37.153641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:37.154110 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:37.297232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:37.305320 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df75cd3d-585e-42d4-b633-4595c20a51d4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1675 microversion: 2.1 time: 0.169567 Apr 02 21:44:37.305907 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3638/6977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:37 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:38.323772 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:38.324398 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:38.331351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:38.331811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:38.332649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:38.333101 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:38.468739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:38.476788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cbf418a8-b1ad-486e-b504-19274824d22b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.156976 Apr 02 21:44:38.477361 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3340/6978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:38 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:39.494917 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:39.495584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:39.502413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:39.502886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:39.504235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:39.504971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:39.647069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:39.654673 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16d8bd0f-452d-4371-b8e1-3cdfce1f6046 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.163805 Apr 02 21:44:39.655253 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3639/6979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:39 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:40.672358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:40.673003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:40.679818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:40.680282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:40.681099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:40.681547 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:40.816287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:40.823914 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f70637be-0668-426c-a33d-5d6bd1bde4d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.155478 Apr 02 21:44:40.824514 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3341/6980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:40 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:41.841986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:41.842618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:41.849217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:41.849689 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:41.850471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:41.850924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:41.980557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:41.987925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d19ea1a-da52-471e-b16e-9204cd90675c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.150311 Apr 02 21:44:41.988523 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3640/6981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:41 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:43.004703 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:43.005324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:43.012211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:43.012700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:43.013477 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:43.013922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:43.146602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:43.154009 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1f104454-b7c9-4f8b-928c-946af0916e50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.153265 Apr 02 21:44:43.154600 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3342/6982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:42 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:44.172014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:44.173178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:44.180195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:44.180698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:44.181480 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:44.181935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:44.313627 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:44.321103 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0062e393-67e8-4679-afec-500c0963a14a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.153280 Apr 02 21:44:44.321691 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3641/6983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:44 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:45.338130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:45.338743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:45.346118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:45.346571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:45.347333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:45.347774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:45.481125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:45.489337 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74ca535d-ac17-4782-83c1-e2c027ffbfbc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.155202 Apr 02 21:44:45.489913 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3343/6984] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:45 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:46.506176 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:46.506808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:46.513707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:46.514177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:46.514985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:46.515442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:46.961911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:46.969944 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d9c4537-7b7a-46c1-b4fa-3d1fdc68ed10 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.467697 Apr 02 21:44:46.970523 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3642/6985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:46 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:47.986994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:47.987625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:47.994469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:47.994933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:47.995714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:47.996193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:48.130097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:48.137413 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2a80858a-4c74-4679-ab49-a9c6a217a84b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.154387 Apr 02 21:44:48.137987 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3344/6986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:47 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:49.155172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:49.155800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:49.163109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:49.163565 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:49.164343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:49.164826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:49.300287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:49.307708 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b6f9cc00-f88c-43ac-865b-fd8c274e7649 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.156525 Apr 02 21:44:49.308277 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3643/6987] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:49 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:50.324746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:50.325363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:50.332883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:50.333340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:50.334102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:50.334541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:50.466995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:50.474370 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35cfbdb8-ed06-416f-a582-14d1037d935d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.153618 Apr 02 21:44:50.474951 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3345/6988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:50 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:51.491287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:51.491931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:51.498869 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:51.499340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:51.500130 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:51.500619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:51.640156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:51.648167 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7199a13e-2298-46b8-83a0-7df014b9758b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.160875 Apr 02 21:44:51.648773 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3644/6989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:51 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:52.666161 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:52.666773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:52.673751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:52.674209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:52.674985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:52.675425 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:52.816141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:52.823867 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47eae1ce-5500-4272-a9c4-fb73a036dd30 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.161922 Apr 02 21:44:52.824464 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3346/6990] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:52 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:53.570426 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:44:53.570918 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:44:53.842408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:53.842968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:53.849848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:53.850320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:53.851141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:53.851599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:53.981033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:53.989076 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c334d0de-e09c-4c95-a174-52aa60593314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.151517 Apr 02 21:44:53.989648 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3645/6991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:53 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:55.006851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:55.007472 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:55.014326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:55.014785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:55.015555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:55.016586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:55.147362 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:55.154735 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-28def274-3fe4-4aea-bdeb-1733e72beec9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.151834 Apr 02 21:44:55.155306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3347/6992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:55 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:56.173319 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:56.173955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:56.181566 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:56.182051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:56.182824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:56.183279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:56.317329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:56.324797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1ed481ee-6dc0-49bf-a70c-63ec00b46fda tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.155593 Apr 02 21:44:56.325378 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3646/6993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:56 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:57.342521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:57.343147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:57.350190 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:57.350655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:57.351436 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:57.351888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:57.487154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:57.494728 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a284a9e4-0115-48e4-8b0d-8535f0c11170 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.156135 Apr 02 21:44:57.495305 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3348/6994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:57 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:58.512372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:58.513038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:58.519924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:58.520396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:58.521211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:58.521671 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:58.650916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:58.658843 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d9fe0278-068b-49b9-a827-10e32e054dee tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.150536 Apr 02 21:44:58.659417 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3647/6995] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:58 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:44:59.675651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:44:59.676212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:44:59.683083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:59.683544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:59.684320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:44:59.684799 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:44:59.820054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:44:59.827616 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-508cf5b6-75e7-4994-a717-47483ec53088 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.156021 Apr 02 21:44:59.828204 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3349/6996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:44:59 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:00.845068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:00.845631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:00.853453 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:00.853925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:00.854756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:00.855248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:00.991126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:00.998492 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a613f92-8690-4eb3-8a09-d91966eef188 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.157617 Apr 02 21:45:00.999062 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3648/6997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:00 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:02.015157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:02.015781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:02.022670 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:02.023128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:02.023925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:02.024366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:02.154123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:02.162110 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d7b0bdcd-072c-4f30-99dd-aa583f3a7c45 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.150899 Apr 02 21:45:02.162692 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3350/6998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:02 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:03.179195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:03.179826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:03.186680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:03.187155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:03.187938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:03.188396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:03.324500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:03.331827 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-54bbcfac-aa93-48c8-a611-fbbc56f452e4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.156601 Apr 02 21:45:03.332401 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3649/6999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:03 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:04.348927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:04.349542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:04.356469 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:04.356999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:04.357792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:04.358234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:04.494046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:04.503678 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0c9d2111-1b0b-4fe3-a780-2c46b118f33c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1680 microversion: 2.1 time: 0.159250 Apr 02 21:45:04.504261 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3351/7000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:04 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:05.520881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:05.521564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:05.528885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:05.529498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:05.530417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:05.530860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:05.668752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:05.676354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee82a5a9-fb9f-4654-8fd5-17ecf18fd61d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1677 microversion: 2.1 time: 0.160099 Apr 02 21:45:05.676963 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3650/7001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:05 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:06.693886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:06.694528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:06.701404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:06.701873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:06.702683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:06.703137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:06.846379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:06.853913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee3d7b11-31b0-4706-8ed4-c830f2b696d9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1677 microversion: 2.1 time: 0.164002 Apr 02 21:45:06.854640 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3352/7002] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:06 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:07.871557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:07.872106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:07.879162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:07.879616 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:07.880410 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:07.880895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.018458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:08.025988 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-980ac36a-a5e3-4db2-b0f8-56d27e6df00d tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1674 microversion: 2.1 time: 0.158563 Apr 02 21:45:08.026564 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3651/7003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:07 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:08.043387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:08.043935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:08.051022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.051489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.052271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.052765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.095131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.095976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.097219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.097677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.125242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:45:08.130509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:45:08.237247 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-283d2279-e967-4c86-b549-90e9ce592d96 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.197944 Apr 02 21:45:08.238311 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3353/7004] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:45:08 2022] POST /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:45:08.254464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:08.255535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:08.262309 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.262787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.263591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.264051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.298877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0e9983c9-afd4-4907-b740-bd20f32dd193 req-e07a1cbf-e28b-46bb-893a-3e0ca5d381b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "name": "network-vif-unplugged", "status": "completed", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:08.310057 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0e9983c9-afd4-4907-b740-bd20f32dd193 req-e07a1cbf-e28b-46bb-893a-3e0ca5d381b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:08.310883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0e9983c9-afd4-4907-b740-bd20f32dd193 req-e07a1cbf-e28b-46bb-893a-3e0ca5d381b2 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:08.325723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0e9983c9-afd4-4907-b740-bd20f32dd193 req-e07a1cbf-e28b-46bb-893a-3e0ca5d381b2 service nova] Creating event network-vif-unplugged:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:45:08.334126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [req-0e9983c9-afd4-4907-b740-bd20f32dd193 req-e07a1cbf-e28b-46bb-893a-3e0ca5d381b2 service nova] Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136517) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:45:08.342426 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0e9983c9-afd4-4907-b740-bd20f32dd193 req-e07a1cbf-e28b-46bb-893a-3e0ca5d381b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050771 Apr 02 21:45:08.343452 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3354/7005] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:45:08.416290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:08.425394 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-18dedc2d-5769-4347-a5ac-b396635c6f3c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1673 microversion: 2.1 time: 0.183010 Apr 02 21:45:08.428958 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3652/7006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:08 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:09.444923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:09.445636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:09.451918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:09.452376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:09.453184 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:09.454258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:09.589908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:09.597340 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6418ef89-2a49-4a50-9b47-8ee2a9c5182c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1673 microversion: 2.1 time: 0.157686 Apr 02 21:45:09.597919 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3355/7007] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:09 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:10.379351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c1ec680b-9a78-4cd5-9a9c-0c1f228d0b0f req-34a6cfa2-2bd0-4618-90f9-220f85e908a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "name": "network-vif-plugged", "status": "completed", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:10.388248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c1ec680b-9a78-4cd5-9a9c-0c1f228d0b0f req-34a6cfa2-2bd0-4618-90f9-220f85e908a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:10.388741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c1ec680b-9a78-4cd5-9a9c-0c1f228d0b0f req-34a6cfa2-2bd0-4618-90f9-220f85e908a7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:10.401354 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c1ec680b-9a78-4cd5-9a9c-0c1f228d0b0f req-34a6cfa2-2bd0-4618-90f9-220f85e908a7 service nova] Creating event network-vif-plugged:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:45:10.407355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-c1ec680b-9a78-4cd5-9a9c-0c1f228d0b0f req-34a6cfa2-2bd0-4618-90f9-220f85e908a7 service nova] Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:45:10.414513 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c1ec680b-9a78-4cd5-9a9c-0c1f228d0b0f req-34a6cfa2-2bd0-4618-90f9-220f85e908a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038971 Apr 02 21:45:10.415351 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3653/7008] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:45:10.614665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:10.615294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:10.622243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:10.622642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:10.623415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:10.623861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:10.765816 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:10.777146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cec34749-521a-44a4-8a67-cdc561542240 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1673 microversion: 2.1 time: 0.166315 Apr 02 21:45:10.778167 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3356/7009] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:10 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:11.796006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:11.796674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:11.803726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:11.804198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:11.805014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:11.805498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:11.950977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:11.958889 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf2d8540-da9e-4dcf-9a69-c1081237c204 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1673 microversion: 2.1 time: 0.168439 Apr 02 21:45:11.959486 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3654/7010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:11 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:12.975758 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:12.976370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:12.983167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:12.983619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:12.984383 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:12.985507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:13.115586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:13.122913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8d047e4d-6df4-4474-a730-0fb2fb777b50 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1673 microversion: 2.1 time: 0.150997 Apr 02 21:45:13.123487 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3357/7011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:12 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:14.139864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:14.140522 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:14.147233 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.147727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.148681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.149134 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.281039 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:14.288625 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61c53783-f9cc-401c-add6-602d35c2ee9a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1666 microversion: 2.1 time: 0.152718 Apr 02 21:45:14.289408 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3655/7012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:14 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:14.305573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:14.306205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:14.313865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.314328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.315118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.315571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.329012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e9559d45-79f4-432c-a9c7-0713811a5f4d req-9d56c8a2-0761-43de-b13e-158e33230a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "name": "network-vif-unplugged", "status": "completed", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:14.338884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e9559d45-79f4-432c-a9c7-0713811a5f4d req-9d56c8a2-0761-43de-b13e-158e33230a37 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.338884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e9559d45-79f4-432c-a9c7-0713811a5f4d req-9d56c8a2-0761-43de-b13e-158e33230a37 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.365582 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e9559d45-79f4-432c-a9c7-0713811a5f4d req-9d56c8a2-0761-43de-b13e-158e33230a37 service nova] Creating event network-vif-unplugged:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:45:14.370968 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e9559d45-79f4-432c-a9c7-0713811a5f4d req-9d56c8a2-0761-43de-b13e-158e33230a37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045533 Apr 02 21:45:14.371998 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3656/7013] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:45:14.475448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:14.483831 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8caafa59-fbcc-4f7d-94eb-11b300cdcde7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1666 microversion: 2.1 time: 0.182243 Apr 02 21:45:14.485194 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3358/7014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:14 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:14.501075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:14.501897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:14.508150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.508668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.509461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.509921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.648412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:14.656062 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-aeceedf2-4387-4108-8d29-7e74273492d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1666 microversion: 2.1 time: 0.159362 Apr 02 21:45:14.657398 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3657/7015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:14 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:14.674106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:14.674666 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:14.680634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.681088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.681861 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.682300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.706514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:45:14.785078 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f270c130-bd5e-4f34-bcd1-999cf722c0ba tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 204 len: 0 microversion: 2.1 time: 0.115067 Apr 02 21:45:14.785708 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3359/7016] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:45:14 2022] DELETE /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:45:14.797001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:14.797845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:14.807429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.807896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.808721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:14.809178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:14.948434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:14.956642 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-56437fba-cb78-4355-802f-8c4593ad7844 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1672 microversion: 2.1 time: 0.166159 Apr 02 21:45:14.957227 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3658/7017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:14 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:15.974528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:15.975238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:15.982125 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:15.982589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:15.983373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:15.983819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:16.118693 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:16.126699 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf45e22c-e1cf-4b9a-9335-b1acc2cdcdcc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1672 microversion: 2.1 time: 0.156502 Apr 02 21:45:16.127271 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3360/7018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:15 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:16.399602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d9e4f59b-573f-4ca6-8761-8136304faf04 req-d2019d30-dec5-4904-a7cd-3d815732f5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "name": "network-vif-plugged", "status": "completed", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:16.408481 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d9e4f59b-573f-4ca6-8761-8136304faf04 req-d2019d30-dec5-4904-a7cd-3d815732f5db service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:16.408976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d9e4f59b-573f-4ca6-8761-8136304faf04 req-d2019d30-dec5-4904-a7cd-3d815732f5db service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:16.420566 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d9e4f59b-573f-4ca6-8761-8136304faf04 req-d2019d30-dec5-4904-a7cd-3d815732f5db service nova] Creating event network-vif-plugged:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:45:16.426245 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d9e4f59b-573f-4ca6-8761-8136304faf04 req-d2019d30-dec5-4904-a7cd-3d815732f5db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030545 Apr 02 21:45:16.426884 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3659/7019] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:45:17.143507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:17.144191 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:17.151549 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:17.152005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:17.152825 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:17.153271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:17.354404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:17.362695 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4d5355f1-bbc9-4cdd-b608-fcc1e554895c tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 200 len: 1604 microversion: 2.1 time: 0.223223 Apr 02 21:45:17.363328 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3361/7020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:17 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:17.425230 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-340ed5b5-d967-4e79-9c0c-929424d82b78 req-704c8dbb-1a99-47f1-8c87-88b6ff990a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0ba556-086a-42c2-b37b-ebb78fa48a2a", "name": "network-vif-deleted", "tag": "8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:17.436387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-340ed5b5-d967-4e79-9c0c-929424d82b78 req-704c8dbb-1a99-47f1-8c87-88b6ff990a32 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:17.436883 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-340ed5b5-d967-4e79-9c0c-929424d82b78 req-704c8dbb-1a99-47f1-8c87-88b6ff990a32 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:17.448934 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-340ed5b5-d967-4e79-9c0c-929424d82b78 req-704c8dbb-1a99-47f1-8c87-88b6ff990a32 service nova] Creating event network-vif-deleted:8ff7f4bd-7df7-43c2-93a7-d64ba5dab50d for instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a on nch2-master-1 Apr 02 21:45:17.458449 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-340ed5b5-d967-4e79-9c0c-929424d82b78 req-704c8dbb-1a99-47f1-8c87-88b6ff990a32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038136 Apr 02 21:45:17.459178 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3660/7021] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:45:18.380200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:18.380810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:18.387633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:18.388092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:18.388926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:18.389376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:18.402647 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. Apr 02 21:45:18.403259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:45:18.404144 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f16badf-19c1-40f5-8521-5ed4be51e057 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 404 len: 111 microversion: 2.1 time: 0.028019 Apr 02 21:45:18.404800 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3362/7022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:18 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:45:18.426049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:18.426876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:18.435580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:18.436131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:18.437048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:18.437742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:18.454786 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. Apr 02 21:45:18.455576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:45:18.456542 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a7fa2ab3-00c0-44b7-9bf0-9d5978fa3716 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 404 len: 111 microversion: 2.1 time: 0.035917 Apr 02 21:45:18.457185 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3661/7023] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:18 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:45:18.506117 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-244523914", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "b5d1da61-b7b6-4e0c-9bae-dde4dea39176"}], "security_groups": [{"name": "tempest-securitygroup--1657421586"}], "key_name": "tempest-keypair-192104428", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:18.607281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] validate_networks() for [('b5d1da61-b7b6-4e0c-9bae-dde4dea39176', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:45:19.008913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:45:19.009348 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:45:19.009829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:45:19.010245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:45:19.010664 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:45:19.019971 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:19.020426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:19.021266 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:19.021719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:19.038140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:45:19.043633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:45:19.056140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:45:19.058484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:45:19.111768 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-25d6e9b2-5902-4328-ba1f-2eda9d8261d8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.604105 Apr 02 21:45:19.114835 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3363/7024] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:45:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:45:19.124706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-379fd728-62f1-4564-9321-1b5b23103be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:19.125896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-379fd728-62f1-4564-9321-1b5b23103be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:19.179087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-379fd728-62f1-4564-9321-1b5b23103be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:19.185999 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-379fd728-62f1-4564-9321-1b5b23103be3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1237 microversion: 2.1 time: 0.065241 Apr 02 21:45:19.186887 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3662/7025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:19 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:20.205093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:20.207676 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:20.215464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:20.215930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:20.216760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:20.217217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:20.294754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:20.302689 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5a70f674-605b-4cc9-af88-b1cd4a2c5a38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1295 microversion: 2.1 time: 0.103179 Apr 02 21:45:20.303494 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3364/7026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:20 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:21.321013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:21.321656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:21.330428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:21.331325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:21.332274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:21.332838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:21.442342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-7724b171-48ba-4d09-b55f-8ebabab6101c req-4b1c6dae-6c2b-4b6c-8b43-4386afdf09a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:21.462604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7724b171-48ba-4d09-b55f-8ebabab6101c req-4b1c6dae-6c2b-4b6c-8b43-4386afdf09a5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:21.463346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-7724b171-48ba-4d09-b55f-8ebabab6101c req-4b1c6dae-6c2b-4b6c-8b43-4386afdf09a5 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:21.482606 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-7724b171-48ba-4d09-b55f-8ebabab6101c req-4b1c6dae-6c2b-4b6c-8b43-4386afdf09a5 service nova] Creating event network-changed:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:45:21.488273 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-7724b171-48ba-4d09-b55f-8ebabab6101c req-4b1c6dae-6c2b-4b6c-8b43-4386afdf09a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050211 Apr 02 21:45:21.489555 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3365/7027] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:45:21.559084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:21.569319 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-06acc7bf-bdc0-4c88-a2c8-eda9ce2b4a6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.252274 Apr 02 21:45:21.570511 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3663/7028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:21 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:22.588096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:22.588818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:22.595873 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:22.596323 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:22.597108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:22.597550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:22.732722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:22.740735 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e6b29c98-f36b-4474-8aa5-d67e64093617 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.157875 Apr 02 21:45:22.741313 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3366/7029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:22 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:23.758157 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:23.758734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:23.765897 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:23.766368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:23.767706 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:23.768164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:23.899202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:23.906710 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72a386b2-7edf-4416-856d-2819bd6abee9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.152659 Apr 02 21:45:23.907241 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3664/7030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:23 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:24.924979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:24.925591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:24.932447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:24.932930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:24.933714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:24.934153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:25.065832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:25.073733 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2e1ed96e-1c5d-40d3-8ef2-6291c5245559 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.153264 Apr 02 21:45:25.074325 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3367/7031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:24 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:26.090850 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:26.091483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:26.098972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:26.099442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:26.100235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:26.100722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:26.233823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:26.241342 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-22319e2b-ec69-47c1-a2c3-c1bb773cde71 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.154462 Apr 02 21:45:26.241926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3665/7032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:26 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:27.258600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:27.259217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:27.266233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:27.266723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:27.268130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:27.268605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:27.405580 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:27.413118 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12ae6cd7-cbdd-4c3c-ad9a-aa9adedfb120 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.158386 Apr 02 21:45:27.413699 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3368/7033] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:27 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:28.370860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-128c9d8a-a1e3-4445-b223-6dc8b7d46163 req-c6f76cda-1311-4c67-adc7-c70ca5da99af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "name": "network-vif-plugged", "status": "completed", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:28.380020 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-128c9d8a-a1e3-4445-b223-6dc8b7d46163 req-c6f76cda-1311-4c67-adc7-c70ca5da99af service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:28.380401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-128c9d8a-a1e3-4445-b223-6dc8b7d46163 req-c6f76cda-1311-4c67-adc7-c70ca5da99af service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:28.394863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-128c9d8a-a1e3-4445-b223-6dc8b7d46163 req-c6f76cda-1311-4c67-adc7-c70ca5da99af service nova] Creating event network-vif-plugged:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:45:28.399899 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-128c9d8a-a1e3-4445-b223-6dc8b7d46163 req-c6f76cda-1311-4c67-adc7-c70ca5da99af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Apr 02 21:45:28.400552 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3666/7034] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:45:28.434293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:28.435087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:28.453020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:28.453488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:28.455433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:28.455887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:28.635473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:28.643683 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-958b55c1-46ee-423a-8696-f7d90bb161ff tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.216327 Apr 02 21:45:28.644261 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3369/7035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:28 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:29.662567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:29.663284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:29.669788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:29.670250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:29.671022 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:29.671475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:29.820243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:29.831188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a92be105-c5bf-4932-864f-27d17fd322d5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1363 microversion: 2.1 time: 0.172250 Apr 02 21:45:29.841267 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3667/7036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:29 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:30.848781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:30.849342 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:30.856085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:30.856553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:30.857338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:30.857785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:30.991989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:30.999459 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c46aff76-456f-4813-8daa-8fd7fa04232a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1548 microversion: 2.1 time: 0.154719 Apr 02 21:45:31.000042 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3370/7037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:30 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:31.016777 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:31.017864 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:31.024646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:31.025126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:31.025921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:31.026387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:31.106886 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-331e203c-7c2c-4b50-9a63-13f2362ae936 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094170 Apr 02 21:45:31.107508 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3668/7038] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Apr 2 21:45:31 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:45:32.066019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-be4da0e2-97c2-426d-93f7-20d1a309c47d req-6c134d09-f91d-4a30-8592-9d3bcb657475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:32.075173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-be4da0e2-97c2-426d-93f7-20d1a309c47d req-6c134d09-f91d-4a30-8592-9d3bcb657475 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:32.075522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-be4da0e2-97c2-426d-93f7-20d1a309c47d req-6c134d09-f91d-4a30-8592-9d3bcb657475 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:32.087396 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-be4da0e2-97c2-426d-93f7-20d1a309c47d req-6c134d09-f91d-4a30-8592-9d3bcb657475 service nova] Creating event network-changed:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:45:32.092868 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-be4da0e2-97c2-426d-93f7-20d1a309c47d req-6c134d09-f91d-4a30-8592-9d3bcb657475 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030474 Apr 02 21:45:32.093665 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3371/7039] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:45:33.435535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:33.436095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:33.442845 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:33.443311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:33.444101 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:33.444723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:33.581143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:33.588510 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff40fa9d-e50c-48b8-aed3-ac72b72bdf80 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1667 microversion: 2.1 time: 0.157981 Apr 02 21:45:33.589089 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3669/7040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:33 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:33.606061 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b608a4-f34f-42bf-9e5b-3ef941ad84f6"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:33.607239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:33.613846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:33.614299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:33.615059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:33.615497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:33.840428 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239348 Apr 02 21:45:33.846392 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3372/7041] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:45:33 2022] POST /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:45:36.058015 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:45:36.059004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:36.066592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:36.067057 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:36.067885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:36.068341 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:36.096172 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:36.101978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Old instance type m1.heat2, new instance type m1.heat {{(pid=136518) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:45:36.108713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:45:36.109151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:45:36.109641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:45:36.110064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:45:36.110486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:45:36.172222 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/action" status: 202 len: 0 microversion: 2.1 time: 0.118241 Apr 02 21:45:36.172907 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3670/7042] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:45:36 2022] POST /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:45:36.182451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:36.183160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:36.190002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:36.190462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:36.191249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:36.191694 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:36.364944 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:36.374802 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8fe30dd3-59f3-4777-9988-bcff7d67d317 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1722 microversion: 2.1 time: 0.197400 Apr 02 21:45:36.375513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3373/7043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:36 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:37.394350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:37.394978 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:37.401254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:37.401744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:37.402525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:37.403006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:37.546278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:37.555060 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7da96ca1-91d6-41c6-a385-49e83bd2a706 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1722 microversion: 2.1 time: 0.165941 Apr 02 21:45:37.555765 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3671/7044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:37 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:38.577901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:38.578514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:38.585276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:38.585733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:38.586496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:38.586935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:38.718556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:38.727031 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6506a27f-9375-4197-a26c-77ce68c14a32 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.153152 Apr 02 21:45:38.727611 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3374/7045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:38 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:39.744385 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:39.744956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:39.752339 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:39.752852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:39.753636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:39.754089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:39.887695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:39.895802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac9e6c0a-2829-4289-b69d-fd986bdf4b0f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.155249 Apr 02 21:45:39.896426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3672/7046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:39 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:40.915867 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:40.916546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:40.923590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:40.924048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:40.924856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:40.925303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:41.055771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:41.064376 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1fb78067-ab6e-4900-8107-c2ebeae56c00 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.151916 Apr 02 21:45:41.064978 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3375/7047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:40 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:42.082362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:42.083040 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:42.089297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:42.089761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:42.090535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:42.090985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:42.225682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:42.233508 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28676330-1b47-4d4a-b76d-a2cff2b1fd27 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.155733 Apr 02 21:45:42.234085 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3673/7048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:42 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:43.250445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:43.251062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:43.257776 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:43.258230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:43.258992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:43.259427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:43.395167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:43.403013 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9a3af4b-d5ae-4919-a5c4-13f6c6be5575 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.156459 Apr 02 21:45:43.403585 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3376/7049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:43 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:44.421141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:44.421769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:44.429120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:44.429778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:44.430676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:44.431141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:44.565797 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:44.573989 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0c4d799-eaba-426d-b458-9550ba935674 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.157085 Apr 02 21:45:44.574560 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3674/7050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:44 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:45.591832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:45.592480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:45.599338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:45.599803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:45.600615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:45.601068 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:45.732617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:45.740532 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-43179371-df1c-4984-867a-5a4de6b2fa97 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.152674 Apr 02 21:45:45.741122 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3377/7051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:45 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:46.758347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:46.758925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:46.765643 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:46.766107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:46.766884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:46.767338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:46.902449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:46.910864 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e131afb4-3fe9-4799-bad4-17a113b87982 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.156531 Apr 02 21:45:46.911441 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3675/7052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:46 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:47.928355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:47.929058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:47.935835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:47.936289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:47.937090 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:47.937542 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:48.072821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:48.081385 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cde40853-e289-401c-8101-e63c036f973b tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.157523 Apr 02 21:45:48.081954 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3378/7053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:47 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:49.097636 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:49.098265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:49.105202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:49.105675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:49.106465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:49.106930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:49.238846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:49.246784 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d90eb449-da56-4f59-a6f5-e3fb6ce8fef5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.153131 Apr 02 21:45:49.247369 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3676/7054] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:49 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:45:50.263728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:50.264354 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:50.271748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:50.272213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:50.273018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:50.273465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:50.410513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:50.418774 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84b9842a-934d-4c36-9068-5f2bd4c0b89a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.159019 Apr 02 21:45:50.419363 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3379/7055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:50 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:51.436938 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:51.437852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:51.445539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:51.446017 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:51.446821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:51.447286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:51.586083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:51.594501 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ddb694a6-343e-4afe-82d6-34fa3a17ef90 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.162195 Apr 02 21:45:51.595113 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3677/7056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:51 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:52.612297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:52.613012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:52.619562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:52.620014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:52.620809 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:52.621250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:52.750551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:52.758702 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b2ed89f4-66b1-422b-af6d-427a44aea54a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.151033 Apr 02 21:45:52.759280 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3380/7057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:52 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:53.775239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:53.775800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:53.782649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:53.783117 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:53.783955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:53.784412 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:53.918133 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:53.926609 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6024fa73-f21f-4bc9-b3ec-9eed400098a1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.155404 Apr 02 21:45:53.927183 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3678/7058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:53 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:54.944177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:54.944819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:54.951567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:54.952019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:54.952814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:54.953256 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:55.087940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:55.096338 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-74a01c7d-41e2-4173-aa9e-7b80f281ef70 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.156111 Apr 02 21:45:55.096943 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3381/7059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:54 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:56.114247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:56.114884 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:56.121890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:56.122361 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:56.123179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:56.123633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:56.258159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:56.266078 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae7201f3-73f0-4832-9888-89fdbbe94d54 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.156334 Apr 02 21:45:56.266672 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3679/7060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:56 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:57.284215 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:57.284854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:57.292260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:57.292742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:57.293509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:57.293955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:57.429076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:57.438379 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dde15747-97d9-4951-b898-db7b4715f841 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.158544 Apr 02 21:45:57.438970 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3382/7061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:57 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:58.455746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:58.456594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:58.463440 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:58.463907 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:58.464714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:58.465169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:58.601503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:58.609434 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b209c015-fa70-43f6-befc-5b19465a1985 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.157926 Apr 02 21:45:58.610015 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3680/7062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:58 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:45:59.627637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:45:59.628314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:45:59.635091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:59.635548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:59.636320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:45:59.636795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:45:59.772815 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:45:59.780657 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ee9b57d9-28c0-485e-8f4a-fabb68b1f7bc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1727 microversion: 2.1 time: 0.157444 Apr 02 21:45:59.781231 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3383/7063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:45:59 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:00.799515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:00.800174 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:00.807417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:00.807874 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:00.808697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:00.809153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:00.956555 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:00.964764 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-108b597d-a2f2-4962-aa26-c8f41796d7b3 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1726 microversion: 2.1 time: 0.169655 Apr 02 21:46:00.965463 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3681/7064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:00 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:01.982240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:01.982856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:01.989900 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:01.990351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:01.991122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:01.991593 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:02.127415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:02.135427 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6320a60c-8709-4392-98b6-2c6634168346 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1724 microversion: 2.1 time: 0.157145 Apr 02 21:46:02.136006 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3384/7065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:01 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:03.153753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:03.154381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:03.161723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:03.162193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:03.162974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:03.163428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:03.298547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:03.307110 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-485eaa89-ac39-4c66-8bbe-eb55ace89ae2 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1724 microversion: 2.1 time: 0.157292 Apr 02 21:46:03.307697 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3682/7066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:03 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:04.324851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:04.325462 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:04.332261 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:04.332757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:04.333529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:04.333973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:04.471894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:04.479895 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e8fbf2e7-5cdf-47f4-a70c-01d95109bdaa tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1724 microversion: 2.1 time: 0.159065 Apr 02 21:46:04.480513 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3385/7067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:04 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:04.518856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d6e151e6-bc0f-44a3-9860-2a53383823bd req-2443e84e-9776-4ebf-82cf-86a2f10c46e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "name": "network-vif-unplugged", "status": "completed", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:04.528266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d6e151e6-bc0f-44a3-9860-2a53383823bd req-2443e84e-9776-4ebf-82cf-86a2f10c46e9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:04.528772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d6e151e6-bc0f-44a3-9860-2a53383823bd req-2443e84e-9776-4ebf-82cf-86a2f10c46e9 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:04.541458 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d6e151e6-bc0f-44a3-9860-2a53383823bd req-2443e84e-9776-4ebf-82cf-86a2f10c46e9 service nova] Creating event network-vif-unplugged:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:46:04.547135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-d6e151e6-bc0f-44a3-9860-2a53383823bd req-2443e84e-9776-4ebf-82cf-86a2f10c46e9 service nova] Instance f8741b6c-71ad-4a60-9278-5f92b665c603 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:46:04.553664 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d6e151e6-bc0f-44a3-9860-2a53383823bd req-2443e84e-9776-4ebf-82cf-86a2f10c46e9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039268 Apr 02 21:46:04.554988 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3683/7068] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:05.497562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:05.498176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:05.505533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.505989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.506757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.507201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.638297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:05.646712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d9cf2b69-64c3-48f3-9bef-bc2b83a1fc18 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1721 microversion: 2.1 time: 0.153000 Apr 02 21:46:05.649381 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3386/7069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:05 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:05.664225 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:05.664912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:05.672145 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.672670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.673465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.674514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.710681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.711156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.711987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.712473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.733256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:46:05.738448 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Getting quotas for user baf3a527e28d43388872b4dba718d940 and project 5f212cc8d96745d2aa089c88769ffc87. Resources: {'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:46:05.835769 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "POST /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/action" status: 202 len: 0 microversion: 2.1 time: 0.175625 Apr 02 21:46:05.836447 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3684/7070] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:46:05 2022] POST /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:46:05.846072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:05.846687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:05.852626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.853083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:05.853856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:05.854296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:06.057283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:06.066194 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c0f0b9b6-74b8-431a-b646-2c4fc1f3cf38 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.225528 Apr 02 21:46:06.066787 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3387/7071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:05 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:07.085047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:07.085674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:07.095432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:07.095909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:07.096742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:07.097209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:07.232520 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:07.240490 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-805eda34-fec7-465e-b8ba-d76660194ddb tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.161471 Apr 02 21:46:07.241076 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3685/7072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:07 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:08.258010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:08.258659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:08.265445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:08.265908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:08.266675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:08.267118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:08.406826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:08.416998 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-46f477ab-59c9-458b-bc20-213c95d7ebdc tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.162540 Apr 02 21:46:08.417608 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3388/7073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:08 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:08.605552 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-564491ca-0e4a-4cba-85f2-cfa561def696 req-dbd58759-2fec-45bf-aa9f-f412d3d8cef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "name": "network-vif-plugged", "status": "completed", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:08.616212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-564491ca-0e4a-4cba-85f2-cfa561def696 req-dbd58759-2fec-45bf-aa9f-f412d3d8cef7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:08.617395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-564491ca-0e4a-4cba-85f2-cfa561def696 req-dbd58759-2fec-45bf-aa9f-f412d3d8cef7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:08.631909 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-564491ca-0e4a-4cba-85f2-cfa561def696 req-dbd58759-2fec-45bf-aa9f-f412d3d8cef7 service nova] Creating event network-vif-plugged:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:46:08.637665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-564491ca-0e4a-4cba-85f2-cfa561def696 req-dbd58759-2fec-45bf-aa9f-f412d3d8cef7 service nova] Instance f8741b6c-71ad-4a60-9278-5f92b665c603 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:46:08.645186 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-564491ca-0e4a-4cba-85f2-cfa561def696 req-dbd58759-2fec-45bf-aa9f-f412d3d8cef7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044301 Apr 02 21:46:08.645893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3686/7074] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:09.436179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:09.437044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:09.444281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:09.445285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:09.445570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:09.446019 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:09.685078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:09.693938 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8458fef3-9f4d-4154-bb57-5427d7c12332 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.262492 Apr 02 21:46:09.694679 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3389/7075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:09 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:10.711764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:10.712406 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:10.720746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:10.721488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:10.722308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:10.722775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:10.859813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:10.870608 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d8dcba2-0d99-4a10-ad13-6d7fef8a4314 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.163270 Apr 02 21:46:10.871215 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3687/7076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:10 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:11.889078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:11.889651 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:11.897015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:11.897471 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:11.898239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:11.898679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:12.035439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:12.044637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3ff802b4-0c23-4904-aefa-356c9f9f9146 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.159604 Apr 02 21:46:12.045228 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3390/7077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:11 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:12.554505 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-daf3c9d3-7c66-4a43-9a61-069ca9bde194 req-290c4570-fa6f-47d3-9c00-8632adb76493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "name": "network-vif-unplugged", "status": "completed", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:12.562702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-daf3c9d3-7c66-4a43-9a61-069ca9bde194 req-290c4570-fa6f-47d3-9c00-8632adb76493 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:12.563235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-daf3c9d3-7c66-4a43-9a61-069ca9bde194 req-290c4570-fa6f-47d3-9c00-8632adb76493 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:12.576566 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-daf3c9d3-7c66-4a43-9a61-069ca9bde194 req-290c4570-fa6f-47d3-9c00-8632adb76493 service nova] Creating event network-vif-unplugged:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:46:12.582140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-daf3c9d3-7c66-4a43-9a61-069ca9bde194 req-290c4570-fa6f-47d3-9c00-8632adb76493 service nova] Instance f8741b6c-71ad-4a60-9278-5f92b665c603 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:46:12.588497 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-daf3c9d3-7c66-4a43-9a61-069ca9bde194 req-290c4570-fa6f-47d3-9c00-8632adb76493 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038033 Apr 02 21:46:12.589106 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3688/7078] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:13.062649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:13.063252 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:13.070571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:13.071026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:13.071791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:13.072230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:13.204358 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:13.212868 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a960d382-14ed-4a5a-afee-a3f6b2f328a5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1720 microversion: 2.1 time: 0.154017 Apr 02 21:46:13.213452 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3391/7079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:13 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:14.231096 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:14.231815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:14.239443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.239905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.240717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.241169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.384051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:14.391959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5678c832-c62f-45c3-83fd-0b91d4dd663a tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1713 microversion: 2.1 time: 0.165262 Apr 02 21:46:14.392776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3689/7080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:14 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1713 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:14.408663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:14.409287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:14.415766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.416229 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.417322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.417771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.557419 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:14.565614 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8c047f4e-b9d3-4310-91f0-f36d2bc4a435 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1713 microversion: 2.1 time: 0.161310 Apr 02 21:46:14.566397 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3392/7081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:14 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:14.581536 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:14.582162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:14.587966 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.588432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.589249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.589702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.723950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:14.732132 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-24071e7d-04b9-4aff-bd18-b3482030fed7 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1713 microversion: 2.1 time: 0.154528 Apr 02 21:46:14.732762 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3690/7082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:14 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:14.748251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:14.748789 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:14.754779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.755245 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.756075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.756490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.780407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:46:14.854720 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01d4fe36-9eca-4e5a-9501-299c443bb645 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 204 len: 0 microversion: 2.1 time: 0.110004 Apr 02 21:46:14.855615 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3393/7083] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:14 2022] DELETE /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:46:14.864712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:14.865953 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:14.872239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.872745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:14.873531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:14.873984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:15.013644 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:15.023297 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8996087-2c79-4342-bb0c-85acd2bcc028 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1719 microversion: 2.1 time: 0.163527 Apr 02 21:46:15.023908 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3691/7084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:14 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:46:16.042208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:16.042947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:16.049791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:16.050250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:16.051026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:16.051473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:16.186263 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:16.194814 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b7e1bbf0-06e5-4402-8c82-5784afa33ef1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1719 microversion: 2.1 time: 0.157256 Apr 02 21:46:16.195393 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3394/7085] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:16 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:16.782287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a761c176-ea72-4844-8526-9b5bcaf6af17 req-929b50c5-ac98-420f-a0a8-d633e73e143a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "name": "network-vif-plugged", "status": "completed", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:16.793049 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a761c176-ea72-4844-8526-9b5bcaf6af17 req-929b50c5-ac98-420f-a0a8-d633e73e143a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:16.793523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a761c176-ea72-4844-8526-9b5bcaf6af17 req-929b50c5-ac98-420f-a0a8-d633e73e143a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:16.806734 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a761c176-ea72-4844-8526-9b5bcaf6af17 req-929b50c5-ac98-420f-a0a8-d633e73e143a service nova] Creating event network-vif-plugged:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:46:16.812033 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a761c176-ea72-4844-8526-9b5bcaf6af17 req-929b50c5-ac98-420f-a0a8-d633e73e143a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034561 Apr 02 21:46:16.812839 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3692/7086] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:46:17.211707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:17.212486 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:17.219551 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:17.220014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:17.220842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:17.221299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:17.489628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:17.497424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4e482dbe-d4d8-47f5-aa83-9a0584026771 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1719 microversion: 2.1 time: 0.289771 Apr 02 21:46:17.498003 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3395/7087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:17 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1719 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:17.948513 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a745e78a-3924-4e85-80c7-51126b479c0a req-fdd48cd2-2a55-4a24-a32a-861927972fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8741b6c-71ad-4a60-9278-5f92b665c603", "name": "network-vif-deleted", "tag": "dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:17.960667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a745e78a-3924-4e85-80c7-51126b479c0a req-fdd48cd2-2a55-4a24-a32a-861927972fc7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:17.961438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a745e78a-3924-4e85-80c7-51126b479c0a req-fdd48cd2-2a55-4a24-a32a-861927972fc7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:17.974116 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a745e78a-3924-4e85-80c7-51126b479c0a req-fdd48cd2-2a55-4a24-a32a-861927972fc7 service nova] Creating event network-vif-deleted:dc1ce2c4-eca0-4fd7-83fb-4e8a2ad5748c for instance f8741b6c-71ad-4a60-9278-5f92b665c603 on nch2-master-1 Apr 02 21:46:17.979923 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a745e78a-3924-4e85-80c7-51126b479c0a req-fdd48cd2-2a55-4a24-a32a-861927972fc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036599 Apr 02 21:46:17.980575 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3693/7088] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:18.517514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:18.518154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:18.525952 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:18.526340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:18.527283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:18.527728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:18.561625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:18.562014 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:18.563167 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lazy-loading 'fault' on Instance uuid f8741b6c-71ad-4a60-9278-5f92b665c603 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:46:18.618326 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf3a527e28d43388872b4dba718d940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f212cc8d96745d2aa089c88769ffc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:18.626181 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f09be156-db31-4854-b25b-56c87640b568 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 200 len: 1327 microversion: 2.1 time: 0.114192 Apr 02 21:46:18.626812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3396/7089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:18 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:19.645923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:19.646638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:19.652890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:19.653362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:19.654141 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:19.654594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:19.669839 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. Apr 02 21:46:19.670437 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:19.671365 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-820f6b9c-1034-47c5-a3a3-85af19c2b4ca tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 404 len: 111 microversion: 2.1 time: 0.031388 Apr 02 21:46:19.671898 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3694/7090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:19 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:19.726456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:19.727416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:19.734126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:19.734586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:19.735363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:19.736431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:19.748772 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. Apr 02 21:46:19.749377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:19.750218 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b86363ce-246d-4658-a335-276f50e6a898 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027766 Apr 02 21:46:19.750753 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3397/7091] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:46:19 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:20.941815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:20.942340 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:20.949163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:20.949630 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:20.950413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:20.950871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:20.964175 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. Apr 02 21:46:20.964919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:20.965787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf43e36d-f496-4b8d-9e37-50b6716bcac5 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 404 len: 111 microversion: 2.1 time: 0.028519 Apr 02 21:46:20.966318 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3695/7092] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:20 2022] DELETE /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:20.974635 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:20.975286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f8741b6c-71ad-4a60-9278-5f92b665c603] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:20.982034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:20.982488 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:20.983248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:20.983687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:20.997529 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. Apr 02 21:46:20.998118 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f8741b6c-71ad-4a60-9278-5f92b665c603 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:20.998939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-de19c223-1887-4f24-b6f5-7226dfad797e tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603" status: 404 len: 111 microversion: 2.1 time: 0.028687 Apr 02 21:46:20.999575 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3398/7093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:20 2022] GET /compute/v2.1/servers/f8741b6c-71ad-4a60-9278-5f92b665c603 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.008107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.008672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:21.014657 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.015132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.015921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.016381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.029630 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. Apr 02 21:46:21.030235 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:21.031251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-902680b8-df13-4f81-a4d3-d5979f2cdb6f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 404 len: 111 microversion: 2.1 time: 0.027070 Apr 02 21:46:21.031783 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3696/7094] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:21 2022] DELETE /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.040241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.040890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: cc0ba556-086a-42c2-b37b-ebb78fa48a2a] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:21.047026 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.047483 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.048868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.049343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.064712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. Apr 02 21:46:21.065306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance cc0ba556-086a-42c2-b37b-ebb78fa48a2a could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:21.066129 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-146a0e0a-bd8a-46c1-a232-be8bde0652b1 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a" status: 404 len: 111 microversion: 2.1 time: 0.029802 Apr 02 21:46:21.066643 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3399/7095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:21 2022] GET /compute/v2.1/servers/cc0ba556-086a-42c2-b37b-ebb78fa48a2a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.074321 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.074842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:21.080817 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.081322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.082107 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.082569 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.096359 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. Apr 02 21:46:21.097000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:21.097845 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-33c4d58e-9f4f-46e1-8fbf-0139ef87d4f4 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 404 len: 111 microversion: 2.1 time: 0.027373 Apr 02 21:46:21.098387 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3697/7096] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:21 2022] DELETE /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.105918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.106527 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: f70e74fe-4037-410d-8d97-264436409ef3] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:21.113073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.113554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.114320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.114761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.128784 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. Apr 02 21:46:21.129380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance f70e74fe-4037-410d-8d97-264436409ef3 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:21.130217 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bdfbc921-6c99-4a34-941f-fb62ec96a6a9 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3" status: 404 len: 111 microversion: 2.1 time: 0.028058 Apr 02 21:46:21.130751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3400/7097] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:21 2022] GET /compute/v2.1/servers/f70e74fe-4037-410d-8d97-264436409ef3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.138424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.138973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:21.145994 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.146464 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.147249 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.147704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.161251 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. Apr 02 21:46:21.161849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:21.162690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-912a5fa5-bc31-43c8-ab7f-114da89a05cd tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 404 len: 111 microversion: 2.1 time: 0.028116 Apr 02 21:46:21.163388 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3698/7098] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:21 2022] DELETE /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.171306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.171856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] [instance: 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:21.178055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.178523 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.179332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:21.179785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:21.193637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] HTTP exception thrown: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. Apr 02 21:46:21.194233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Returning 404 to user: Instance 6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:21.195073 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c7740097-44aa-4dd0-87e1-7e9a1e5a7f73 tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0" status: 404 len: 111 microversion: 2.1 time: 0.027751 Apr 02 21:46:21.195625 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3401/7099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:21 2022] GET /compute/v2.1/servers/6dc8d0b0-f622-4ab1-b80b-ee490b24a2e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:21.203898 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f73fc9a-843b-4989-9a27-d73249ae494f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] Calling method '.version_select at 0x7f54c7c1f280>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:21.226739 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f73fc9a-843b-4989-9a27-d73249ae494f tempest-ServerActionsTestJSON-1728208507 tempest-ServerActionsTestJSON-1728208507-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192104428" status: 202 len: 0 microversion: 2.1 time: 0.026942 Apr 02 21:46:21.227318 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3699/7100] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Apr 2 21:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192104428 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 02 21:46:26.998751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1130901535", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "8a27b79a-dd6c-497c-a00a-8c6bf30a0d16"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:27.050114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] validate_networks() for [('8a27b79a-dd6c-497c-a00a-8c6bf30a0d16', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:46:27.384841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:46:27.385274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:46:27.385756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:46:27.386172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:46:27.386586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:46:27.396075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:27.396570 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:27.397427 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:27.398255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:27.417364 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Getting quotas for project 262a1451abbf479da01623a8cb576601. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:46:27.422616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Getting quotas for user 33119dc511be4910b9d7ff2770dbd47b and project 262a1451abbf479da01623a8cb576601. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:46:27.435529 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:46:27.439042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:46:27.483816 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a76e396a-14bc-4ce9-b801-03a4dca57f03 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598975 Apr 02 21:46:27.484505 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3402/7101] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:46:27.496076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ff87c767-544f-41b9-8136-3d4770c9b4a1 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:27.496755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ff87c767-544f-41b9-8136-3d4770c9b4a1 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:27.557804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ff87c767-544f-41b9-8136-3d4770c9b4a1 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:27.564550 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ff87c767-544f-41b9-8136-3d4770c9b4a1 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1217 microversion: 2.1 time: 0.073214 Apr 02 21:46:27.565133 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3700/7102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:27 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:28.582214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:28.582978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:28.589133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:28.589602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:28.590392 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:28.590844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:28.669728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:28.679016 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-53287806-ff47-4cc7-8d24-1c0a7a7502f3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1277 microversion: 2.1 time: 0.101872 Apr 02 21:46:28.679896 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3403/7103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:28 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:29.697146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:29.697825 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:29.704749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:29.705333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:29.706247 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:29.706812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:29.853742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2b2f2363-e944-4683-a2ac-870f0e741f49 req-6e8ea367-a8e5-4f9d-a91f-bd5b4ae51a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006094f2-a736-48d1-bc85-ef0c52a4ec8c", "tag": "d4f75ebf-82c6-468d-981b-3b1ecec06aca"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:29.859991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:29.864732 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2b2f2363-e944-4683-a2ac-870f0e741f49 req-6e8ea367-a8e5-4f9d-a91f-bd5b4ae51a8b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:29.866081 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2b2f2363-e944-4683-a2ac-870f0e741f49 req-6e8ea367-a8e5-4f9d-a91f-bd5b4ae51a8b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:29.871081 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6c2fead4-e998-45b2-9ddf-caa1f202467b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1317 microversion: 2.1 time: 0.177832 Apr 02 21:46:29.871677 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3701/7104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:29 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:29.884967 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2b2f2363-e944-4683-a2ac-870f0e741f49 req-6e8ea367-a8e5-4f9d-a91f-bd5b4ae51a8b service nova] Creating event network-changed:d4f75ebf-82c6-468d-981b-3b1ecec06aca for instance 006094f2-a736-48d1-bc85-ef0c52a4ec8c on nch2-master-1 Apr 02 21:46:29.890166 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2b2f2363-e944-4683-a2ac-870f0e741f49 req-6e8ea367-a8e5-4f9d-a91f-bd5b4ae51a8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041751 Apr 02 21:46:29.890779 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3404/7105] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:46:30.888858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:30.889497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:30.899411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:30.899892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:30.900719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:30.901186 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:31.031908 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:31.039437 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e0a59fa3-25ba-4f8c-862d-42c4943b234d tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1317 microversion: 2.1 time: 0.154581 Apr 02 21:46:31.040025 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3702/7106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:30 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:46:32.062254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:32.062955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:32.069200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:32.069655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:32.070418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:32.070856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:32.205888 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:32.213348 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0c560ac8-8e4d-4b1b-98cd-5892add282c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1317 microversion: 2.1 time: 0.156193 Apr 02 21:46:32.213928 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3405/7107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:32 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:33.230808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:33.231449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:33.238946 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:33.239424 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:33.240218 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:33.240719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:33.374325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:33.381911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f21aa070-c008-46ad-a898-bec8919d179c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1317 microversion: 2.1 time: 0.155096 Apr 02 21:46:33.382490 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3703/7108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:33 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:34.398655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:34.399293 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:34.406200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:34.406656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:34.407422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:34.407863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:34.540240 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:34.548080 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-668d1be7-ffa7-4403-aa29-a7dd67faef16 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1317 microversion: 2.1 time: 0.153212 Apr 02 21:46:34.548725 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3406/7109] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:34 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:34.712622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-408da064-7f0d-42e4-a9f7-2ed1dc91e459 req-1c4652ac-7bcc-4322-aba1-2cf854910712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006094f2-a736-48d1-bc85-ef0c52a4ec8c", "name": "network-vif-plugged", "status": "completed", "tag": "d4f75ebf-82c6-468d-981b-3b1ecec06aca"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:34.722456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-408da064-7f0d-42e4-a9f7-2ed1dc91e459 req-1c4652ac-7bcc-4322-aba1-2cf854910712 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:34.722926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-408da064-7f0d-42e4-a9f7-2ed1dc91e459 req-1c4652ac-7bcc-4322-aba1-2cf854910712 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:34.736991 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-408da064-7f0d-42e4-a9f7-2ed1dc91e459 req-1c4652ac-7bcc-4322-aba1-2cf854910712 service nova] Creating event network-vif-plugged:d4f75ebf-82c6-468d-981b-3b1ecec06aca for instance 006094f2-a736-48d1-bc85-ef0c52a4ec8c on nch2-master-1 Apr 02 21:46:34.742093 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-408da064-7f0d-42e4-a9f7-2ed1dc91e459 req-1c4652ac-7bcc-4322-aba1-2cf854910712 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033193 Apr 02 21:46:34.742868 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3704/7110] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:35.565761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:35.566382 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:35.573163 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:35.573621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:35.574380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:35.574822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:35.708886 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:35.716259 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f46b166-b745-4667-a886-1252e5df62b2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1317 microversion: 2.1 time: 0.154543 Apr 02 21:46:35.716874 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3407/7111] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:35 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:36.735183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:36.736024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:36.742419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:36.742885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:36.743670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:36.744126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:36.878535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:36.886114 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-39e5c7b6-0684-4fa0-9ff3-3777daf30993 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.156155 Apr 02 21:46:36.886694 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3705/7112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:36 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:36.939726 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-128112438", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "8a27b79a-dd6c-497c-a00a-8c6bf30a0d16"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:36.990720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] validate_networks() for [('8a27b79a-dd6c-497c-a00a-8c6bf30a0d16', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:46:37.351696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:46:37.352124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:46:37.352636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:46:37.353051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:46:37.353466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:46:37.362402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:37.362855 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:37.363659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:37.364099 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:37.380343 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Getting quotas for project 262a1451abbf479da01623a8cb576601. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:46:37.385585 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Getting quotas for user 33119dc511be4910b9d7ff2770dbd47b and project 262a1451abbf479da01623a8cb576601. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:46:37.398428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:46:37.400777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:46:37.444973 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-12350949-5228-4e6c-8f50-dfae39936fce tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509128 Apr 02 21:46:37.445644 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3408/7113] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:46:37.457739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c0fdd844-2ad5-4cc1-a150-7e49f02c5ecb tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:37.458407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c0fdd844-2ad5-4cc1-a150-7e49f02c5ecb tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:37.518647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c0fdd844-2ad5-4cc1-a150-7e49f02c5ecb tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:37.527473 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c0fdd844-2ad5-4cc1-a150-7e49f02c5ecb tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1216 microversion: 2.1 time: 0.075113 Apr 02 21:46:37.528370 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3706/7114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:37 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1216 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:38.552036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:38.552717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:38.559617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:38.560084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:38.560901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:38.561349 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:38.634756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:38.642179 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a9bceac5-262a-4d9b-80d9-fdc8443f691b tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1274 microversion: 2.1 time: 0.095497 Apr 02 21:46:38.643306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3409/7115] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:38 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:39.661180 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:39.661757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:39.669498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:39.669962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:39.670758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:39.671213 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:39.690835 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0e171095-f7e7-473a-ad08-5b83d65a88fa req-86d542e1-ebf6-4d5a-87f9-7a54f3673708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9889097b-9847-43aa-8ee8-593be627b66b", "tag": "5a832a95-fac2-4dae-abd5-da8401620934"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:39.700304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0e171095-f7e7-473a-ad08-5b83d65a88fa req-86d542e1-ebf6-4d5a-87f9-7a54f3673708 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:39.701131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0e171095-f7e7-473a-ad08-5b83d65a88fa req-86d542e1-ebf6-4d5a-87f9-7a54f3673708 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:39.712630 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0e171095-f7e7-473a-ad08-5b83d65a88fa req-86d542e1-ebf6-4d5a-87f9-7a54f3673708 service nova] Creating event network-changed:5a832a95-fac2-4dae-abd5-da8401620934 for instance 9889097b-9847-43aa-8ee8-593be627b66b on nch2-master-1 Apr 02 21:46:39.717663 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0e171095-f7e7-473a-ad08-5b83d65a88fa req-86d542e1-ebf6-4d5a-87f9-7a54f3673708 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Apr 02 21:46:39.718673 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3410/7116] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:46:39.834852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:39.842505 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-14afee0d-6b3b-49e4-9538-36174dd5cbf2 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1316 microversion: 2.1 time: 0.185541 Apr 02 21:46:39.843409 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3707/7117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:39 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:40.861738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:40.862456 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:40.869227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:40.869810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:40.870757 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:40.871253 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:41.013470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:41.021361 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc7525fa-ee99-407d-b7c4-70a7c8ad5368 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1316 microversion: 2.1 time: 0.165301 Apr 02 21:46:41.021939 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3411/7118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:40 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:42.038155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:42.038765 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:42.045310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:42.045775 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:42.046579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:42.047029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:42.176153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:42.183522 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e379b1f-da4d-492c-ba61-cc483c67ed1e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1316 microversion: 2.1 time: 0.149394 Apr 02 21:46:42.184093 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3708/7119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:42 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:43.201017 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:43.201677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:43.208335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:43.208833 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:43.209609 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:43.210058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:43.342662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:43.350291 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b2e55b8-ded0-44a2-81da-4b29a825ad57 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1316 microversion: 2.1 time: 0.153168 Apr 02 21:46:43.350877 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3412/7120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:43 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:44.367171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:44.367810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:44.374687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:44.375161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:44.375948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:44.376409 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:44.518880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:44.526455 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-399c10ac-a8ff-40b6-a0bb-c8c41b7295dc tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1316 microversion: 2.1 time: 0.163208 Apr 02 21:46:44.527037 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3709/7121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:44 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:44.835464 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-6efa38a1-84d5-44c1-bea9-b298cdfb113b req-73104b87-e23b-44f8-af2d-4f88a46fe8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9889097b-9847-43aa-8ee8-593be627b66b", "name": "network-vif-plugged", "status": "completed", "tag": "5a832a95-fac2-4dae-abd5-da8401620934"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:44.843752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6efa38a1-84d5-44c1-bea9-b298cdfb113b req-73104b87-e23b-44f8-af2d-4f88a46fe8d8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:44.844208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-6efa38a1-84d5-44c1-bea9-b298cdfb113b req-73104b87-e23b-44f8-af2d-4f88a46fe8d8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:44.854910 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-6efa38a1-84d5-44c1-bea9-b298cdfb113b req-73104b87-e23b-44f8-af2d-4f88a46fe8d8 service nova] Creating event network-vif-plugged:5a832a95-fac2-4dae-abd5-da8401620934 for instance 9889097b-9847-43aa-8ee8-593be627b66b on nch2-master-1 Apr 02 21:46:44.859927 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-6efa38a1-84d5-44c1-bea9-b298cdfb113b req-73104b87-e23b-44f8-af2d-4f88a46fe8d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103779 Apr 02 21:46:44.860580 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3413/7122] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:45.543182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:45.543819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:45.551290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:45.551770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:45.552608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:45.553066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:45.688381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:45.696326 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d3e152dc-0a71-427d-a1c2-a9acb3e32c2e tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1316 microversion: 2.1 time: 0.157579 Apr 02 21:46:45.696932 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3710/7123] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:45 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:46.714868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:46.715535 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:46.723055 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:46.723515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:46.724303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:46.724787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:46.857335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:46.864712 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6b78befb-9f0d-4eb5-9af7-9ef0a5792ab6 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1505 microversion: 2.1 time: 0.155349 Apr 02 21:46:46.865291 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3414/7124] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:46 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:46.881441 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:46.881943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:46.888719 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:46.889212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:46.889987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:46.890445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:46.915106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:46:46.990951 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ac8a60e6-6bc0-41d6-bcd4-cd4c00a969ec tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 204 len: 0 microversion: 2.1 time: 0.113676 Apr 02 21:46:46.991498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3711/7125] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:46 2022] DELETE /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:46:47.000507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:47.001139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:47.007775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:47.008238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:47.009066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:47.009548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:47.145961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:47.153409 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db14cd37-d818-4e91-ace5-edf02b7343b4 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1511 microversion: 2.1 time: 0.157812 Apr 02 21:46:47.153998 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3415/7126] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:46 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:48.172425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:48.173178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:48.179930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:48.180402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:48.181219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:48.181679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:48.313785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:48.321202 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb136bcb-c90e-4bd1-afe3-b620342a85ee tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1511 microversion: 2.1 time: 0.153109 Apr 02 21:46:48.321780 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3712/7127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:48 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:49.113634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-dad6c06f-175b-4634-a371-0fddb4c46fd7 req-04e6b2a3-5d2c-4c49-979b-c3d9d177d7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9889097b-9847-43aa-8ee8-593be627b66b", "name": "network-vif-deleted", "tag": "5a832a95-fac2-4dae-abd5-da8401620934"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:49.121718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dad6c06f-175b-4634-a371-0fddb4c46fd7 req-04e6b2a3-5d2c-4c49-979b-c3d9d177d7eb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:49.122414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-dad6c06f-175b-4634-a371-0fddb4c46fd7 req-04e6b2a3-5d2c-4c49-979b-c3d9d177d7eb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:49.133796 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-dad6c06f-175b-4634-a371-0fddb4c46fd7 req-04e6b2a3-5d2c-4c49-979b-c3d9d177d7eb service nova] Creating event network-vif-deleted:5a832a95-fac2-4dae-abd5-da8401620934 for instance 9889097b-9847-43aa-8ee8-593be627b66b on nch2-master-1 Apr 02 21:46:49.138389 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-dad6c06f-175b-4634-a371-0fddb4c46fd7 req-04e6b2a3-5d2c-4c49-979b-c3d9d177d7eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119490 Apr 02 21:46:49.139186 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3416/7128] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:49.338000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:49.338586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:49.345675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:49.346177 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:49.346963 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:49.347420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:49.377347 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:49.378466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:49.378937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lazy-loading 'fault' on Instance uuid 9889097b-9847-43aa-8ee8-593be627b66b {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:46:49.424254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:49.433696 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cd1b4dd4-00ef-4f44-b17f-9be3bdb25943 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 200 len: 1306 microversion: 2.1 time: 0.099726 Apr 02 21:46:49.434274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3713/7129] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:49 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:50.454250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:50.455407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:50.462087 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.462553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.463344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.463793 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.477554 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] HTTP exception thrown: Instance 9889097b-9847-43aa-8ee8-593be627b66b could not be found. Apr 02 21:46:50.478160 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 404 to user: Instance 9889097b-9847-43aa-8ee8-593be627b66b could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:50.479010 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-10a28148-6f6c-425e-af8e-c35dbbdcc479 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 404 len: 111 microversion: 2.1 time: 0.030026 Apr 02 21:46:50.479553 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3417/7130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:50 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:50.488952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:50.489590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:50.496325 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.496838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.497622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.498083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.630588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:50.637925 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9dfa2329-b1d2-4b56-8ec0-725658038d55 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.153582 Apr 02 21:46:50.638502 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3714/7131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:50 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:50.655181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c56728d-b10c-486c-bd03-7edc8c366c3c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:50.656176 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7c56728d-b10c-486c-bd03-7edc8c366c3c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 6a98448e-c0df-4063-9736-52ca7d7fb4ae] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:50.662362 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-7c56728d-b10c-486c-bd03-7edc8c366c3c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] HTTP exception thrown: Instance 6a98448e-c0df-4063-9736-52ca7d7fb4ae could not be found. Apr 02 21:46:50.662951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7c56728d-b10c-486c-bd03-7edc8c366c3c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 404 to user: Instance 6a98448e-c0df-4063-9736-52ca7d7fb4ae could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:50.663777 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7c56728d-b10c-486c-bd03-7edc8c366c3c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "POST /compute/v2.1/servers/6a98448e-c0df-4063-9736-52ca7d7fb4ae/action" status: 404 len: 111 microversion: 2.1 time: 0.012667 Apr 02 21:46:50.664312 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3418/7132] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:46:50 2022] POST /compute/v2.1/servers/6a98448e-c0df-4063-9736-52ca7d7fb4ae/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:50.672201 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:50.672892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:50.678962 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.679426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.680239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.680717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.810355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:50.818356 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-df1b6fcf-b312-4958-b65e-f808ce4fa055 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.149971 Apr 02 21:46:50.818926 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3715/7133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:50 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:50.834803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:50.835417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:50.842096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.842548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.843308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:50.843751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:50.980308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:50.988477 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-28502a97-07d1-4921-89e4-b92700331f71 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.157199 Apr 02 21:46:50.989058 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3419/7134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:50 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:51.004600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "99486db6-5dde-4d8a-b4a8-ed700241660b"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:51.005659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.011889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.012286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.013168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.013628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.041064 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:51.046366 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] HTTP exception thrown: Flavor 99486db6-5dde-4d8a-b4a8-ed700241660b could not be found. Apr 02 21:46:51.046983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 400 to user: Flavor 99486db6-5dde-4d8a-b4a8-ed700241660b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:51.047851 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-45b64432-df0c-40d0-bd8d-64d182511b05 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "POST /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c/action" status: 400 len: 107 microversion: 2.1 time: 0.047325 Apr 02 21:46:51.048410 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3716/7135] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:46:50 2022] POST /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c/action => generated 107 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:46:51.057185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.057836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.063817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.064277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.065107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.065565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.195142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:51.202543 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7f114f31-41e7-4efa-8e8c-fe684c81e6c8 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.149241 Apr 02 21:46:51.203115 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3420/7136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:51 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:51.219318 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.219948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.226457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.226930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.227715 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.228173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.361766 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:51.369790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7a0db65c-5baf-47ff-894e-043e638da5c7 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.154331 Apr 02 21:46:51.370371 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3717/7137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:51 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:51.385802 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd2ada69-1d22-46f5-ad27-ef36dfe8066c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:51.386998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd2ada69-1d22-46f5-ad27-ef36dfe8066c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:51.387809 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd2ada69-1d22-46f5-ad27-ef36dfe8066c tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "POST /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c/action" status: 400 len: 113 microversion: 2.1 time: 0.005980 Apr 02 21:46:51.388324 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3421/7138] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:46:51 2022] POST /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 02 21:46:51.396563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.397194 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.403231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.403707 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.404514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.404984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.539333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:51.547140 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b42a2778-947f-4640-99e1-4daed612f852 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1506 microversion: 2.1 time: 0.154961 Apr 02 21:46:51.547719 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3718/7139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:51 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:51.567801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.568294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.575208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.575675 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.576478 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.576936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.590361 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] HTTP exception thrown: Instance 9889097b-9847-43aa-8ee8-593be627b66b could not be found. Apr 02 21:46:51.590966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 404 to user: Instance 9889097b-9847-43aa-8ee8-593be627b66b could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:51.591804 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ff5ad765-63d5-4c2a-9c9a-d799d4a0f651 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 404 len: 111 microversion: 2.1 time: 0.028793 Apr 02 21:46:51.592334 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3422/7140] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:51 2022] DELETE /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 02 21:46:51.600826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.601491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 9889097b-9847-43aa-8ee8-593be627b66b] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.607393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.607867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.608680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.609139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.622433 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] HTTP exception thrown: Instance 9889097b-9847-43aa-8ee8-593be627b66b could not be found. Apr 02 21:46:51.623063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 404 to user: Instance 9889097b-9847-43aa-8ee8-593be627b66b could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:51.623899 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0f864c8c-ac25-45fa-a7d8-97af5369ec34 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b" status: 404 len: 111 microversion: 2.1 time: 0.027644 Apr 02 21:46:51.624421 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3719/7141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:51 2022] GET /compute/v2.1/servers/9889097b-9847-43aa-8ee8-593be627b66b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:46:51.634279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.634800 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.640882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.641346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.642128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.642576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.667853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:46:51.742393 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-960de0d1-e8d7-40c2-b61e-657aa865d419 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "DELETE /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 204 len: 0 microversion: 2.1 time: 0.113478 Apr 02 21:46:51.743205 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3423/7142] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:46:51 2022] DELETE /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:46:51.751088 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:51.751837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:51.757888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.758357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.759135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:51.759588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:51.895755 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:51.903268 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-633f634f-d521-49ff-a645-e7b3bd1bfaa3 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1512 microversion: 2.1 time: 0.156063 Apr 02 21:46:51.903841 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3720/7143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:51 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:52.922049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:52.922765 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:52.929126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:52.929589 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:52.930359 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:52.930805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:53.071598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:53.079126 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1feb21c5-58a5-4ead-8c70-ca447512d523 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1512 microversion: 2.1 time: 0.161445 Apr 02 21:46:53.079702 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3424/7144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:52 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:53.684789 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-f4ad5af6-6cac-4ae8-97e8-7f0d0c80be4b req-0cdb3dc9-36cc-49c2-b7da-34cc9899c9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006094f2-a736-48d1-bc85-ef0c52a4ec8c", "name": "network-vif-deleted", "tag": "d4f75ebf-82c6-468d-981b-3b1ecec06aca"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:46:53.694523 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f4ad5af6-6cac-4ae8-97e8-7f0d0c80be4b req-0cdb3dc9-36cc-49c2-b7da-34cc9899c9b3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:53.695006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-f4ad5af6-6cac-4ae8-97e8-7f0d0c80be4b req-0cdb3dc9-36cc-49c2-b7da-34cc9899c9b3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:53.708448 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-f4ad5af6-6cac-4ae8-97e8-7f0d0c80be4b req-0cdb3dc9-36cc-49c2-b7da-34cc9899c9b3 service nova] Creating event network-vif-deleted:d4f75ebf-82c6-468d-981b-3b1ecec06aca for instance 006094f2-a736-48d1-bc85-ef0c52a4ec8c on nch2-master-1 Apr 02 21:46:53.714792 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-f4ad5af6-6cac-4ae8-97e8-7f0d0c80be4b req-0cdb3dc9-36cc-49c2-b7da-34cc9899c9b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033828 Apr 02 21:46:53.715416 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3721/7145] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:46:54.097155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:54.098196 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:54.105844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:54.106355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:54.107705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:54.108292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:54.142209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:54.142681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:54.143141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lazy-loading 'fault' on Instance uuid 006094f2-a736-48d1-bc85-ef0c52a4ec8c {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:46:54.189169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33119dc511be4910b9d7ff2770dbd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262a1451abbf479da01623a8cb576601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:46:54.196851 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f96413f-7d87-494b-938c-0523dd76ef18 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 200 len: 1307 microversion: 2.1 time: 0.104491 Apr 02 21:46:54.197308 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3425/7146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:54 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:46:55.214737 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:46:55.215463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] [instance: 006094f2-a736-48d1-bc85-ef0c52a4ec8c] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:46:55.223137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:55.223612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:55.224400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:46:55.224880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:46:55.237916 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] HTTP exception thrown: Instance 006094f2-a736-48d1-bc85-ef0c52a4ec8c could not be found. Apr 02 21:46:55.238518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] Returning 404 to user: Instance 006094f2-a736-48d1-bc85-ef0c52a4ec8c could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:46:55.239364 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11f35a3d-cb0f-4c71-bdd3-7caa4e72dc74 tempest-ServersNegativeTestJSON-1321748329 tempest-ServersNegativeTestJSON-1321748329-project] 10.222.0.18 "GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c" status: 404 len: 111 microversion: 2.1 time: 0.029038 Apr 02 21:46:55.239893 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3722/7147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:46:55 2022] GET /compute/v2.1/servers/006094f2-a736-48d1-bc85-ef0c52a4ec8c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:47:33.790986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b8ced307-f90f-440a-a17d-7b7ee85834e4 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Action: 'create', calling method: .version_select at 0x7f54d4b125e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-777885352"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:47:33.806147 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b8ced307-f90f-440a-a17d-7b7ee85834e4 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Getting quotas for project fd583fa9f14e418e850937a746252b93. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:47:33.811334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b8ced307-f90f-440a-a17d-7b7ee85834e4 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Getting quotas for user 724e735d54f244ab9c2fef0c55a185bb and project fd583fa9f14e418e850937a746252b93. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:47:34.139940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b8ced307-f90f-440a-a17d-7b7ee85834e4 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Getting quotas for project fd583fa9f14e418e850937a746252b93. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:47:34.145524 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-b8ced307-f90f-440a-a17d-7b7ee85834e4 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Getting quotas for user 724e735d54f244ab9c2fef0c55a185bb and project fd583fa9f14e418e850937a746252b93. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:47:34.160508 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b8ced307-f90f-440a-a17d-7b7ee85834e4 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.373756 Apr 02 21:47:34.161123 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3426/7148] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:47:33 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:34.208679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1676966154", "imageRef": "6d99bb29-a606-4ba7-b04f-7d51ad5e2f31", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-777885352", "networks": [{"uuid": "77ec5217-ea97-4f7a-9757-3122d63d0e89"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:47:34.259983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] validate_networks() for [('77ec5217-ea97-4f7a-9757-3122d63d0e89', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:47:34.718561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:47:34.719006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:47:34.719498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:47:34.719925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:47:34.720923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:47:34.729735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:34.730200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:34.731047 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:34.731531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:34.748598 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Getting quotas for project fd583fa9f14e418e850937a746252b93. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:47:34.753885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Getting quotas for user 724e735d54f244ab9c2fef0c55a185bb and project fd583fa9f14e418e850937a746252b93. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:47:34.765958 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:47:34.768227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6d99bb29-a606-4ba7-b04f-7d51ad5e2f31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:47:34.812707 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98894f5c-2073-408e-8246-1e418a9920a7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608774 Apr 02 21:47:34.813366 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3723/7149] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:47:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:47:34.824376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc2e0654-2744-450a-9e29-bce4b694a927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:34.825029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc2e0654-2744-450a-9e29-bce4b694a927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:34.878514 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc2e0654-2744-450a-9e29-bce4b694a927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:34.885954 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc2e0654-2744-450a-9e29-bce4b694a927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1258 microversion: 2.1 time: 0.066658 Apr 02 21:47:34.886519 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3427/7150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:34 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:47:35.904250 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:35.904921 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:35.910924 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:35.911395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:35.912217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:35.912656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:35.976842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:35.985790 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-dd031523-497f-4310-8e30-c0477aca6e91 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1318 microversion: 2.1 time: 0.086434 Apr 02 21:47:35.989154 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3724/7151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:35 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1318 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:37.003193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:37.012733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:37.021843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:37.022321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:37.023223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:37.023586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:37.201489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:37.212161 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-24554b5e-fbe8-4e1f-9c89-29ba36931739 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.212584 Apr 02 21:47:37.214253 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3428/7152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:36 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:38.234471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:38.236807 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:38.253996 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:38.254489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:38.255292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:38.255750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:38.403619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:38.411522 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-fe35588d-4b2a-4c5c-9b83-8f791a791396 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.183151 Apr 02 21:47:38.412288 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3725/7153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:38 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:39.429801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:39.430555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:39.437967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:39.439386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:39.440622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:39.441305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:39.603655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:39.613051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6a372e8b-a203-444f-aaa1-4b17938827bf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.187124 Apr 02 21:47:39.613751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3429/7154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:39 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:40.631195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:40.632063 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:40.638735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:40.639223 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:40.640038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:40.640526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:40.794312 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:40.809478 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5414df2-35e3-4c1c-92d8-2aade77e3029 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.182811 Apr 02 21:47:40.810301 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3726/7155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:40 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:41.827397 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:41.827980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:41.839084 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:41.840536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:41.841490 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:41.842139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:42.025865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:42.033399 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a2779d4d-10a3-42f8-baf2-7105809c54b0 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.210339 Apr 02 21:47:42.033980 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3430/7156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:41 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:43.050732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:43.052307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:43.059043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:43.059539 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:43.060343 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:43.060834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:43.211380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:43.218950 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-67dd6465-4726-45d7-89f8-8612ed8eea9f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.172696 Apr 02 21:47:43.219555 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3727/7157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:43 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:44.237289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:44.237961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:44.244748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:44.245212 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:44.245999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:44.246445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:44.460619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:44.468392 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0aa0f028-b2e3-4e7f-a366-7b99d9314ee3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.235584 Apr 02 21:47:44.469005 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3431/7158] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:44 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:44.786757 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-e8fd7cad-05d5-41a3-8165-193f36809e03 req-ab587903-fd85-4a24-9642-3d45c8f87e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:47:44.807700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8fd7cad-05d5-41a3-8165-193f36809e03 req-ab587903-fd85-4a24-9642-3d45c8f87e4b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:44.808436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-e8fd7cad-05d5-41a3-8165-193f36809e03 req-ab587903-fd85-4a24-9642-3d45c8f87e4b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:44.827781 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-e8fd7cad-05d5-41a3-8165-193f36809e03 req-ab587903-fd85-4a24-9642-3d45c8f87e4b service nova] Creating event network-changed:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:47:44.837482 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-e8fd7cad-05d5-41a3-8165-193f36809e03 req-ab587903-fd85-4a24-9642-3d45c8f87e4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055719 Apr 02 21:47:44.839701 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3728/7159] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:47:45.485140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:45.486988 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:45.493773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:45.494251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:45.495006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:45.495448 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:45.714705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:45.722664 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1b88e130-a809-4579-bff8-8187a1661ae2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.241356 Apr 02 21:47:45.723604 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3432/7160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:45 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:46.739812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:46.740556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:46.747732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:46.748203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:46.749025 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:46.749484 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:46.883778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:46.891219 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ed520385-7567-43db-a64e-225d0a6bcedf tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.156047 Apr 02 21:47:46.891805 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3729/7161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:46 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:47.909124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:47.910396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:47.917624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:47.918092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:47.918874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:47.919320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:48.066654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:48.079694 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-279a8351-63e5-4cd1-81c6-86f8d4a4c6a5 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.175008 Apr 02 21:47:48.080984 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3433/7162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:47 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:49.097376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:49.098002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:49.104758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:49.105232 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:49.106013 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:49.106465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:49.240947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:49.248482 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28173ad2-a32d-4225-b58f-7f5faa0c8f75 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.155123 Apr 02 21:47:49.249084 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3730/7163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:49 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:50.265210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:50.265830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:50.272526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:50.272983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:50.273749 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:50.274187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:50.409107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:50.416762 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-32040e1a-56e2-401b-b160-72e0047ac070 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.155470 Apr 02 21:47:50.417324 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3434/7164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:50 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:51.289009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-885c4939-c791-4d09-948e-04d94373c122 req-5630656d-4e19-497e-9b13-7bf1b4823a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "name": "network-vif-plugged", "status": "completed", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:47:51.297822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-885c4939-c791-4d09-948e-04d94373c122 req-5630656d-4e19-497e-9b13-7bf1b4823a9d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:51.298273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-885c4939-c791-4d09-948e-04d94373c122 req-5630656d-4e19-497e-9b13-7bf1b4823a9d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:51.310228 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-885c4939-c791-4d09-948e-04d94373c122 req-5630656d-4e19-497e-9b13-7bf1b4823a9d service nova] Creating event network-vif-plugged:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:47:51.315993 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-885c4939-c791-4d09-948e-04d94373c122 req-5630656d-4e19-497e-9b13-7bf1b4823a9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029855 Apr 02 21:47:51.316320 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3731/7165] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:47:51.433927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:51.434552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:51.441689 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:51.442145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:51.442927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:51.443370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:51.579723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:51.587775 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-91f3b1fd-5f65-4319-95ec-08b9fae87a15 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.157762 Apr 02 21:47:51.588341 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3435/7166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:51 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:52.606330 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:52.607060 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:52.614237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:52.614708 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:52.615515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:52.615976 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:52.757729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:52.765392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-631b1a2f-01ae-4fe8-9585-73b97b872927 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1358 microversion: 2.1 time: 0.164921 Apr 02 21:47:52.765981 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3732/7167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:52 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:53.782407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:53.782984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:53.789166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:53.789624 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:53.790402 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:53.791103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:53.922625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:53.930569 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-13753cd7-ea29-4bde-827d-b1e25964b41a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1547 microversion: 2.1 time: 0.152319 Apr 02 21:47:53.931151 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3436/7168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:53 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:53.947211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:53.947867 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:53.954649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:53.955183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:53.955964 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:53.956428 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:54.087704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:54.095285 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-00283344-73e1-4b0d-a3ea-41e2dcbd41a6 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1547 microversion: 2.1 time: 0.151994 Apr 02 21:47:54.096379 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3733/7169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:53 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:54.111391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:54.115287 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:54.116076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Searching by: {'deleted': False, 'project_id': 'fd583fa9f14e418e850937a746252b93'} {{(pid=136517) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 02 21:47:54.121370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:54.121838 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:54.122678 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:54.123122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:54.148143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.multi_cell_list [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136517) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 02 21:47:54.174166 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c043247-e05c-4b10-8a12-5293d6cec95e tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066658 Apr 02 21:47:54.174757 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3437/7170] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Apr 2 21:47:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:47:54.185246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:54.185881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:54.192423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:54.192937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:54.193732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:54.194224 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:54.328198 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:54.336289 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-449f5c91-29a7-4e26-8345-6fa8232b9e87 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1547 microversion: 2.1 time: 0.155069 Apr 02 21:47:54.336914 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3734/7171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:54 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:47:55.838967 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdf91a12-e487-47a4-9291-8de27fb20027"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:47:55.840088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:55.847509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:55.848002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:55.848813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:55.849262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:56.083656 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-56e90d89-a14a-46a3-9e9c-901dde6d40dc tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248572 Apr 02 21:47:56.084300 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3438/7172] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Apr 2 21:47:55 2022] POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:47:59.397716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:47:59.398354 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:47:59.405205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:59.405680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:59.406470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:47:59.406927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:47:59.545535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:47:59.553471 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a8ebe4db-0d2e-4817-83f9-2bbf99d6adcb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1593 microversion: 2.1 time: 0.159752 Apr 02 21:47:59.554076 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3735/7173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:47:59 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1593 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:01.205129 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-57dd1485-d87f-4869-a517-3d567ada0089 req-3d5bc102-00e0-4e36-8b72-a0b6f976d442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:48:01.213672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-57dd1485-d87f-4869-a517-3d567ada0089 req-3d5bc102-00e0-4e36-8b72-a0b6f976d442 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:01.214185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-57dd1485-d87f-4869-a517-3d567ada0089 req-3d5bc102-00e0-4e36-8b72-a0b6f976d442 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:01.225786 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-57dd1485-d87f-4869-a517-3d567ada0089 req-3d5bc102-00e0-4e36-8b72-a0b6f976d442 service nova] Creating event network-changed:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:48:01.230738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-57dd1485-d87f-4869-a517-3d567ada0089 req-3d5bc102-00e0-4e36-8b72-a0b6f976d442 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030580 Apr 02 21:48:01.232153 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3439/7174] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:48:02.219532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1062763109"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:48:02.220356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:02.227550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:02.228320 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:02.229161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:02.229613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:02.370397 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.network.security_group_api [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Adding security group 9e550104-19ef-4d20-80f5-221dc2809f8a to port 8f6745e6-f304-407d-af8a-8602eed4e726 Apr 02 21:48:02.723216 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19463b19-be40-4723-8fcd-94c41ee98119 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/action" status: 202 len: 0 microversion: 2.1 time: 0.507578 Apr 02 21:48:02.725446 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3736/7175] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:48:02 2022] POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:48:02.734820 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:02.736883 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:02.744714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:02.746037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:02.747241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:02.747962 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:02.920642 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:02.929632 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3a7c0676-dcdc-4d78-8f0c-2f04441e6ea7 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1757 microversion: 2.1 time: 0.200025 Apr 02 21:48:02.930571 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3440/7176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:02 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:03.247373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-fabf082c-e837-49ff-b04b-b4fd09e85d3a req-2cd6734a-577d-4141-b7b7-b4d3ca04577e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:48:03.256154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fabf082c-e837-49ff-b04b-b4fd09e85d3a req-2cd6734a-577d-4141-b7b7-b4d3ca04577e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:03.256726 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-fabf082c-e837-49ff-b04b-b4fd09e85d3a req-2cd6734a-577d-4141-b7b7-b4d3ca04577e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:03.268426 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-fabf082c-e837-49ff-b04b-b4fd09e85d3a req-2cd6734a-577d-4141-b7b7-b4d3ca04577e service nova] Creating event network-changed:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:48:03.273810 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-fabf082c-e837-49ff-b04b-b4fd09e85d3a req-2cd6734a-577d-4141-b7b7-b4d3ca04577e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031055 Apr 02 21:48:03.274423 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3737/7177] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:48:28.589923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:48:28.590927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:28.597733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:28.598195 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:28.598966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:28.599412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:28.671189 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4bf72686-9a24-4002-acea-279d9a876dd3 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/action" status: 202 len: 0 microversion: 2.1 time: 0.085033 Apr 02 21:48:28.671836 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3441/7178] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:48:28 2022] POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:48:28.683374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:28.684219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:28.691900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:28.692408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:28.693253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:28.693733 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:28.843614 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:28.852218 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0bc5bd0c-cf28-456b-93d6-a9c4924da746 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1749 microversion: 2.1 time: 0.174515 Apr 02 21:48:28.852830 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3738/7179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:28 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:29.872141 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:29.872829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:29.879743 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:29.880144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:29.880955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:29.881403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:30.029975 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:30.038510 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-991236ed-0047-4c28-8df8-4384e675855f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.172189 Apr 02 21:48:30.039081 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3442/7180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:29 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:31.056393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:31.057053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:31.063844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:31.064315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:31.065138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:31.065603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:31.526188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:31.534166 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-69986a33-ed74-4bfa-8199-b8c74afc3eeb tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.481719 Apr 02 21:48:31.534743 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3739/7181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:31 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:32.551748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:32.552433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:32.559742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:32.560367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:32.561183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:32.561629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:32.708996 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:32.716932 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bf544a6-2a2e-439b-bf62-71d33e2eb878 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.169209 Apr 02 21:48:32.717569 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3443/7182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:32 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:33.734418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:33.734985 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:33.742348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:33.742814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:33.743591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:33.744041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:33.886932 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:33.894997 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0d4274f8-8361-4a60-9d8c-dfceccbf0554 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.164672 Apr 02 21:48:33.895569 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3740/7183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:33 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:34.912685 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:34.913304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:34.920435 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:34.920920 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:34.921682 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:34.922120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:35.065923 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:35.073912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-35e9889f-d535-4b56-85d8-d51893719d61 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.165186 Apr 02 21:48:35.074484 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3444/7184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:34 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:36.091149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:36.091745 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:36.099266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:36.099734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:36.100553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:36.101009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:36.246764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:36.255400 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-57717d4e-42d1-4d66-8dff-645043b9577f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.168224 Apr 02 21:48:36.255975 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3741/7185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:36 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:37.273110 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:37.273708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:37.280607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:37.281065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:37.281856 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:37.282299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:37.425022 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:37.432961 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cf02236a-6627-492e-8634-7b0b292f0b35 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.163713 Apr 02 21:48:37.433539 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3445/7186] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:37 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:38.451418 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:38.452111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:38.461306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:38.461773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:38.462594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:38.463051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:38.718414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:38.726454 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05d25cf5-5eb1-4d0c-a0e0-1a33ffeae66c tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.279195 Apr 02 21:48:38.727027 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3742/7187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:38 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:39.743181 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:39.743740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:39.750621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:39.751091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:39.751871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:39.752322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:39.898912 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:39.906778 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-721f8298-5f1a-4bb9-8e4c-b71514d152a2 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1754 microversion: 2.1 time: 0.167548 Apr 02 21:48:39.907386 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3446/7188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:39 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:48:40.925564 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:48:40.926228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:48:40.933152 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:40.933650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:40.934461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:48:40.934912 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:48:41.079106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:48:41.087157 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bb19f26d-9719-47d7-8477-52ede03b0f90 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1757 microversion: 2.1 time: 0.166283 Apr 02 21:48:41.087731 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3743/7189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:48:40 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:13.673251 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1062763109"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:13.673864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:13.680751 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:13.681202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:13.681985 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:13.682432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:13.869498 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.network.security_group_api [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Removing security group 9e550104-19ef-4d20-80f5-221dc2809f8a from port 8f6745e6-f304-407d-af8a-8602eed4e726 Apr 02 21:49:14.203966 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-971c45e1-f5b4-4108-9604-e280abdb0466 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/action" status: 202 len: 0 microversion: 2.1 time: 0.534726 Apr 02 21:49:14.214878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-28a58d28-bf33-4a01-828d-a5128897c55e req-4f8ff7bd-0fdf-4db0-bb1e-9b1bd6db0311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:14.219785 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3447/7190] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:49:13 2022] POST /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:49:14.224042 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-28a58d28-bf33-4a01-828d-a5128897c55e req-4f8ff7bd-0fdf-4db0-bb1e-9b1bd6db0311 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:14.224550 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-28a58d28-bf33-4a01-828d-a5128897c55e req-4f8ff7bd-0fdf-4db0-bb1e-9b1bd6db0311 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:14.243131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-28a58d28-bf33-4a01-828d-a5128897c55e req-4f8ff7bd-0fdf-4db0-bb1e-9b1bd6db0311 service nova] Creating event network-changed:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:49:14.249151 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-28a58d28-bf33-4a01-828d-a5128897c55e req-4f8ff7bd-0fdf-4db0-bb1e-9b1bd6db0311 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041348 Apr 02 21:49:14.250100 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3744/7191] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:49:15.614333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:15.615037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:15.621104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:15.621556 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:15.622328 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:15.622769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:15.704352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lazy-loading 'services' on Instance uuid 5f87a679-3e55-4259-a776-a0cfbf9083f7 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:49:15.780002 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bc0d4b3b-0691-416f-860c-e2f34acf542a tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments/cdf91a12-e487-47a4-9291-8de27fb20027" status: 202 len: 0 microversion: 2.1 time: 0.170935 Apr 02 21:49:15.780812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3448/7192] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:49:15 2022] DELETE /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments/cdf91a12-e487-47a4-9291-8de27fb20027 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:49:15.796672 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:15.797991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:15.805395 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:15.805956 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:15.806788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:15.807251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:15.841847 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2e4daa6a-1ae1-4ec0-a0de-5942d8759353 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051589 Apr 02 21:49:15.842425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3745/7193] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:49:15 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:49:16.264709 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-c02e8837-f3ce-4870-980d-f91206bbf395 req-86ebfa11-7847-4bc4-8f2d-010f46885d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:16.273774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c02e8837-f3ce-4870-980d-f91206bbf395 req-86ebfa11-7847-4bc4-8f2d-010f46885d91 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:16.274236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-c02e8837-f3ce-4870-980d-f91206bbf395 req-86ebfa11-7847-4bc4-8f2d-010f46885d91 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:16.285134 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-c02e8837-f3ce-4870-980d-f91206bbf395 req-86ebfa11-7847-4bc4-8f2d-010f46885d91 service nova] Creating event network-changed:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:49:16.290542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-c02e8837-f3ce-4870-980d-f91206bbf395 req-86ebfa11-7847-4bc4-8f2d-010f46885d91 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029909 Apr 02 21:49:16.291198 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3449/7194] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:49:16.854333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:16.855287 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:16.863168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:16.863687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:16.865053 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:16.865515 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:16.893717 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-52ca37f3-f251-4ca0-8965-f14fd8e5d376 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043628 Apr 02 21:49:16.894282 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3746/7195] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Apr 2 21:49:16 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 02 21:49:16.906248 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:16.906846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:16.913098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:16.913553 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:16.914607 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:16.915033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:16.988411 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] HTTP exception thrown: Instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 is not attached to volume cdf91a12-e487-47a4-9291-8de27fb20027 Apr 02 21:49:16.989083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Returning 404 to user: Instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 is not attached to volume cdf91a12-e487-47a4-9291-8de27fb20027 {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:49:16.989942 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-af1fe7f1-be26-405d-a841-a78dc13764b1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments/cdf91a12-e487-47a4-9291-8de27fb20027" status: 404 len: 154 microversion: 2.1 time: 0.089109 Apr 02 21:49:16.990501 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3450/7196] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Apr 2 21:49:16 2022] DELETE /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7/os-volume_attachments/cdf91a12-e487-47a4-9291-8de27fb20027 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:49:18.125538 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:18.126058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:18.133852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:18.134326 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:18.135109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:18.135568 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:18.159982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:49:18.231828 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9490a34a-138b-4374-9e8a-f731a7912690 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 204 len: 0 microversion: 2.1 time: 0.109965 Apr 02 21:49:18.235578 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3747/7197] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:49:18 2022] DELETE /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:49:18.240560 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:18.241186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:18.247945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:18.248405 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:18.249211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:18.249654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:18.389062 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:18.397109 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bb58d384-9ebe-4ec2-9fea-42d2ec0b297d tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1553 microversion: 2.1 time: 0.160521 Apr 02 21:49:18.397678 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3451/7198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:18 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:19.415948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:19.416720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:19.423527 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:19.424002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:19.424820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:19.425277 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:19.561826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:19.570099 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-30fa32ed-b8b0-498b-bc8b-434cf4f2efec tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1553 microversion: 2.1 time: 0.158749 Apr 02 21:49:19.570690 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3748/7199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:19 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:20.588107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:20.588699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:20.595500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:20.595954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:20.596781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:20.597225 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:20.673721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724e735d54f244ab9c2fef0c55a185bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd583fa9f14e418e850937a746252b93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:20.681377 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7ad20a30-d18c-4dcd-a7f0-5c83d48b703f tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 200 len: 1511 microversion: 2.1 time: 0.097381 Apr 02 21:49:20.681996 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3452/7200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:20 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:20.720851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-a7364700-8cfb-42b8-9b1a-dbd76315eb1b req-a3b54aa5-30c5-4183-a66c-c374b2b9e8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f87a679-3e55-4259-a776-a0cfbf9083f7", "name": "network-vif-deleted", "tag": "8f6745e6-f304-407d-af8a-8602eed4e726"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:20.732370 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a7364700-8cfb-42b8-9b1a-dbd76315eb1b req-a3b54aa5-30c5-4183-a66c-c374b2b9e8a4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:20.733150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-a7364700-8cfb-42b8-9b1a-dbd76315eb1b req-a3b54aa5-30c5-4183-a66c-c374b2b9e8a4 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:20.745929 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-a7364700-8cfb-42b8-9b1a-dbd76315eb1b req-a3b54aa5-30c5-4183-a66c-c374b2b9e8a4 service nova] Creating event network-vif-deleted:8f6745e6-f304-407d-af8a-8602eed4e726 for instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 on nch2-master-1 Apr 02 21:49:20.751667 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-a7364700-8cfb-42b8-9b1a-dbd76315eb1b req-a3b54aa5-30c5-4183-a66c-c374b2b9e8a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035372 Apr 02 21:49:20.752268 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3749/7201] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:49:21.698445 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:21.699070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] [instance: 5f87a679-3e55-4259-a776-a0cfbf9083f7] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:21.705995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:21.706410 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:21.707695 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:21.708140 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:21.721232 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] HTTP exception thrown: Instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 could not be found. Apr 02 21:49:21.721823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Returning 404 to user: Instance 5f87a679-3e55-4259-a776-a0cfbf9083f7 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:49:21.723324 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0cf51bf1-7e98-4269-814f-469acdbe0eb1 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7" status: 404 len: 111 microversion: 2.1 time: 0.028187 Apr 02 21:49:21.723867 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3453/7202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:21 2022] GET /compute/v2.1/servers/5f87a679-3e55-4259-a776-a0cfbf9083f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:49:21.732641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9d0890c6-2ae5-490d-a07b-d924bcac7150 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] Calling method '.version_select at 0x7f54c7d53f70>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:21.750188 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9d0890c6-2ae5-490d-a07b-d924bcac7150 tempest-TestMinimumBasicScenario-546088523 tempest-TestMinimumBasicScenario-546088523-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777885352" status: 202 len: 0 microversion: 2.1 time: 0.021687 Apr 02 21:49:21.750760 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3750/7203] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Apr 2 21:49:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777885352 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:49:30.680182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d340c89d-e5e0-4905-a744-a19c6ef0ea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: .version_select at 0x7f54d4bc3dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-711119392"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:30.694020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d340c89d-e5e0-4905-a744-a19c6ef0ea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:49:30.699122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d340c89d-e5e0-4905-a744-a19c6ef0ea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:49:31.052387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d340c89d-e5e0-4905-a744-a19c6ef0ea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:49:31.057438 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-d340c89d-e5e0-4905-a744-a19c6ef0ea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:49:31.073710 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d340c89d-e5e0-4905-a744-a19c6ef0ea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.555737 Apr 02 21:49:31.074308 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3454/7204] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:49:30 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:36.864120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-697333350", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "8a6c5791-bb35-4cef-a8b6-c027db65c57f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-711119392", "security_groups": [{"name": "tempest-secgroup-smoke-1110928852"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:37.029929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] validate_networks() for [('8a6c5791-bb35-4cef-a8b6-c027db65c57f', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:49:37.464369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:49:37.465387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:49:37.466548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:49:37.466905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:49:37.467654 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:49:37.479122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:37.479625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:37.484388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:37.485248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:37.505387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:49:37.510796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:49:37.524750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:49:37.527196 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:49:37.576557 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2670cfbb-aa93-4833-9eb9-91fc84b30a34 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717792 Apr 02 21:49:37.580624 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3751/7205] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:49:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:49:37.588006 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e43549c1-c59f-4a3d-b14d-912a366f4ab1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:37.588659 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e43549c1-c59f-4a3d-b14d-912a366f4ab1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:37.745210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e43549c1-c59f-4a3d-b14d-912a366f4ab1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:37.757051 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e43549c1-c59f-4a3d-b14d-912a366f4ab1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1265 microversion: 2.1 time: 0.172760 Apr 02 21:49:37.767245 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3455/7206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:37 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:38.779173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:38.780246 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:38.793923 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:38.794734 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:38.795727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:38.797241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:38.871670 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:38.879846 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4b22d1ca-c1e1-4db3-a64f-4deb03fc9c89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1325 microversion: 2.1 time: 0.108219 Apr 02 21:49:38.880851 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3752/7207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:38 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1325 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:39.898603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:39.899430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:39.918322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:39.918932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:39.920360 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:39.927537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:40.363603 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:40.371036 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6c3b8440-2095-42ee-b6eb-4d963e1439be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1391 microversion: 2.1 time: 0.477239 Apr 02 21:49:40.371619 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3456/7208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:39 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1391 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:40.685658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-8ceddc91-faa8-40a1-a60b-1ed8f8453b75 req-800499e6-8635-4acb-b18b-1d1c062c34fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b52a73-b76a-474f-968d-4efbd4b3315f", "tag": "45dac72c-1fda-42e8-8941-d44a1cfdbe7b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:40.697772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8ceddc91-faa8-40a1-a60b-1ed8f8453b75 req-800499e6-8635-4acb-b18b-1d1c062c34fd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:40.698561 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-8ceddc91-faa8-40a1-a60b-1ed8f8453b75 req-800499e6-8635-4acb-b18b-1d1c062c34fd service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:40.713486 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-8ceddc91-faa8-40a1-a60b-1ed8f8453b75 req-800499e6-8635-4acb-b18b-1d1c062c34fd service nova] Creating event network-changed:45dac72c-1fda-42e8-8941-d44a1cfdbe7b for instance 91b52a73-b76a-474f-968d-4efbd4b3315f on nch2-master-1 Apr 02 21:49:40.725886 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-8ceddc91-faa8-40a1-a60b-1ed8f8453b75 req-800499e6-8635-4acb-b18b-1d1c062c34fd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043760 Apr 02 21:49:40.726605 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3753/7209] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:49:41.387193 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:41.387954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:41.395202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:41.395668 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:41.396443 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:41.396915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:41.617108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:41.624622 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c59f2f3-763b-482d-bd4b-205031a133f8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1391 microversion: 2.1 time: 0.241349 Apr 02 21:49:41.625198 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3457/7210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:41 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:42.644829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:42.645572 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:42.652074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:42.652580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:42.653369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:42.653829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:42.887487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:42.895380 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-10fa8a1e-b2d2-46a8-abb1-b903bcb85808 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1391 microversion: 2.1 time: 0.257124 Apr 02 21:49:42.895957 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3754/7211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:42 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:43.912711 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:43.913322 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:43.920871 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:43.921334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:43.922270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:43.922679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:44.070259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:44.077893 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4b87b6c-4eca-4ae3-9afd-394be8162603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1391 microversion: 2.1 time: 0.169629 Apr 02 21:49:44.078526 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3458/7212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:43 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:45.094868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:45.095501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:45.102445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:45.102920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:45.103710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:45.104171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:45.241691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:45.249133 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-99f58ba6-e3be-437c-a8eb-71b2fb343701 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1391 microversion: 2.1 time: 0.158271 Apr 02 21:49:45.249713 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3755/7213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:45 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:45.841796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5b31703e-a6a1-4eee-a423-378672d7c050 req-991ef1d8-25eb-401a-94b6-0ed34482254c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b52a73-b76a-474f-968d-4efbd4b3315f", "name": "network-vif-plugged", "status": "completed", "tag": "45dac72c-1fda-42e8-8941-d44a1cfdbe7b"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:45.852640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5b31703e-a6a1-4eee-a423-378672d7c050 req-991ef1d8-25eb-401a-94b6-0ed34482254c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:45.853123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5b31703e-a6a1-4eee-a423-378672d7c050 req-991ef1d8-25eb-401a-94b6-0ed34482254c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:45.864791 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5b31703e-a6a1-4eee-a423-378672d7c050 req-991ef1d8-25eb-401a-94b6-0ed34482254c service nova] Creating event network-vif-plugged:45dac72c-1fda-42e8-8941-d44a1cfdbe7b for instance 91b52a73-b76a-474f-968d-4efbd4b3315f on nch2-master-1 Apr 02 21:49:45.869886 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5b31703e-a6a1-4eee-a423-378672d7c050 req-991ef1d8-25eb-401a-94b6-0ed34482254c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034453 Apr 02 21:49:45.870691 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3459/7214] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:49:46.266804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:46.267389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:46.275236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:46.275710 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:46.276641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:46.277104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:46.411944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:46.419497 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2033a60e-f1d5-419f-a4a1-945cccf99b51 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1391 microversion: 2.1 time: 0.156758 Apr 02 21:49:46.420071 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3756/7215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:46 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:47.437679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:47.438441 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:47.445043 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:47.445500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:47.446310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:47.446754 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:47.582174 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:47.589698 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a14b9225-1622-4b57-8740-bc12b9031b5f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1562 microversion: 2.1 time: 0.157169 Apr 02 21:49:47.590269 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3460/7216] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:47 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:47.605676 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:47.606302 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:47.613052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:47.613517 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:47.614300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:47.614753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:47.752622 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:47.760518 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-89621f47-21a4-4ee0-adb1-b1fdc2ba5c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1562 microversion: 2.1 time: 0.158607 Apr 02 21:49:47.761287 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3757/7217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:47 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:49.368028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:49:49.368692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:49:49.375629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:49.376088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:49.376901 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:49.377540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:49.465599 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c3d4cac9-0fab-4dbb-9c2e-251a33e1ff1c req-486d30a3-3453-45c9-be1e-5b9741d0e5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b52a73-b76a-474f-968d-4efbd4b3315f", "tag": "45dac72c-1fda-42e8-8941-d44a1cfdbe7b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:49:49.475219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c3d4cac9-0fab-4dbb-9c2e-251a33e1ff1c req-486d30a3-3453-45c9-be1e-5b9741d0e5af service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:49:49.475687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c3d4cac9-0fab-4dbb-9c2e-251a33e1ff1c req-486d30a3-3453-45c9-be1e-5b9741d0e5af service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:49:49.490751 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c3d4cac9-0fab-4dbb-9c2e-251a33e1ff1c req-486d30a3-3453-45c9-be1e-5b9741d0e5af service nova] Creating event network-changed:45dac72c-1fda-42e8-8941-d44a1cfdbe7b for instance 91b52a73-b76a-474f-968d-4efbd4b3315f on nch2-master-1 Apr 02 21:49:49.496198 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c3d4cac9-0fab-4dbb-9c2e-251a33e1ff1c req-486d30a3-3453-45c9-be1e-5b9741d0e5af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092575 Apr 02 21:49:49.496880 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3758/7218] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:49:49.566647 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:49:49.576674 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cbe20142-7e57-4d26-a1a8-e3caf83ec809 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1562 microversion: 2.1 time: 0.214177 Apr 02 21:49:49.577271 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3461/7219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:49:49 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:49:54.222293 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:49:54.222995 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:50:14.886374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:14.887404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:14.893724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:14.894200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:14.894987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:14.895446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:14.957219 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d37483a4-bda6-4783-929a-752474068f44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action" status: 200 len: 24574 microversion: 2.1 time: 0.076039 Apr 02 21:50:14.957856 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3759/7220] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:50:14 2022] POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:50:26.049012 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:26.049605 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:26.057470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:26.057932 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:26.058712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:26.059173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:26.124234 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9b93ef54-8492-4eac-8974-293cea04fe77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action" status: 202 len: 0 microversion: 2.1 time: 0.079277 Apr 02 21:50:26.124921 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3462/7221] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:50:26 2022] POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:50:26.134882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:26.135584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:26.143608 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:26.144231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:26.145511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:26.145997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:26.288823 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:26.296891 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-95027c75-b975-41ee-ae33-103fa8f97c88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1686 microversion: 2.1 time: 0.166889 Apr 02 21:50:26.297465 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3760/7222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:26 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:27.316828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:27.317543 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:27.323764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:27.324219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:27.325015 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:27.325458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:27.459505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:27.466991 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9353dc89-7d86-48c2-93f9-76057b6fe959 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1666 microversion: 2.1 time: 0.155747 Apr 02 21:50:27.467558 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3463/7223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:27 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:28.556837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:28.557795 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:28.565470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:28.565939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:28.566732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:28.567189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:28.634906 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72f71455-d360-4108-b230-a5e0ba40e54f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action" status: 200 len: 32649 microversion: 2.1 time: 0.083015 Apr 02 21:50:28.641428 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3761/7224] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:50:28 2022] POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action => generated 32649 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:50:28.646854 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:28.647498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:28.654626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:28.655083 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:28.655863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:28.656305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:28.724904 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-08c1c5a9-79b0-4c70-9148-1eb15181768a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action" status: 202 len: 0 microversion: 2.1 time: 0.081252 Apr 02 21:50:28.725459 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3464/7225] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:50:28 2022] POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:50:28.734262 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:28.735018 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:28.742447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:28.742920 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:28.743720 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:28.744212 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:28.884891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:28.893560 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5667ffb3-91ef-48d8-bf12-7cbdab73171c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1673 microversion: 2.1 time: 0.162803 Apr 02 21:50:28.894606 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3762/7226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:28 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:29.913566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:29.914211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:29.920442 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:29.920936 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:29.921701 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:29.922145 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:30.387182 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:30.394637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-db0713f2-2790-4f1f-bdd0-46bf852647d1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1681 microversion: 2.1 time: 0.487121 Apr 02 21:50:30.395210 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3465/7227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:29 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:30.486034 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:30.487001 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:30.495324 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:30.495806 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:30.496694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:30.497164 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:30.551265 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-373d4ef4-e628-4078-8ee9-38228c6e7334 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action" status: 200 len: 38435 microversion: 2.1 time: 0.069017 Apr 02 21:50:30.552549 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3763/7228] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:50:30 2022] POST /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f/action => generated 38435 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:50:31.581040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:31.581558 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:31.584868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b051c8c2-36f0-4265-b383-585623095ffc req-cda50d77-6b69-4de1-bc41-319160ce64c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b52a73-b76a-474f-968d-4efbd4b3315f", "tag": "45dac72c-1fda-42e8-8941-d44a1cfdbe7b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:31.588738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:31.589210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:31.590010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:31.590465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:31.595211 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b051c8c2-36f0-4265-b383-585623095ffc req-cda50d77-6b69-4de1-bc41-319160ce64c8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:31.595680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b051c8c2-36f0-4265-b383-585623095ffc req-cda50d77-6b69-4de1-bc41-319160ce64c8 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:31.607565 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b051c8c2-36f0-4265-b383-585623095ffc req-cda50d77-6b69-4de1-bc41-319160ce64c8 service nova] Creating event network-changed:45dac72c-1fda-42e8-8941-d44a1cfdbe7b for instance 91b52a73-b76a-474f-968d-4efbd4b3315f on nch2-master-1 Apr 02 21:50:31.612708 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b051c8c2-36f0-4265-b383-585623095ffc req-cda50d77-6b69-4de1-bc41-319160ce64c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032844 Apr 02 21:50:31.613734 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3764/7229] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:50:31.618082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:50:31.710444 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-eb62b993-909a-4628-be99-cde23a1fce70 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 204 len: 0 microversion: 2.1 time: 0.133009 Apr 02 21:50:31.711483 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3466/7230] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:50:31 2022] DELETE /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:50:31.731066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:31.731939 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:31.745048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:31.745560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:31.746368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:31.746827 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:31.909439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:31.917526 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6e57b201-e779-4e8b-bfc2-b47fb8baea77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1687 microversion: 2.1 time: 0.195263 Apr 02 21:50:31.918331 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3765/7231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:31 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:50:32.935863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:32.936507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:32.943241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:32.943698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:32.944481 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:32.944930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:33.079282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:33.086714 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b3a7987e-279c-4828-8464-a85996dae941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1568 microversion: 2.1 time: 0.155276 Apr 02 21:50:33.087290 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3467/7232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:32 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:34.005808 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-b445f9c0-922b-4736-a372-389511f478e7 req-bb876007-08e7-4831-81f1-673b51b97922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b52a73-b76a-474f-968d-4efbd4b3315f", "name": "network-vif-deleted", "tag": "45dac72c-1fda-42e8-8941-d44a1cfdbe7b"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:34.015982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b445f9c0-922b-4736-a372-389511f478e7 req-bb876007-08e7-4831-81f1-673b51b97922 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:34.016389 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-b445f9c0-922b-4736-a372-389511f478e7 req-bb876007-08e7-4831-81f1-673b51b97922 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:34.028489 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-b445f9c0-922b-4736-a372-389511f478e7 req-bb876007-08e7-4831-81f1-673b51b97922 service nova] Creating event network-vif-deleted:45dac72c-1fda-42e8-8941-d44a1cfdbe7b for instance 91b52a73-b76a-474f-968d-4efbd4b3315f on nch2-master-1 Apr 02 21:50:34.033734 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-b445f9c0-922b-4736-a372-389511f478e7 req-bb876007-08e7-4831-81f1-673b51b97922 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Apr 02 21:50:34.034410 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3766/7233] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:50:34.110511 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:34.111234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:34.118586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:34.119046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:34.119828 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:34.120268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:34.153013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:34.153467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:34.153917 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lazy-loading 'fault' on Instance uuid 91b52a73-b76a-474f-968d-4efbd4b3315f {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:50:34.195078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:34.202506 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89936178-afeb-4ffb-8ab4-10c49a98d9b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 200 len: 1355 microversion: 2.1 time: 0.102426 Apr 02 21:50:34.203081 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3468/7234] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:34 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:35.221061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:35.221792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 91b52a73-b76a-474f-968d-4efbd4b3315f] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:35.228918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:35.229398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:35.230190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:35.230656 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:35.244668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] HTTP exception thrown: Instance 91b52a73-b76a-474f-968d-4efbd4b3315f could not be found. Apr 02 21:50:35.245308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Returning 404 to user: Instance 91b52a73-b76a-474f-968d-4efbd4b3315f could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:50:35.246152 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-940db34f-1802-423c-b1af-85c1c7c766bc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f" status: 404 len: 111 microversion: 2.1 time: 0.029513 Apr 02 21:50:35.246687 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3767/7235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:35 2022] GET /compute/v2.1/servers/91b52a73-b76a-474f-968d-4efbd4b3315f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:50:38.585837 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6476f1d9-16ce-487a-98d3-8bf7c5be2c48 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '.version_select at 0x7f54d41b5160>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:38.605813 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6476f1d9-16ce-487a-98d3-8bf7c5be2c48 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-711119392" status: 202 len: 0 microversion: 2.1 time: 0.024400 Apr 02 21:50:38.606410 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3469/7236] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 21:50:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-711119392 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:50:38.633451 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5bdbed8d-178f-4658-be8b-1ef07d7555e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: .version_select at 0x7f54c7d22040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2041732824"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:38.649959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5bdbed8d-178f-4658-be8b-1ef07d7555e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:50:38.655849 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5bdbed8d-178f-4658-be8b-1ef07d7555e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:50:38.770911 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5bdbed8d-178f-4658-be8b-1ef07d7555e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:50:38.775995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5bdbed8d-178f-4658-be8b-1ef07d7555e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:50:38.791282 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5bdbed8d-178f-4658-be8b-1ef07d7555e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.162684 Apr 02 21:50:38.791892 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3768/7237] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:50:38 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:50:44.265989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-287630381", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "9a9cea6e-d982-45b7-b812-d39bbaaf350e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2041732824", "security_groups": [{"name": "tempest-secgroup-smoke-1231388518"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:44.391777 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] validate_networks() for [('9a9cea6e-d982-45b7-b812-d39bbaaf350e', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:50:44.905964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:50:44.906428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:50:44.907056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:50:44.907606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:50:44.908033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:50:44.917281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:44.917737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:44.918552 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:44.918999 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:44.937254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:50:44.943285 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:50:44.956002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:50:44.958426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:50:45.008243 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-67049bac-bd65-457e-986b-e3ef8efec903 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.747117 Apr 02 21:50:45.013974 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3470/7238] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:50:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:50:45.020972 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4193f08b-4649-47c1-b9e3-5fb3444defe1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:45.021860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4193f08b-4649-47c1-b9e3-5fb3444defe1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:45.079814 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4193f08b-4649-47c1-b9e3-5fb3444defe1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:45.087357 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4193f08b-4649-47c1-b9e3-5fb3444defe1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1266 microversion: 2.1 time: 0.071923 Apr 02 21:50:45.088379 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3769/7239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:45 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:46.108156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:46.109992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:46.123984 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:46.124422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:46.125733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:46.126863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:46.222249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:46.230604 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e4cb467d-96ea-4b0e-bf92-1d7a0a44859f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1336 microversion: 2.1 time: 0.129564 Apr 02 21:50:46.232087 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3471/7240] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:46 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1336 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:47.252399 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:47.253600 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:47.262860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:47.263337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:47.264209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:47.264809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:47.434607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:47.448611 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6bc60a8b-6e55-4a13-b3f8-f8132c8a9f5a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1392 microversion: 2.1 time: 0.202546 Apr 02 21:50:47.458050 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3770/7241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:47 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:47.620104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-0f1e82de-3c58-4f03-afaf-0d475b01edd2 req-b40e1528-37a1-4961-b5c9-0fa9a17a4897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624983ea-5204-49d9-b35f-7ebd43ae492e", "tag": "896fa884-a4f1-4e60-9ad3-7779492535c3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:47.648626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f1e82de-3c58-4f03-afaf-0d475b01edd2 req-b40e1528-37a1-4961-b5c9-0fa9a17a4897 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:47.650308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-0f1e82de-3c58-4f03-afaf-0d475b01edd2 req-b40e1528-37a1-4961-b5c9-0fa9a17a4897 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:47.673641 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-0f1e82de-3c58-4f03-afaf-0d475b01edd2 req-b40e1528-37a1-4961-b5c9-0fa9a17a4897 service nova] Creating event network-changed:896fa884-a4f1-4e60-9ad3-7779492535c3 for instance 624983ea-5204-49d9-b35f-7ebd43ae492e on nch2-master-1 Apr 02 21:50:47.681415 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-0f1e82de-3c58-4f03-afaf-0d475b01edd2 req-b40e1528-37a1-4961-b5c9-0fa9a17a4897 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064719 Apr 02 21:50:47.684259 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3472/7242] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:50:48.471694 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:48.472269 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:48.481903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:48.482384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:48.483197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:48.483662 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:48.635065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:48.642523 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-72a8caea-748d-46fa-bef6-ae9e90e26bb0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1392 microversion: 2.1 time: 0.174964 Apr 02 21:50:48.643711 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3771/7243] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:48 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:49.661082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:49.661798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:49.668355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:49.668865 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:49.669648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:49.670098 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:49.805137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:49.812662 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-941a4492-4c16-45fd-88a6-8defc5b964dd tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1392 microversion: 2.1 time: 0.156818 Apr 02 21:50:49.813246 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3473/7244] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:49 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:50.829913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:50.830486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:50.838012 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:50.838465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:50.839248 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:50.839702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:50.976219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:50.983691 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6d96b8f8-7e69-461e-8c00-12c93a5f8b2a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1392 microversion: 2.1 time: 0.157816 Apr 02 21:50:50.984264 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3772/7245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:50 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:52.000568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:52.001219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:52.008485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:52.009007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:52.009803 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:52.010249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:52.143455 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:52.152960 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-07a0dc7d-a352-437b-b3d6-1104e5a88b1c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1392 microversion: 2.1 time: 0.156215 Apr 02 21:50:52.153923 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3474/7246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:51 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:52.319905 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-28591a3c-e159-40ef-bbce-45f63120c184 req-2181a7ee-1c28-408f-89fb-b215bf41ef21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624983ea-5204-49d9-b35f-7ebd43ae492e", "name": "network-vif-plugged", "status": "completed", "tag": "896fa884-a4f1-4e60-9ad3-7779492535c3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:52.328170 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-28591a3c-e159-40ef-bbce-45f63120c184 req-2181a7ee-1c28-408f-89fb-b215bf41ef21 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:52.328647 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-28591a3c-e159-40ef-bbce-45f63120c184 req-2181a7ee-1c28-408f-89fb-b215bf41ef21 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:52.339766 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-28591a3c-e159-40ef-bbce-45f63120c184 req-2181a7ee-1c28-408f-89fb-b215bf41ef21 service nova] Creating event network-vif-plugged:896fa884-a4f1-4e60-9ad3-7779492535c3 for instance 624983ea-5204-49d9-b35f-7ebd43ae492e on nch2-master-1 Apr 02 21:50:52.344931 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-28591a3c-e159-40ef-bbce-45f63120c184 req-2181a7ee-1c28-408f-89fb-b215bf41ef21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079660 Apr 02 21:50:52.345498 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3773/7247] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:50:53.172311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:53.173611 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:53.181381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:53.181842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:53.182632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:53.183079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:53.318390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:53.325877 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-59a64897-4da0-489e-bce8-9c2be3a39139 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1392 microversion: 2.1 time: 0.157462 Apr 02 21:50:53.326461 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3475/7248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:53 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:54.343611 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:54.344328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:54.351308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:54.351799 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:54.352578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:54.353033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:54.493171 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:54.500808 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11bb80f2-4610-48f8-9c84-2aaf111f3056 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1564 microversion: 2.1 time: 0.162307 Apr 02 21:50:54.501399 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3774/7249] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:54 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:54.517869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:54.518616 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:54.525396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:54.525853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:54.526643 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:54.527073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:54.664631 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:54.672098 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d4a80e49-cf1d-46b2-a01d-d8d593463ab3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1564 microversion: 2.1 time: 0.158526 Apr 02 21:50:54.672737 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3476/7250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:54 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:50:56.592500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:50:56.593135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:50:56.597201 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-327c7efb-c6e7-4cc9-8d51-1702574623d5 req-aac62362-d374-4832-81f0-a8bee77565e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624983ea-5204-49d9-b35f-7ebd43ae492e", "tag": "896fa884-a4f1-4e60-9ad3-7779492535c3"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:50:56.600628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:56.601099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:56.601895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:56.602394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:56.608227 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-327c7efb-c6e7-4cc9-8d51-1702574623d5 req-aac62362-d374-4832-81f0-a8bee77565e0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:50:56.609164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-327c7efb-c6e7-4cc9-8d51-1702574623d5 req-aac62362-d374-4832-81f0-a8bee77565e0 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:50:56.621535 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-327c7efb-c6e7-4cc9-8d51-1702574623d5 req-aac62362-d374-4832-81f0-a8bee77565e0 service nova] Creating event network-changed:896fa884-a4f1-4e60-9ad3-7779492535c3 for instance 624983ea-5204-49d9-b35f-7ebd43ae492e on nch2-master-1 Apr 02 21:50:56.626888 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-327c7efb-c6e7-4cc9-8d51-1702574623d5 req-aac62362-d374-4832-81f0-a8bee77565e0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034406 Apr 02 21:50:56.627609 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3477/7251] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:50:56.762792 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:50:56.772096 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7f38223d-0313-442e-9223-4e95cb801349 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1564 microversion: 2.1 time: 0.183225 Apr 02 21:50:56.779439 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3775/7252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:50:56 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:20.020823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:51:20.022509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:20.028739 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:20.029199 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:20.029966 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:20.030407 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:20.083467 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-84e510fa-fd60-4542-a513-9492ca7037ca tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e/action" status: 200 len: 24573 microversion: 2.1 time: 0.067600 Apr 02 21:51:20.085025 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3478/7253] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:51:20 2022] POST /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e/action => generated 24573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:51:31.103585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:51:31.104586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:31.110865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:31.111331 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:31.112106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:31.112588 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:31.183328 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61c73917-a1e5-4718-b5db-fdcfaa78411d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e/action" status: 202 len: 0 microversion: 2.1 time: 0.084401 Apr 02 21:51:31.183977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3776/7254] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:51:31 2022] POST /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:51:31.193790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:31.194497 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:31.203390 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:31.203857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:31.205156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:31.205604 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:31.439939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:31.447464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-94d34600-50da-4f79-97eb-a715bb581cf7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1675 microversion: 2.1 time: 0.258941 Apr 02 21:51:31.448041 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3479/7255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:31 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1675 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:32.467403 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:32.468078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:32.474613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:32.475087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:32.475881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:32.477006 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:32.617756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:32.625185 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cdb714e7-81c2-4374-801d-9e974fa0565c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.163169 Apr 02 21:51:32.625759 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3777/7256] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:32 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:33.644366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:33.645032 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:33.653036 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:33.653485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:33.654257 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:33.654699 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:33.787994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:33.795369 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c433b79c-e22f-48d4-bbf7-cf7df2c4194a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.155820 Apr 02 21:51:33.795943 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3480/7257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:33 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:34.812491 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:34.813048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:34.819829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:34.820904 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:34.821687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:34.822144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:34.956373 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:34.964383 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b1bf71f5-b0db-4f1f-bb13-2a3ff1c04bdf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.155923 Apr 02 21:51:34.964990 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3778/7258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:34 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:35.981259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:35.981929 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:35.990939 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:35.991393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:35.992162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:35.992630 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:36.134264 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:36.141818 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-785f4dab-0aee-4f74-9dc4-d251ad69b394 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.164462 Apr 02 21:51:36.142389 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3481/7259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:35 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:37.159535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:37.160228 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:37.167914 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:37.168390 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:37.169208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:37.169669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:37.305333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:37.312740 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1610b862-4463-4c72-b28d-3506fa004bf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.157117 Apr 02 21:51:37.313324 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3779/7260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:37 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:38.330714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:38.331333 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:38.338626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:38.339082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:38.339889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:38.340331 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:38.473850 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:38.482154 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-efa82050-1113-4d8c-af11-446c41bfe26e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.155431 Apr 02 21:51:38.482724 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3482/7261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:38 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:39.499580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:39.500215 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:39.510188 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:39.510663 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:39.511468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:39.511934 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:39.653525 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:39.660937 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b3d8cb6d-a3db-4a47-8d07-58e276e48b19 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.165586 Apr 02 21:51:39.661539 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3780/7262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:39 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:40.678157 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:40.678779 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:40.685581 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:40.686037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:40.686824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:40.687246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:40.824515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:40.831864 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f0d74edb-685c-46ca-9df8-04fae5a0af7c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.157654 Apr 02 21:51:40.832635 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3483/7263] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:40 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:41.849279 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:41.849842 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:41.856126 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:41.856641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:41.857432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:41.857893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:41.990743 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:41.998147 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ddd8a17c-5b8c-4e04-9d15-7737b4ef30f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1680 microversion: 2.1 time: 0.152917 Apr 02 21:51:41.998724 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3781/7264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:41 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:51:43.015590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:51:43.016192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:51:43.023065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:43.023528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:43.024305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:51:43.024787 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:51:43.166636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:51:43.174256 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4b5473f-adb6-456b-8db7-5f6cab0efc01 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1683 microversion: 2.1 time: 0.162571 Apr 02 21:51:43.174853 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3484/7265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:51:43 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:09.375070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:09.376052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:09.382954 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:09.383425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:09.384203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:09.384700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:09.438669 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-43602020-113b-4571-8b9d-4fe41173f240 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e/action" status: 200 len: 69087 microversion: 2.1 time: 0.067438 Apr 02 21:52:09.439667 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3782/7266] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:52:09 2022] POST /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e/action => generated 69087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:52:16.694474 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:16.695136 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:16.698680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d5dcf73d-66cd-4ce2-8689-db1d15e24a05 req-2605e2bd-488f-4463-905a-fdc07b6dba33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "624983ea-5204-49d9-b35f-7ebd43ae492e", "tag": "896fa884-a4f1-4e60-9ad3-7779492535c3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:16.702460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:16.702931 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:16.703722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:16.704187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:16.708056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d5dcf73d-66cd-4ce2-8689-db1d15e24a05 req-2605e2bd-488f-4463-905a-fdc07b6dba33 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:16.708646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d5dcf73d-66cd-4ce2-8689-db1d15e24a05 req-2605e2bd-488f-4463-905a-fdc07b6dba33 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:16.721378 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d5dcf73d-66cd-4ce2-8689-db1d15e24a05 req-2605e2bd-488f-4463-905a-fdc07b6dba33 service nova] Creating event network-changed:896fa884-a4f1-4e60-9ad3-7779492535c3 for instance 624983ea-5204-49d9-b35f-7ebd43ae492e on nch2-master-1 Apr 02 21:52:16.729545 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d5dcf73d-66cd-4ce2-8689-db1d15e24a05 req-2605e2bd-488f-4463-905a-fdc07b6dba33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035726 Apr 02 21:52:16.731308 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:52:16.733613 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3783/7267] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:52:16.816761 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b36fa3e0-fae8-4370-8ba7-5f2b2faaf638 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 204 len: 0 microversion: 2.1 time: 0.126495 Apr 02 21:52:16.820728 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3485/7268] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:52:16 2022] DELETE /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:52:16.828554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:16.829348 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:16.837291 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:16.838635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:16.839449 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:16.839918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:16.996241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:17.004421 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c52d4eb3-2689-413c-9b48-44512edfbbf1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1689 microversion: 2.1 time: 0.182389 Apr 02 21:52:17.005355 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3784/7269] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:16 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:52:18.022918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:18.023623 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:18.031214 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:18.031667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:18.032432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:18.032892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:18.171530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:18.178996 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e24dc91d-3b9f-44cc-a40e-8cec0ef9d925 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1570 microversion: 2.1 time: 0.160464 Apr 02 21:52:18.179572 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3486/7270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:18 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:19.069082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-7370e82b-1a0e-47dd-b40b-eb9c52b7f8f2 req-ff63a9da-41e8-46a2-af10-b8d199644c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "624983ea-5204-49d9-b35f-7ebd43ae492e", "name": "network-vif-deleted", "tag": "896fa884-a4f1-4e60-9ad3-7779492535c3"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:19.079290 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7370e82b-1a0e-47dd-b40b-eb9c52b7f8f2 req-ff63a9da-41e8-46a2-af10-b8d199644c81 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:19.079750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-7370e82b-1a0e-47dd-b40b-eb9c52b7f8f2 req-ff63a9da-41e8-46a2-af10-b8d199644c81 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:19.092639 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-7370e82b-1a0e-47dd-b40b-eb9c52b7f8f2 req-ff63a9da-41e8-46a2-af10-b8d199644c81 service nova] Creating event network-vif-deleted:896fa884-a4f1-4e60-9ad3-7779492535c3 for instance 624983ea-5204-49d9-b35f-7ebd43ae492e on nch2-master-1 Apr 02 21:52:19.098194 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-7370e82b-1a0e-47dd-b40b-eb9c52b7f8f2 req-ff63a9da-41e8-46a2-af10-b8d199644c81 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032863 Apr 02 21:52:19.098798 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3785/7271] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:52:19.197307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:19.197918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:19.204774 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:19.205271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:19.206078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:19.206525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:19.236586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:19.236976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:19.237434 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lazy-loading 'fault' on Instance uuid 624983ea-5204-49d9-b35f-7ebd43ae492e {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:52:19.276884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:19.284242 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-36ddd02a-94ff-470b-9203-f0bda2fde9a2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 200 len: 1356 microversion: 2.1 time: 0.091378 Apr 02 21:52:19.284795 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3487/7272] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:19 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 1356 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:20.302137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:20.302893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 624983ea-5204-49d9-b35f-7ebd43ae492e] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:20.310425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:20.310901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:20.311690 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:20.312147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:20.325905 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] HTTP exception thrown: Instance 624983ea-5204-49d9-b35f-7ebd43ae492e could not be found. Apr 02 21:52:20.326507 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Returning 404 to user: Instance 624983ea-5204-49d9-b35f-7ebd43ae492e could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:52:20.327379 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5c1718ec-b122-4f51-8bd4-f7cdd3024caa tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e" status: 404 len: 111 microversion: 2.1 time: 0.029560 Apr 02 21:52:20.327923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3786/7273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:20 2022] GET /compute/v2.1/servers/624983ea-5204-49d9-b35f-7ebd43ae492e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:52:23.685271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b858fe1c-3fc6-41de-a2dc-3378797c3c73 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '.version_select at 0x7f54d4d7c8b0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:23.705746 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b858fe1c-3fc6-41de-a2dc-3378797c3c73 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2041732824" status: 202 len: 0 microversion: 2.1 time: 0.024469 Apr 02 21:52:23.706472 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3488/7274] 10.222.0.18 () {58 vars in 1283 bytes} [Sat Apr 2 21:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2041732824 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:52:23.726182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-998b717f-6f03-4f29-a17c-e5e1f029a92c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: .version_select at 0x7f54c7d26790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-432205694"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:23.745294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-998b717f-6f03-4f29-a17c-e5e1f029a92c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:52:23.750836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-998b717f-6f03-4f29-a17c-e5e1f029a92c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:52:24.182058 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-998b717f-6f03-4f29-a17c-e5e1f029a92c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:52:24.187078 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-998b717f-6f03-4f29-a17c-e5e1f029a92c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:52:24.201318 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-998b717f-6f03-4f29-a17c-e5e1f029a92c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.479121 Apr 02 21:52:24.201929 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3787/7275] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:52:23 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:29.552439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-524778518", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "f4d41ab7-4080-49e9-bfd2-306ccea646b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-432205694", "security_groups": [{"name": "tempest-secgroup-smoke-182227553"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:29.666922 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] validate_networks() for [('f4d41ab7-4080-49e9-bfd2-306ccea646b5', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:52:30.079794 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:52:30.080299 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:52:30.080887 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:52:30.081461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:52:30.081934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:52:30.096111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:30.096619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:30.097823 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:30.098505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:30.119093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:52:30.125226 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:52:30.138692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:52:30.141051 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:52:30.188565 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ad30f7ff-0824-49ef-9b27-f64d44e05382 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.639792 Apr 02 21:52:30.194780 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3489/7276] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:52:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:52:30.210703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21a55e7f-e15b-4760-864c-15701c5f8ab9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:30.211439 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21a55e7f-e15b-4760-864c-15701c5f8ab9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:30.297959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21a55e7f-e15b-4760-864c-15701c5f8ab9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:30.305541 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21a55e7f-e15b-4760-864c-15701c5f8ab9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1265 microversion: 2.1 time: 0.109935 Apr 02 21:52:30.310039 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3788/7277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:30 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:31.325788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:31.326955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:31.334697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:31.335166 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:31.335961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:31.336412 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:31.405899 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:31.414268 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8b1f0f49-8458-4b93-9f78-213f6755e78a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1317 microversion: 2.1 time: 0.093806 Apr 02 21:52:31.414868 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3490/7278] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:31 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:32.432986 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:32.434243 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:32.444763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:32.445533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:32.446681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:32.447310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:32.629193 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:32.637802 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-58670301-1605-4442-8b04-62d787a71536 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.210197 Apr 02 21:52:32.639235 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3789/7279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:32 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:33.108518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-5d5805a1-2f6b-411f-8d52-a9e6ae60c6c0 req-96648fd0-8fd1-447d-af7e-de3990c9818b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:33.120636 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5d5805a1-2f6b-411f-8d52-a9e6ae60c6c0 req-96648fd0-8fd1-447d-af7e-de3990c9818b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:33.121103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-5d5805a1-2f6b-411f-8d52-a9e6ae60c6c0 req-96648fd0-8fd1-447d-af7e-de3990c9818b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:33.137912 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-5d5805a1-2f6b-411f-8d52-a9e6ae60c6c0 req-96648fd0-8fd1-447d-af7e-de3990c9818b service nova] Creating event network-changed:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:52:33.143174 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-5d5805a1-2f6b-411f-8d52-a9e6ae60c6c0 req-96648fd0-8fd1-447d-af7e-de3990c9818b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038461 Apr 02 21:52:33.143977 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3491/7280] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:52:33.655219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:33.655915 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:33.662987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:33.663461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:33.664255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:33.664742 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:33.820214 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:33.828332 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2993f688-5401-4f30-92cb-b90ac440d5f2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.176998 Apr 02 21:52:33.829420 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3790/7281] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:33 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:34.846997 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:34.847626 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:34.855042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:34.855501 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:34.856292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:34.856764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:35.002016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:35.009341 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-01abeefe-080d-47ef-9160-648a9e2b5f40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.167794 Apr 02 21:52:35.009920 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3492/7282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:34 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:36.026532 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:36.027082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:36.033871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:36.034345 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:36.035132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:36.035593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:36.178876 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:36.186938 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c720f781-16fc-44d6-a683-2f608fe18d20 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.164461 Apr 02 21:52:36.187524 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3791/7283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:36 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:37.204024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:37.204600 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:37.211356 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:37.211818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:37.212621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:37.213072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:37.344927 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:37.352478 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a574ba59-b26f-40ab-a860-70147e10ff0e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.152355 Apr 02 21:52:37.353064 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3493/7284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:37 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:38.369514 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:38.370153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:38.377003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:38.377477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:38.378266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:38.378750 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:38.524547 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:38.533250 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f4876d52-e747-416c-b198-5f9c7ac05d02 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.167706 Apr 02 21:52:38.533841 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3792/7285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:38 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:38.592598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-38d794b2-aefe-4eaa-98e5-df1908ba2746 req-38484865-581e-4901-8914-1f2e79776f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "name": "network-vif-plugged", "status": "completed", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:38.602028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-38d794b2-aefe-4eaa-98e5-df1908ba2746 req-38484865-581e-4901-8914-1f2e79776f0b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:38.602526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-38d794b2-aefe-4eaa-98e5-df1908ba2746 req-38484865-581e-4901-8914-1f2e79776f0b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:38.613956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-38d794b2-aefe-4eaa-98e5-df1908ba2746 req-38484865-581e-4901-8914-1f2e79776f0b service nova] Creating event network-vif-plugged:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:52:38.619003 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-38d794b2-aefe-4eaa-98e5-df1908ba2746 req-38484865-581e-4901-8914-1f2e79776f0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030913 Apr 02 21:52:38.619620 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3494/7286] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:52:39.550578 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:39.551210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:39.557991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:39.558466 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:39.559255 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:39.559744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:39.692473 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:39.699883 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f67602be-3f4e-4324-a10b-0c1bf6709ba9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1390 microversion: 2.1 time: 0.153198 Apr 02 21:52:39.700471 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3793/7287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:39 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:40.718491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:40.719148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:40.725391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:40.725857 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:40.726628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:40.727104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:40.863548 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:40.870991 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e4ef9b09-98f3-422f-808c-554fb9076ad0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1561 microversion: 2.1 time: 0.158194 Apr 02 21:52:40.871566 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3495/7288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:40 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:40.887100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:40.887735 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:40.895102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:40.895597 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:40.896380 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:40.896877 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:41.035847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:41.043559 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-48fee0b7-9319-4d82-89d1-69ffe8a3ebf3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1561 microversion: 2.1 time: 0.160353 Apr 02 21:52:41.044144 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3794/7289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:40 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:52:42.956246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:52:42.956890 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:52:42.964033 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:42.964522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:42.965373 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:42.965826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:43.081971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-bbd7a13b-3e12-483b-838a-b611d45f74a6 req-ef46cba6-181e-435a-8274-dbbb4f2f0d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:52:43.090068 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bbd7a13b-3e12-483b-838a-b611d45f74a6 req-ef46cba6-181e-435a-8274-dbbb4f2f0d08 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:52:43.090534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bbd7a13b-3e12-483b-838a-b611d45f74a6 req-ef46cba6-181e-435a-8274-dbbb4f2f0d08 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:52:43.102088 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-bbd7a13b-3e12-483b-838a-b611d45f74a6 req-ef46cba6-181e-435a-8274-dbbb4f2f0d08 service nova] Creating event network-changed:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:52:43.107309 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-bbd7a13b-3e12-483b-838a-b611d45f74a6 req-ef46cba6-181e-435a-8274-dbbb4f2f0d08 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081054 Apr 02 21:52:43.108896 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3795/7290] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:52:43.117872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:52:43.126370 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5e9fdf97-6910-4f46-b858-0022e57da8a7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1561 microversion: 2.1 time: 0.174543 Apr 02 21:52:43.127134 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3496/7291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:52:42 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:07.436714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:53:07.437753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:07.444278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:07.444779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:07.445606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:07.446094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:07.502514 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-42d6903a-2fe7-48be-a123-738c19ef2c2e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action" status: 200 len: 24576 microversion: 2.1 time: 0.070831 Apr 02 21:53:07.503190 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3796/7292] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:53:07 2022] POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action => generated 24576 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:53:18.553028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:53:18.554123 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:18.560204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:18.560649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:18.561423 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:18.561859 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:18.600034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:18.606124 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Old instance type m1.heat2, new instance type m1.heat {{(pid=136517) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 02 21:53:18.613152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:53:18.613586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:53:18.614085 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:53:18.614499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:53:18.614911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:53:18.676198 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-789b4f45-e5b6-4356-8c4d-2ef42fbceabf tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action" status: 202 len: 0 microversion: 2.1 time: 0.127268 Apr 02 21:53:18.676816 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3497/7293] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:53:18 2022] POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:53:18.685712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:18.686430 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:18.693916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:18.694392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:18.695179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:18.695635 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:18.873112 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:18.881359 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7e5981d0-49e1-466f-8400-53203eff2bf6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1688 microversion: 2.1 time: 0.199978 Apr 02 21:53:18.882242 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3797/7294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:18 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:19.900494 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:19.901134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:19.908811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:19.909265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:19.910040 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:19.910487 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:20.052910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:20.060385 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8e9cb3ef-5d0a-4e3b-97b0-903dc13094b0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1688 microversion: 2.1 time: 0.164798 Apr 02 21:53:20.060989 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3498/7295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:19 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:21.077838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:21.078495 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:21.085457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:21.085940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:21.086731 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:21.087192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:21.222253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:21.229781 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a1973c9-f65f-413d-8885-218025e6af99 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1688 microversion: 2.1 time: 0.156070 Apr 02 21:53:21.230361 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3798/7296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:21 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:53:22.247385 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:22.247937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:22.254863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:22.255330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:22.256106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:22.256592 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:22.394595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:22.402091 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8f9fcdfd-4f5c-4894-9408-dd5099b089f4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1688 microversion: 2.1 time: 0.158898 Apr 02 21:53:22.402662 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3499/7297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:22 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:23.419027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:23.419752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:23.426563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:23.427041 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:23.427834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:23.428306 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:23.569108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:23.576585 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e2d1e96-c743-4828-8d36-527763a5ee81 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1688 microversion: 2.1 time: 0.161510 Apr 02 21:53:23.577175 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3799/7298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:23 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:24.594379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:24.594980 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:24.602018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:24.602479 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:24.603267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:24.603715 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:25.078321 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:25.085697 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-935dac33-2168-4e32-9fc7-76a1b875ee77 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1688 microversion: 2.1 time: 0.495787 Apr 02 21:53:25.086275 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3500/7299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:24 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1688 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:26.102704 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:26.103351 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:26.110074 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:26.110554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:26.111350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:26.111818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:26.246559 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:26.254692 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-17a61db8-23b2-4b15-b579-809075f82673 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.156095 Apr 02 21:53:26.255275 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3800/7300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:26 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:27.271698 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:27.272341 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:27.279039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:27.279496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:27.280265 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:27.281292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:27.413961 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:27.421380 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a8613060-a809-4907-afbc-6113312ecf47 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.153686 Apr 02 21:53:27.421957 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3501/7301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:27 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:28.438486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:28.439124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:28.446182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:28.446686 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:28.447488 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:28.447949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:28.588095 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:28.595813 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0f59d3a3-e1c7-42f0-9e73-704543fe9086 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.161346 Apr 02 21:53:28.596401 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3801/7302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:28 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:29.613304 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:29.613860 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:29.620852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:29.621315 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:29.622091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:29.622539 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:29.762338 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:29.770393 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0f3641ad-bffb-43a6-9a79-dbe6acfab046 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.161141 Apr 02 21:53:29.770968 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3502/7303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:29 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:30.788358 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:30.789029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:30.795875 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:30.797106 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:30.797936 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:30.798400 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:30.934168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:30.942126 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2980c159-526b-402e-aa76-187f745a5736 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.158019 Apr 02 21:53:30.942719 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3802/7304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:30 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:31.959284 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:31.959898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:31.966775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:31.967230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:31.968065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:31.968564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:32.100054 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:32.107441 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-30a447b6-5ba3-4a87-914c-fa74d56e01fe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.152079 Apr 02 21:53:32.108020 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3503/7305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:31 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:33.126307 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:33.126955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:33.133667 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:33.134137 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:33.134933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:33.135376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:33.271844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:33.279412 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-21a040a6-d0b5-458c-8b42-404d253c144b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.157656 Apr 02 21:53:33.279992 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3803/7306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:33 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:34.297143 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:34.297742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:34.304422 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:34.304908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:34.305702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:34.306142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:34.438806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:34.446424 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-16a146d4-427d-4de9-9373-4985c058ac95 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.153300 Apr 02 21:53:34.447002 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3504/7307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:34 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:35.469051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:35.469679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:35.476551 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:35.477024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:35.477927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:35.478563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:35.616833 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:35.624594 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4ca9149d-9b80-4230-a5b3-6c25f4f5df23 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.159676 Apr 02 21:53:35.625172 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3804/7308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:35 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:36.640911 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:36.641466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:36.648208 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:36.648705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:36.649508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:36.649947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:36.801296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:36.808830 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0d939a72-bc4d-48e6-b13e-2d75bf0d85fc tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1693 microversion: 2.1 time: 0.172021 Apr 02 21:53:36.809421 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3505/7309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:36 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:37.826179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:37.826822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:37.834337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:37.834816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:37.835619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:37.836084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:37.976202 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:37.983769 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e707c47e-fe0e-4897-924e-cc596e324ae7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1692 microversion: 2.1 time: 0.161635 Apr 02 21:53:37.984344 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3805/7310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:37 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:39.000411 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:39.001038 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:39.007824 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:39.008309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:39.009566 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:39.010306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:39.154720 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:39.162359 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-06e1b990-61b1-4a44-bd52-1021396525d6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1690 microversion: 2.1 time: 0.165837 Apr 02 21:53:39.162935 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3506/7311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:38 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:40.179081 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:40.179785 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:40.187294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.187762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.188570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.189027 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.326300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:40.333668 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-71088028-bf14-4fd2-872d-722f0f8c4767 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1687 microversion: 2.1 time: 0.158511 Apr 02 21:53:40.334244 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3806/7312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:40 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:40.350508 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:53:40.351049 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:40.357892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.358928 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.359712 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.360162 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.416770 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-86720faa-64ab-4884-a485-fe9800953d1b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action" status: 204 len: 0 microversion: 2.1 time: 0.069983 Apr 02 21:53:40.417650 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3507/7313] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:53:40 2022] POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:53:40.427459 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:40.428179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:40.434509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.435007 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.435811 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.436329 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.578283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:40.585862 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-f8b695ae-5748-4aad-9260-78331805330a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1687 microversion: 2.1 time: 0.162555 Apr 02 21:53:40.586451 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3807/7314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:40 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:40.602998 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:40.603740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:40.610541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.611009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.611786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.612232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.863499 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:40.871651 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-31679aae-3138-43e7-8e2b-d9e2f6cd7009 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1687 microversion: 2.1 time: 0.272887 Apr 02 21:53:40.872549 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3508/7315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:40 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1687 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:40.874383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-12131ed9-cc02-42c2-9d32-61e85185317c req-234be62d-8473-4ada-9c36-e8a2abbee8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "name": "network-vif-unplugged", "status": "completed", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:53:40.884073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-12131ed9-cc02-42c2-9d32-61e85185317c req-234be62d-8473-4ada-9c36-e8a2abbee8ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:40.884713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-12131ed9-cc02-42c2-9d32-61e85185317c req-234be62d-8473-4ada-9c36-e8a2abbee8ca service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:40.897863 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-12131ed9-cc02-42c2-9d32-61e85185317c req-234be62d-8473-4ada-9c36-e8a2abbee8ca service nova] Creating event network-vif-unplugged:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:53:40.904592 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [req-12131ed9-cc02-42c2-9d32-61e85185317c req-234be62d-8473-4ada-9c36-e8a2abbee8ca service nova] Instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136518) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 02 21:53:40.912693 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-12131ed9-cc02-42c2-9d32-61e85185317c req-234be62d-8473-4ada-9c36-e8a2abbee8ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043502 Apr 02 21:53:40.914557 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3808/7316] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:53:41.889076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:53:41.889851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:53:41.896672 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:41.897151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:41.897943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:41.898401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:42.039283 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:53:42.047465 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a089c65b-9fc2-4a52-9f52-0b12865fbd07 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1679 microversion: 2.1 time: 0.162438 Apr 02 21:53:42.048041 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3509/7317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:53:41 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:53:42.929971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-41a83e95-e28c-4a55-a6b7-307cad8ad8e6 req-0fbbef24-b347-453a-8666-551c8605c81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "name": "network-vif-plugged", "status": "completed", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:53:42.938821 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-41a83e95-e28c-4a55-a6b7-307cad8ad8e6 req-0fbbef24-b347-453a-8666-551c8605c81c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:53:42.939292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-41a83e95-e28c-4a55-a6b7-307cad8ad8e6 req-0fbbef24-b347-453a-8666-551c8605c81c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:53:42.952904 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-41a83e95-e28c-4a55-a6b7-307cad8ad8e6 req-0fbbef24-b347-453a-8666-551c8605c81c service nova] Creating event network-vif-plugged:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:53:42.958083 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-41a83e95-e28c-4a55-a6b7-307cad8ad8e6 req-0fbbef24-b347-453a-8666-551c8605c81c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032354 Apr 02 21:53:42.958680 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3809/7318] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:54:06.265509 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:06.266491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:06.272533 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:06.273020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:06.273801 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:06.274250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:06.328142 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2774b742-cc25-4474-ba9a-49f2094d8270 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action" status: 200 len: 24579 microversion: 2.1 time: 0.066720 Apr 02 21:54:06.328851 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3510/7319] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:54:06 2022] POST /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d/action => generated 24579 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:54:13.587336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:13.587947 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:13.596473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-49136063-f365-47aa-8fd5-2708048b6602 req-29e87dcd-91f1-4a19-b1c6-64e34d4064cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:13.604182 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:13.610531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-49136063-f365-47aa-8fd5-2708048b6602 req-29e87dcd-91f1-4a19-b1c6-64e34d4064cb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:13.610991 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-49136063-f365-47aa-8fd5-2708048b6602 req-29e87dcd-91f1-4a19-b1c6-64e34d4064cb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:13.616778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:13.617682 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:13.618150 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:13.625125 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-49136063-f365-47aa-8fd5-2708048b6602 req-29e87dcd-91f1-4a19-b1c6-64e34d4064cb service nova] Creating event network-changed:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:54:13.631585 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-49136063-f365-47aa-8fd5-2708048b6602 req-29e87dcd-91f1-4a19-b1c6-64e34d4064cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039253 Apr 02 21:54:13.632405 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3511/7320] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:54:13.644190 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:54:13.728293 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-d932ca24-0b59-4bdd-b966-0c41e1c53018 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 204 len: 0 microversion: 2.1 time: 0.145247 Apr 02 21:54:13.730827 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3810/7321] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:54:13 2022] DELETE /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:54:13.740921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:13.741638 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:13.748096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:13.748587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:13.749376 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:13.749822 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:13.994734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:14.002788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-373f02fb-8925-4063-91a5-a67f842c03be tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1685 microversion: 2.1 time: 0.267262 Apr 02 21:54:14.003374 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3512/7322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:13 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1685 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:15.021009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:15.021740 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:15.028619 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:15.029099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:15.029891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:15.030355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:15.174698 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:15.182242 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a08690c4-7548-4808-9a94-2731f43c45ae tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1567 microversion: 2.1 time: 0.165571 Apr 02 21:54:15.182828 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3811/7323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:15 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:15.754116 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-183c1b53-9e1f-4092-b6bc-c1a680e75ee4 req-8832d6e0-e58c-4090-8bbf-cca933669f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2f38de-0bbf-4069-bf55-3e569f0e0a2d", "name": "network-vif-deleted", "tag": "1e48117a-9517-4c9c-a1dd-0c8f4c31e719"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:15.763213 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-183c1b53-9e1f-4092-b6bc-c1a680e75ee4 req-8832d6e0-e58c-4090-8bbf-cca933669f1f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:15.763669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-183c1b53-9e1f-4092-b6bc-c1a680e75ee4 req-8832d6e0-e58c-4090-8bbf-cca933669f1f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:15.775287 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-183c1b53-9e1f-4092-b6bc-c1a680e75ee4 req-8832d6e0-e58c-4090-8bbf-cca933669f1f service nova] Creating event network-vif-deleted:1e48117a-9517-4c9c-a1dd-0c8f4c31e719 for instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d on nch2-master-1 Apr 02 21:54:15.780576 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-183c1b53-9e1f-4092-b6bc-c1a680e75ee4 req-8832d6e0-e58c-4090-8bbf-cca933669f1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030113 Apr 02 21:54:15.781242 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3513/7324] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:54:16.200625 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:16.201264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:16.208786 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:16.209268 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:16.210069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:16.210537 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:16.241631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:16.242109 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:16.242591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lazy-loading 'fault' on Instance uuid 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:54:16.285716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:16.292575 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-011aa625-872d-4e0f-a545-05feface5671 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 200 len: 1355 microversion: 2.1 time: 0.096350 Apr 02 21:54:16.293158 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3812/7325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:16 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 1355 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:17.311180 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:17.311892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:17.318773 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:17.319236 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:17.320048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:17.320522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:17.334376 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] HTTP exception thrown: Instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d could not be found. Apr 02 21:54:17.335009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Returning 404 to user: Instance 1c2f38de-0bbf-4069-bf55-3e569f0e0a2d could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:54:17.335858 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8ad64b13-32c7-4de3-af0f-d6f5d682ed05 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d" status: 404 len: 111 microversion: 2.1 time: 0.029940 Apr 02 21:54:17.336414 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3514/7326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:17 2022] GET /compute/v2.1/servers/1c2f38de-0bbf-4069-bf55-3e569f0e0a2d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:54:20.690696 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-593d612f-327d-41e0-8fc5-550921f0eaa4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '.version_select at 0x7f54c7d38670>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:20.712710 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-593d612f-327d-41e0-8fc5-550921f0eaa4 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-432205694" status: 202 len: 0 microversion: 2.1 time: 0.025474 Apr 02 21:54:20.713321 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3813/7327] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 21:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-432205694 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:54:20.750314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81bd5c12-404e-487a-9fc7-46c5edc501e7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: .version_select at 0x7f54c778af70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-514731770"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:20.765941 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-81bd5c12-404e-487a-9fc7-46c5edc501e7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:54:20.772759 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-81bd5c12-404e-487a-9fc7-46c5edc501e7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:54:21.222562 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-81bd5c12-404e-487a-9fc7-46c5edc501e7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:54:21.227677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-81bd5c12-404e-487a-9fc7-46c5edc501e7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:54:21.243548 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81bd5c12-404e-487a-9fc7-46c5edc501e7 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.497336 Apr 02 21:54:21.244175 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3515/7328] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:54:20 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:26.776822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-957152944", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "a02c3a3b-f380-4fac-bafe-8f13edae308f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-514731770", "security_groups": [{"name": "tempest-secgroup-smoke-865643469"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:26.892129 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] validate_networks() for [('a02c3a3b-f380-4fac-bafe-8f13edae308f', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:54:27.709356 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:54:27.709880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:54:27.710519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:54:27.711052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:54:27.711563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:54:27.721000 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:27.721557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:27.722474 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:27.722942 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:27.742556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:54:27.748178 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:54:27.762094 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:54:27.764465 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:54:27.815559 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [83abd5d2-476e-4140-a209-bac59856a25e] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:54:28.823426 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [83abd5d2-476e-4140-a209-bac59856a25e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43088. Apr 02 21:54:28.830377 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8e8a6521-9405-407d-87af-511271b3fe88 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.058515 Apr 02 21:54:28.832904 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3814/7329] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:54:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:54:28.843301 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b627ca78-282f-4a75-81d7-967b87359264 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:28.844005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b627ca78-282f-4a75-81d7-967b87359264 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:28.926073 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b627ca78-282f-4a75-81d7-967b87359264 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:28.939664 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b627ca78-282f-4a75-81d7-967b87359264 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1265 microversion: 2.1 time: 0.100403 Apr 02 21:54:28.952142 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3516/7330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:28 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:30.021475 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:30.022116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:30.030156 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:30.031010 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:30.032685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:30.033500 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:30.115778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:30.123594 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-85b56ec6-89a0-4e0c-8b88-21df1c7e2637 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1335 microversion: 2.1 time: 0.169086 Apr 02 21:54:30.124379 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3815/7331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:29 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1335 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:31.144964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:31.146197 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:31.154381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:31.155238 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:31.156310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:31.157534 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:31.321940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1a96f37f-4fad-4c0e-9675-bc7e10a4d534 req-4b7353f3-9819-473f-b449-d3bdb41ae296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08", "tag": "d4a1ea6d-0220-4974-b71a-88a8d567613e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:31.339019 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1a96f37f-4fad-4c0e-9675-bc7e10a4d534 req-4b7353f3-9819-473f-b449-d3bdb41ae296 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:31.339479 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1a96f37f-4fad-4c0e-9675-bc7e10a4d534 req-4b7353f3-9819-473f-b449-d3bdb41ae296 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:31.361255 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1a96f37f-4fad-4c0e-9675-bc7e10a4d534 req-4b7353f3-9819-473f-b449-d3bdb41ae296 service nova] Creating event network-changed:d4a1ea6d-0220-4974-b71a-88a8d567613e for instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 on nch2-master-1 Apr 02 21:54:31.367142 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1a96f37f-4fad-4c0e-9675-bc7e10a4d534 req-4b7353f3-9819-473f-b449-d3bdb41ae296 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049289 Apr 02 21:54:31.368113 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3816/7332] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:54:31.431632 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:31.442923 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bdfad17-0d13-4219-ae27-bfce81a4bc8a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1390 microversion: 2.1 time: 0.305747 Apr 02 21:54:31.446139 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3517/7333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:31 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1390 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:32.464443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:32.465209 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:32.472104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:32.472590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:32.473369 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:32.473822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:32.610504 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:32.617869 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-daf00308-e121-460c-9f36-10231c4bc3e3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1390 microversion: 2.1 time: 0.158486 Apr 02 21:54:32.618488 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3817/7334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:32 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:33.634983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:33.635622 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:33.643048 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:33.643510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:33.644286 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:33.644769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:33.780491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:33.788429 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-26221abb-4146-4ca9-b236-aef7c6163987 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1390 microversion: 2.1 time: 0.157547 Apr 02 21:54:33.789046 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3518/7335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:33 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:34.805984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:34.806549 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:34.813368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:34.813844 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:34.814633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:34.815093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:34.954751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:34.962212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-006b7c07-ed0a-48c5-9f60-fbd4a02d79c8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1390 microversion: 2.1 time: 0.160236 Apr 02 21:54:34.962798 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3818/7336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:34 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:35.065502 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-bd037241-818c-48d6-a06d-6636d236e7e6 req-8336e6e6-3c88-48d1-8d4c-75f2a1e84bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08", "name": "network-vif-plugged", "status": "completed", "tag": "d4a1ea6d-0220-4974-b71a-88a8d567613e"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:35.074559 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bd037241-818c-48d6-a06d-6636d236e7e6 req-8336e6e6-3c88-48d1-8d4c-75f2a1e84bfa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:35.075046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-bd037241-818c-48d6-a06d-6636d236e7e6 req-8336e6e6-3c88-48d1-8d4c-75f2a1e84bfa service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:35.086798 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-bd037241-818c-48d6-a06d-6636d236e7e6 req-8336e6e6-3c88-48d1-8d4c-75f2a1e84bfa service nova] Creating event network-vif-plugged:d4a1ea6d-0220-4974-b71a-88a8d567613e for instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 on nch2-master-1 Apr 02 21:54:35.091917 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-bd037241-818c-48d6-a06d-6636d236e7e6 req-8336e6e6-3c88-48d1-8d4c-75f2a1e84bfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030847 Apr 02 21:54:35.092544 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3519/7337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:54:35.979231 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:35.979860 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:35.986714 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:35.987183 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:35.987960 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:35.988417 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:36.122052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:36.130195 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c10e448a-5ce1-456f-9039-d8830ef2fe4a tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1390 microversion: 2.1 time: 0.154914 Apr 02 21:54:36.130779 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3819/7338] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:35 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:37.147505 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:37.148203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:37.155205 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:37.155657 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:37.156418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:37.156913 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:37.290170 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:37.297841 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d042f6dd-3763-4eaf-b51a-782cede7a713 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1563 microversion: 2.1 time: 0.154318 Apr 02 21:54:37.298417 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3520/7339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:37 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:37.314548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:37.315181 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:37.321952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:37.322426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:37.323205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:37.323661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:37.463486 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:37.471109 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-659bdc1d-b33f-45ff-9f4a-caeae1331fce tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1563 microversion: 2.1 time: 0.160945 Apr 02 21:54:37.471698 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3820/7340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:37 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:54:39.173298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:54:39.173915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:54:39.175052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c481c91e-7c96-45e8-955b-f4c97609fdad req-0b683f82-f6be-43b4-8880-54d5dc15a476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08", "tag": "d4a1ea6d-0220-4974-b71a-88a8d567613e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:54:39.180771 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:39.181249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:39.182424 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:39.182964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:39.184819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c481c91e-7c96-45e8-955b-f4c97609fdad req-0b683f82-f6be-43b4-8880-54d5dc15a476 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:54:39.185411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c481c91e-7c96-45e8-955b-f4c97609fdad req-0b683f82-f6be-43b4-8880-54d5dc15a476 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:54:39.198183 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c481c91e-7c96-45e8-955b-f4c97609fdad req-0b683f82-f6be-43b4-8880-54d5dc15a476 service nova] Creating event network-changed:d4a1ea6d-0220-4974-b71a-88a8d567613e for instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 on nch2-master-1 Apr 02 21:54:39.203469 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c481c91e-7c96-45e8-955b-f4c97609fdad req-0b683f82-f6be-43b4-8880-54d5dc15a476 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032818 Apr 02 21:54:39.204066 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3821/7341] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:54:39.420114 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:54:39.428545 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c9bf5f4-0fa5-4dde-bc4a-09b613ef29ef tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1563 microversion: 2.1 time: 0.260560 Apr 02 21:54:39.429324 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3521/7342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:54:39 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:02.698645 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:55:02.699666 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:02.706002 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:02.706414 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:02.707189 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:02.707642 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:02.757111 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1dd0ff3-6d96-4f88-8e95-d98167f795a1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action" status: 200 len: 24573 microversion: 2.1 time: 0.063459 Apr 02 21:55:02.757799 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3822/7343] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:55:02 2022] POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action => generated 24573 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:55:13.752277 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f71882d8-dde4-47a1-81e2-a49d5d26b6f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:55:13.758273 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f71882d8-dde4-47a1-81e2-a49d5d26b6f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:13.758729 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f71882d8-dde4-47a1-81e2-a49d5d26b6f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:13.780317 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f71882d8-dde4-47a1-81e2-a49d5d26b6f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Going to try to stop instance {{(pid=136517) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 02 21:55:13.821445 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f71882d8-dde4-47a1-81e2-a49d5d26b6f9 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action" status: 202 len: 0 microversion: 2.1 time: 0.073451 Apr 02 21:55:13.822150 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3522/7344] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:55:13 2022] POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:55:13.831810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:13.832610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:13.839822 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:13.840293 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:13.841166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:13.841633 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:14.036621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:14.044077 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-76a01991-83e1-4f8b-a832-ed499917bb89 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.217446 Apr 02 21:55:14.044700 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3823/7345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:13 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:55:15.064781 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:15.065454 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:15.071723 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:15.072192 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:15.073003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:15.073458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:15.252220 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:15.259724 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7e434969-4853-4d42-8739-b65652d7aaa0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.200794 Apr 02 21:55:15.260305 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3523/7346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:15 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:16.276747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:16.277408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:16.284959 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:16.285429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:16.286253 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:16.286713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:16.420809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:16.428949 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc09825a-5c71-48f4-b218-66a10f69d3e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.156189 Apr 02 21:55:16.429522 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3824/7347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:16 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:17.445836 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:17.446461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:17.453344 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:17.453808 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:17.454587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:17.455211 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:17.592575 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:17.599973 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f17f148-53e5-49f2-b5b1-451cd0d33c03 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.158029 Apr 02 21:55:17.600571 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3524/7348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:17 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:18.617582 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:18.618161 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:18.625076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:18.625553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:18.626393 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:18.626852 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:18.759545 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:18.767055 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-55e85383-9b97-4a51-89f4-1f20ef11cd44 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.153473 Apr 02 21:55:18.767638 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3825/7349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:18 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:19.785518 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:19.786106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:19.792766 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:19.793223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:19.793992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:19.794431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:19.927368 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:19.934856 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5b1714e3-f416-4583-be78-17600c626580 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.154318 Apr 02 21:55:19.935433 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3525/7350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:19 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:20.952747 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:20.953391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:20.960813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:20.961315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:20.962083 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:20.962543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:21.101820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:21.109392 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b5a7806-d5aa-41ab-a577-e3249baebc31 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.160653 Apr 02 21:55:21.109975 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3826/7351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:20 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:22.127332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:22.127891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:22.134223 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:22.134683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:22.135458 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:22.135918 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:22.275544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:22.283715 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-792f4665-6fbd-405c-aa54-606b99f25059 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.160903 Apr 02 21:55:22.284293 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3526/7352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:22 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:23.300796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:23.301434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:23.308383 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:23.308838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:23.309668 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:23.310136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:23.444072 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:23.451701 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-586a0165-7f09-4dd8-a8a8-4eafd5a65988 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1692 microversion: 2.1 time: 0.154920 Apr 02 21:55:23.452294 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3827/7353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:23 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:24.469335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:24.470093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:24.478079 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:24.478615 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:24.479537 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:24.480007 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:24.648001 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:24.655927 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f20d8236-4a33-4562-8e27-4cc6c090c461 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1669 microversion: 2.1 time: 0.190505 Apr 02 21:55:24.656773 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3527/7354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:24 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:25.750256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:55:25.751131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:25.758030 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:25.758502 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:25.759292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:25.759753 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:25.818435 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-359411b2-6ef3-416a-9300-56019531a166 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action" status: 200 len: 38195 microversion: 2.1 time: 0.072049 Apr 02 21:55:25.819089 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3828/7355] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:55:25 2022] POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action => generated 38195 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:55:25.830847 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-79c6b405-e093-4c05-837f-33c7f8e29b61 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:55:25.837634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79c6b405-e093-4c05-837f-33c7f8e29b61 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:25.838091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-79c6b405-e093-4c05-837f-33c7f8e29b61 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:25.860109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-79c6b405-e093-4c05-837f-33c7f8e29b61 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Going to try to start instance {{(pid=136517) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 02 21:55:25.903222 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-79c6b405-e093-4c05-837f-33c7f8e29b61 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action" status: 202 len: 0 microversion: 2.1 time: 0.076530 Apr 02 21:55:25.903728 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3528/7356] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:55:25 2022] POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:55:25.914116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:25.914858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:25.922396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:25.923011 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:25.924337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:25.924826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:26.065031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:26.073031 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9e372fa5-e876-4e12-81df-a4cfb71c8f80 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1678 microversion: 2.1 time: 0.163579 Apr 02 21:55:26.073927 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3829/7357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:25 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:27.091379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:55:27.092332 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:27.100052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:27.100617 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:27.101461 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:27.101910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:27.240089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:55:27.247648 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d953e2a-292a-4778-bc1a-ca51601c8276 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1682 microversion: 2.1 time: 0.160983 Apr 02 21:55:27.248222 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3529/7358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:55:27 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:55:53.446824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:55:53.447774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:55:53.454429 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:53.455703 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:53.456168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:55:53.456697 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:55:53.523902 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-974539c7-efb9-404b-ba18-8ef8b6eeb82f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action" status: 200 len: 62761 microversion: 2.1 time: 0.080816 Apr 02 21:55:53.524651 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3830/7359] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:55:53 2022] POST /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08/action => generated 62761 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:56:01.060388 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:01.060992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:01.068716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:01.069186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:01.069982 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:01.070431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:01.097096 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:56:01.118677 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-494612af-ebf0-43fc-83d3-4d60d60c0fd5 req-93fb7ca3-832f-4bcd-bf83-ad84e0d9fe26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08", "tag": "d4a1ea6d-0220-4974-b71a-88a8d567613e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:01.129426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-494612af-ebf0-43fc-83d3-4d60d60c0fd5 req-93fb7ca3-832f-4bcd-bf83-ad84e0d9fe26 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:01.130264 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-494612af-ebf0-43fc-83d3-4d60d60c0fd5 req-93fb7ca3-832f-4bcd-bf83-ad84e0d9fe26 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:01.142489 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-494612af-ebf0-43fc-83d3-4d60d60c0fd5 req-93fb7ca3-832f-4bcd-bf83-ad84e0d9fe26 service nova] Creating event network-changed:d4a1ea6d-0220-4974-b71a-88a8d567613e for instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 on nch2-master-1 Apr 02 21:56:01.148275 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-494612af-ebf0-43fc-83d3-4d60d60c0fd5 req-93fb7ca3-832f-4bcd-bf83-ad84e0d9fe26 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089123 Apr 02 21:56:01.149128 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3831/7360] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:56:01.189239 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b476a8a-4e5e-42eb-a1f6-a03f83e58fdb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 204 len: 0 microversion: 2.1 time: 0.132589 Apr 02 21:56:01.189766 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3530/7361] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:56:01 2022] DELETE /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:56:01.198909 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:01.199646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:01.206846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:01.207328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:01.208142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:01.208641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:01.360411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:01.369174 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-87517477-2cc0-41b1-9beb-ddc7074f9639 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1688 microversion: 2.1 time: 0.174845 Apr 02 21:56:01.370049 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3832/7362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:01 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:02.387762 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:02.388500 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:02.395908 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:02.396352 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:02.397153 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:02.397597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:02.533059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:02.541789 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b132f70-0a38-4dd4-ad51-7b6e6b3979bb tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1569 microversion: 2.1 time: 0.158319 Apr 02 21:56:02.542532 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3531/7363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:02 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:03.398391 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-9d00bc53-a082-4418-95a2-1daf59599fb2 req-8d6f112b-2abe-4b99-9ece-4f259922812e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08", "name": "network-vif-deleted", "tag": "d4a1ea6d-0220-4974-b71a-88a8d567613e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:03.408404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9d00bc53-a082-4418-95a2-1daf59599fb2 req-8d6f112b-2abe-4b99-9ece-4f259922812e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:03.409168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-9d00bc53-a082-4418-95a2-1daf59599fb2 req-8d6f112b-2abe-4b99-9ece-4f259922812e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:03.422140 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-9d00bc53-a082-4418-95a2-1daf59599fb2 req-8d6f112b-2abe-4b99-9ece-4f259922812e service nova] Creating event network-vif-deleted:d4a1ea6d-0220-4974-b71a-88a8d567613e for instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 on nch2-master-1 Apr 02 21:56:03.428353 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-9d00bc53-a082-4418-95a2-1daf59599fb2 req-8d6f112b-2abe-4b99-9ece-4f259922812e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033745 Apr 02 21:56:03.429017 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3833/7364] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:56:03.559134 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:03.559708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:03.567078 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:03.567545 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:03.568340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:03.568814 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:03.599150 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:03.599696 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:03.600148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lazy-loading 'fault' on Instance uuid d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:56:03.640661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:03.649202 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ffb8468-6a75-4275-8f7d-db65cdd73697 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 200 len: 1355 microversion: 2.1 time: 0.094149 Apr 02 21:56:03.649783 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3532/7365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:03 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 1355 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:04.666846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:04.667557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:04.674571 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:04.675038 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:04.675815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:04.676272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:04.689370 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] HTTP exception thrown: Instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 could not be found. Apr 02 21:56:04.689967 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Returning 404 to user: Instance d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:56:04.690803 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16ba3a97-2655-4dde-98be-752fd95dd22d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08" status: 404 len: 111 microversion: 2.1 time: 0.028306 Apr 02 21:56:04.691326 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3834/7366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:04 2022] GET /compute/v2.1/servers/d26eb8f0-c0fa-4e8f-9bf9-1062f3341b08 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:56:08.042819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-184584e4-7a20-4e4a-bcc9-f8d7995528d3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '.version_select at 0x7f54c77e9ca0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:08.062679 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-184584e4-7a20-4e4a-bcc9-f8d7995528d3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-514731770" status: 202 len: 0 microversion: 2.1 time: 0.023742 Apr 02 21:56:08.063305 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3533/7367] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 21:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-514731770 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:56:08.087323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5372ca9a-aa62-489c-8b8e-41d2cbe34f7e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: .version_select at 0x7f54d453e8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-338933230"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:08.104036 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5372ca9a-aa62-489c-8b8e-41d2cbe34f7e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:56:08.111206 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5372ca9a-aa62-489c-8b8e-41d2cbe34f7e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:56:08.283140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5372ca9a-aa62-489c-8b8e-41d2cbe34f7e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:56:08.288871 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-5372ca9a-aa62-489c-8b8e-41d2cbe34f7e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:56:08.303340 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5372ca9a-aa62-489c-8b8e-41d2cbe34f7e tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.220127 Apr 02 21:56:08.303966 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3835/7368] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:56:08 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:13.879470 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1803929544", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "networks": [{"uuid": "dad2f7c9-64f8-478e-b03e-ab205c0e62ed"}], "key_name": "tempest-TestNetworkAdvancedServerOps-338933230", "security_groups": [{"name": "tempest-secgroup-smoke-1530498942"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:14.035155 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] validate_networks() for [('dad2f7c9-64f8-478e-b03e-ab205c0e62ed', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:56:14.580620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:56:14.581056 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:56:14.581541 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:56:14.581959 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:56:14.582380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:56:14.592239 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:14.592791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:14.593613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:14.594059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:14.616187 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:56:14.621756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Getting quotas for user 6a25135e2c29463999fd4d912d99bf6b and project ca394d2c596042ad961fc645ce7b6940. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:56:14.635784 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:56:14.638204 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:56:14.684710 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [c3c742be-dbf0-4bea-b6e3-78d9e446f3b7] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:56:15.693812 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [c3c742be-dbf0-4bea-b6e3-78d9e446f3b7] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43306. Apr 02 21:56:15.698738 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6fa32275-03a9-4964-9e53-4c6321dc1974 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.823754 Apr 02 21:56:15.699866 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3534/7369] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:56:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:56:15.713979 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e111f064-2db1-452f-ba1f-4c39d9b1b57c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:15.715426 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e111f064-2db1-452f-ba1f-4c39d9b1b57c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:15.773628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e111f064-2db1-452f-ba1f-4c39d9b1b57c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:15.780343 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e111f064-2db1-452f-ba1f-4c39d9b1b57c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1266 microversion: 2.1 time: 0.074366 Apr 02 21:56:15.781118 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3836/7370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:15 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:16.797995 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:16.798629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:16.817764 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:16.818724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:16.819811 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:16.820446 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:16.901706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:16.910821 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-197386cc-baa8-4384-a160-b5db164a7282 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1336 microversion: 2.1 time: 0.117664 Apr 02 21:56:16.911640 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3535/7371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:16 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:17.928868 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:17.929802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:17.938116 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:17.938587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:17.939575 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:17.940119 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:18.084794 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:18.093207 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6a28237c-2741-4e45-a242-eef4a3856835 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1392 microversion: 2.1 time: 0.168690 Apr 02 21:56:18.093808 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3837/7372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:17 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:18.137030 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-776fccf6-ecd3-4e4f-a3f5-3f716550d8dc req-e3de07c7-a230-48ff-bb17-7828a73875d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2b4e11-a886-4de0-9cb1-dd90f09037b9", "tag": "1e70c727-6ab0-44c9-b00c-3122de811098"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:18.171864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-776fccf6-ecd3-4e4f-a3f5-3f716550d8dc req-e3de07c7-a230-48ff-bb17-7828a73875d3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:18.172639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-776fccf6-ecd3-4e4f-a3f5-3f716550d8dc req-e3de07c7-a230-48ff-bb17-7828a73875d3 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:18.186493 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-776fccf6-ecd3-4e4f-a3f5-3f716550d8dc req-e3de07c7-a230-48ff-bb17-7828a73875d3 service nova] Creating event network-changed:1e70c727-6ab0-44c9-b00c-3122de811098 for instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 on nch2-master-1 Apr 02 21:56:18.194404 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-776fccf6-ecd3-4e4f-a3f5-3f716550d8dc req-e3de07c7-a230-48ff-bb17-7828a73875d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062561 Apr 02 21:56:18.195374 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3536/7373] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:56:19.109746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:19.110397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:19.118244 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:19.118837 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:19.119567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:19.120120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:19.260338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:19.268336 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2819213a-fd6d-46a0-8b0f-7643ef5c6cfe tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1392 microversion: 2.1 time: 0.162068 Apr 02 21:56:19.268961 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3838/7374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:19 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:20.286377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:20.287109 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:20.294279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:20.294742 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:20.295520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:20.295968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:20.433884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:20.441489 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-99c451d9-5cbb-4cf1-b517-d8c2a2c5a2a3 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1392 microversion: 2.1 time: 0.160141 Apr 02 21:56:20.442071 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3537/7375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:20 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:21.459816 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:21.460590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:21.467982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:21.468487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:21.469304 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:21.469772 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:21.610751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:21.619472 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bf075b59-7ac3-498e-92b1-1c77cde56b12 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1392 microversion: 2.1 time: 0.164764 Apr 02 21:56:21.620274 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3839/7376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:21 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:21.628156 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b6d5eb18-9f0e-4562-8ccb-faac60220792 req-e412f351-3005-49ef-9c0d-dc280e71771f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2b4e11-a886-4de0-9cb1-dd90f09037b9", "name": "network-vif-plugged", "status": "completed", "tag": "1e70c727-6ab0-44c9-b00c-3122de811098"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:21.636934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b6d5eb18-9f0e-4562-8ccb-faac60220792 req-e412f351-3005-49ef-9c0d-dc280e71771f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:21.637393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b6d5eb18-9f0e-4562-8ccb-faac60220792 req-e412f351-3005-49ef-9c0d-dc280e71771f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:21.648913 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b6d5eb18-9f0e-4562-8ccb-faac60220792 req-e412f351-3005-49ef-9c0d-dc280e71771f service nova] Creating event network-vif-plugged:1e70c727-6ab0-44c9-b00c-3122de811098 for instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 on nch2-master-1 Apr 02 21:56:21.654063 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b6d5eb18-9f0e-4562-8ccb-faac60220792 req-e412f351-3005-49ef-9c0d-dc280e71771f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088672 Apr 02 21:56:21.654663 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3538/7377] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 21:56:22.636240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:22.636900 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:22.643587 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:22.644052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:22.644862 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:22.645316 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:22.782075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:22.790328 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0e920b85-d4ea-4563-8310-ec3732d1a61d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1392 microversion: 2.1 time: 0.158079 Apr 02 21:56:22.790906 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3840/7378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:22 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:23.809724 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:23.810598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:23.817431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:23.817889 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:23.818650 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:23.819092 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:23.953834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:23.961266 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a1cdef6-d675-48fa-94c3-9baef5b44a27 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1564 microversion: 2.1 time: 0.157232 Apr 02 21:56:23.961842 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3539/7379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:23 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:23.977534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:23.978259 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:23.985044 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:23.985518 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:23.986308 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:23.987299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:24.121142 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:24.128664 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6bd9d71c-e154-4459-844f-27dbc696bc3c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1564 microversion: 2.1 time: 0.155316 Apr 02 21:56:24.129247 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3841/7380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:23 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:26.053093 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:56:26.053721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:26.061058 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:26.061655 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:26.061987 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c9b949e0-85b8-4c48-b15c-c79f9e1e3271 req-4c815a1d-9342-4379-aeae-686c6d3a901b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2b4e11-a886-4de0-9cb1-dd90f09037b9", "tag": "1e70c727-6ab0-44c9-b00c-3122de811098"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:26.062902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:26.063596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:26.070778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c9b949e0-85b8-4c48-b15c-c79f9e1e3271 req-4c815a1d-9342-4379-aeae-686c6d3a901b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:26.071245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c9b949e0-85b8-4c48-b15c-c79f9e1e3271 req-4c815a1d-9342-4379-aeae-686c6d3a901b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:26.083106 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c9b949e0-85b8-4c48-b15c-c79f9e1e3271 req-4c815a1d-9342-4379-aeae-686c6d3a901b service nova] Creating event network-changed:1e70c727-6ab0-44c9-b00c-3122de811098 for instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 on nch2-master-1 Apr 02 21:56:26.089603 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c9b949e0-85b8-4c48-b15c-c79f9e1e3271 req-4c815a1d-9342-4379-aeae-686c6d3a901b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030652 Apr 02 21:56:26.090548 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3842/7381] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:56:26.295168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:56:26.302531 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c5064713-d893-43bd-bfed-575207cbea6c tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1564 microversion: 2.1 time: 0.253644 Apr 02 21:56:26.314278 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3540/7382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:56:26 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:56:49.895342 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:56:49.896364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:56:49.902556 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:49.903029 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:49.903803 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:56:49.904260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:56:49.964778 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2acd8ac-abf2-472f-a86d-ae023d2ff941 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action" status: 200 len: 24569 microversion: 2.1 time: 0.075135 Apr 02 21:56:49.965425 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3843/7383] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:56:49 2022] POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:57:01.073270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:01.073948 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:01.080750 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:01.081209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:01.081973 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:01.082417 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:01.104028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lazy-loading 'flavor' on Instance uuid 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:57:01.171070 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c08225c7-104b-4e58-98ed-85a953b584c2 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action" status: 202 len: 0 microversion: 2.1 time: 0.101520 Apr 02 21:57:01.175213 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3541/7384] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:57:01 2022] POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:57:01.181199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:01.181925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:01.190394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:01.190968 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:01.191853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:01.192396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:01.338104 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:01.345620 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3892d27e-b5cc-4174-9348-4d4ded467603 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1690 microversion: 2.1 time: 0.168833 Apr 02 21:57:01.346186 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3844/7385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:01 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:02.364864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:02.365569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:02.371818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:02.372276 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:02.373104 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:02.373561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:02.508111 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:02.515633 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e1bc64f2-8b7e-443c-a05b-9c23c7d170f0 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1673 microversion: 2.1 time: 0.156589 Apr 02 21:57:02.516194 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3542/7386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:02 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:03.606593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:03.607573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:03.617892 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:03.618362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:03.619146 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:03.619601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:03.678690 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b320a658-4963-4b98-94a0-e9a2b09b697d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action" status: 200 len: 38409 microversion: 2.1 time: 0.075935 Apr 02 21:57:03.679356 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3845/7387] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:57:03 2022] POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action => generated 38409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:57:03.690677 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:03.691224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:03.698203 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:03.698660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:03.699432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:03.699880 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:03.764032 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2d1f1f2e-8ee5-4d6e-9d23-16293c8f59e1 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action" status: 202 len: 0 microversion: 2.1 time: 0.077028 Apr 02 21:57:03.764629 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3543/7388] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:57:03 2022] POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:57:03.774121 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:03.774843 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:03.781878 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:03.782353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:03.783147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:03.783607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:03.926782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:03.934556 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-eb1aec52-c279-41f4-9eaf-0f2f9a223484 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1679 microversion: 2.1 time: 0.164726 Apr 02 21:57:03.935335 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3846/7389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:03 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:04.954528 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:04.955259 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:04.961687 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:04.962151 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:04.962925 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:04.963400 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:05.098663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:05.106100 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4fae6e4-658e-4fa1-9803-9d279de4c8e8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1679 microversion: 2.1 time: 0.156977 Apr 02 21:57:05.106672 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3544/7390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:04 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:06.123576 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:06.124120 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:06.131463 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:06.131933 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:06.132749 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:06.133245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:06.272580 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:06.280148 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e70a389a-7af8-40da-9757-c9f26ec38eb6 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1682 microversion: 2.1 time: 0.160525 Apr 02 21:57:06.280760 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3847/7391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:06 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:06.369221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:06.370173 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:06.377066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:06.378052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:06.378829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:06.379274 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:06.422557 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a721eb43-c414-4695-b1a2-c0816aaddab8 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action" status: 200 len: 38409 microversion: 2.1 time: 0.057126 Apr 02 21:57:06.423221 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3545/7392] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:57:06 2022] POST /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9/action => generated 38409 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 02 21:57:07.423973 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:07.425021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:07.427574 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a18b52e9-a9d6-41e6-be29-f669bf7ea973 req-57689204-0800-4bb1-863d-467b577ba457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2b4e11-a886-4de0-9cb1-dd90f09037b9", "tag": "1e70c727-6ab0-44c9-b00c-3122de811098"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:07.432127 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:07.432646 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:07.433585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:07.434054 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:07.437107 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a18b52e9-a9d6-41e6-be29-f669bf7ea973 req-57689204-0800-4bb1-863d-467b577ba457 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:07.438934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a18b52e9-a9d6-41e6-be29-f669bf7ea973 req-57689204-0800-4bb1-863d-467b577ba457 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:07.449401 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a18b52e9-a9d6-41e6-be29-f669bf7ea973 req-57689204-0800-4bb1-863d-467b577ba457 service nova] Creating event network-changed:1e70c727-6ab0-44c9-b00c-3122de811098 for instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 on nch2-master-1 Apr 02 21:57:07.454461 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a18b52e9-a9d6-41e6-be29-f669bf7ea973 req-57689204-0800-4bb1-863d-467b577ba457 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031744 Apr 02 21:57:07.455432 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3546/7393] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:57:07.461135 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 21:57:07.552943 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8efe7059-b834-4689-9e3b-3dae76005e1d tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 204 len: 0 microversion: 2.1 time: 0.132790 Apr 02 21:57:07.553682 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3848/7394] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 21:57:07 2022] DELETE /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 21:57:07.563152 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:07.564242 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:07.571933 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:07.572590 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:07.573702 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:07.574375 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:07.800662 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:07.808664 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b244cd2b-ec96-4ea8-975b-e49cc3b1661f tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1688 microversion: 2.1 time: 0.250501 Apr 02 21:57:07.809665 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3547/7395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:07 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1688 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:08.827028 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:08.827744 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:08.834989 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:08.835457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:08.836240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:08.836717 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:08.976974 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:08.984489 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bbfaa195-5355-4605-a586-68c07f87ba4b tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1570 microversion: 2.1 time: 0.161745 Apr 02 21:57:08.985059 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3849/7396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:08 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:09.894595 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-2500d2de-08eb-4405-b3a3-3ade7b488554 req-65b26777-c403-4275-8546-f95b67add44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2b4e11-a886-4de0-9cb1-dd90f09037b9", "name": "network-vif-deleted", "tag": "1e70c727-6ab0-44c9-b00c-3122de811098"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:09.904817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2500d2de-08eb-4405-b3a3-3ade7b488554 req-65b26777-c403-4275-8546-f95b67add44c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:09.905262 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-2500d2de-08eb-4405-b3a3-3ade7b488554 req-65b26777-c403-4275-8546-f95b67add44c service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:09.920220 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-2500d2de-08eb-4405-b3a3-3ade7b488554 req-65b26777-c403-4275-8546-f95b67add44c service nova] Creating event network-vif-deleted:1e70c727-6ab0-44c9-b00c-3122de811098 for instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 on nch2-master-1 Apr 02 21:57:09.925570 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-2500d2de-08eb-4405-b3a3-3ade7b488554 req-65b26777-c403-4275-8546-f95b67add44c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035389 Apr 02 21:57:09.926400 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3548/7397] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:57:10.003210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:10.003880 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:10.011016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:10.011501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:10.012498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:10.013073 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:10.048286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:10.048716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:10.049192 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lazy-loading 'fault' on Instance uuid 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:57:10.094381 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a25135e2c29463999fd4d912d99bf6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca394d2c596042ad961fc645ce7b6940', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:10.102000 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5035fa01-5982-45a9-8432-1affa9b45860 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 200 len: 1356 microversion: 2.1 time: 0.104342 Apr 02 21:57:10.102581 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3850/7398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:09 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:11.122046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:11.122741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] [instance: 7c2b4e11-a886-4de0-9cb1-dd90f09037b9] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:11.129561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:11.130018 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:11.130780 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:11.131221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:11.144726 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] HTTP exception thrown: Instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 could not be found. Apr 02 21:57:11.145319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Returning 404 to user: Instance 7c2b4e11-a886-4de0-9cb1-dd90f09037b9 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 21:57:11.146182 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-acc6fc35-b9d9-446d-91ec-e3e1f48c23a5 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9" status: 404 len: 111 microversion: 2.1 time: 0.029331 Apr 02 21:57:11.146722 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3549/7399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:11 2022] GET /compute/v2.1/servers/7c2b4e11-a886-4de0-9cb1-dd90f09037b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 21:57:14.545087 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5358945e-b660-4bc8-a744-33cd487e0c40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] Calling method '.version_select at 0x7f54d4a94dc0>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:14.566892 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5358945e-b660-4bc8-a744-33cd487e0c40 tempest-TestNetworkAdvancedServerOps-255875686 tempest-TestNetworkAdvancedServerOps-255875686-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-338933230" status: 202 len: 0 microversion: 2.1 time: 0.025648 Apr 02 21:57:14.571170 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3851/7400] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Apr 2 21:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-338933230 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:57:26.123978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ba6d9fcd-12be-44b0-a044-38f05fdb3f79 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'create', calling method: .version_select at 0x7f54c77fb280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1731586302"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:26.138041 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ba6d9fcd-12be-44b0-a044-38f05fdb3f79 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:57:26.143144 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ba6d9fcd-12be-44b0-a044-38f05fdb3f79 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for user d67b2d6324ec46ca91756e3a19dac4dd and project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:57:26.349127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ba6d9fcd-12be-44b0-a044-38f05fdb3f79 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:57:26.354142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-ba6d9fcd-12be-44b0-a044-38f05fdb3f79 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for user d67b2d6324ec46ca91756e3a19dac4dd and project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:57:26.368933 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ba6d9fcd-12be-44b0-a044-38f05fdb3f79 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.426422 Apr 02 21:57:26.369534 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3550/7401] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 21:57:25 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 21:57:27.309999 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-735112094", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1731586302", "security_groups": [{"name": "tempest-secgroup-smoke-482115301"}], "networks": [{"uuid": "736cf116-b58d-41e4-9c8d-0139b33e2970"}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:27.418506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] validate_networks() for [('736cf116-b58d-41e4-9c8d-0139b33e2970', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 21:57:27.784761 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 21:57:27.785102 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 21:57:27.785594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 21:57:27.786021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 21:57:27.786483 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 21:57:27.795388 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:27.795858 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:27.796716 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:27.797175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:27.814364 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 21:57:27.819695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for user d67b2d6324ec46ca91756e3a19dac4dd and project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 21:57:27.832144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 21:57:27.834509 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 21:57:27.881478 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3e45acfe-c3e0-4c73-801f-807ef3da4ba1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.576823 Apr 02 21:57:27.886977 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3852/7402] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 21:57:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 21:57:27.893297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-57d11873-2a60-4c3d-a8c0-b77711a65225 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:27.894660 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-57d11873-2a60-4c3d-a8c0-b77711a65225 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:27.960947 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-57d11873-2a60-4c3d-a8c0-b77711a65225 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:27.968603 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-57d11873-2a60-4c3d-a8c0-b77711a65225 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1246 microversion: 2.1 time: 0.079463 Apr 02 21:57:27.969952 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3551/7403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:27 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:28.989217 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:28.989890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:28.997617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:28.998143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:28.999090 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:28.999727 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:29.139350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:29.148328 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3f5b8137-abe4-40fd-85ec-693e29d073ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1306 microversion: 2.1 time: 0.165975 Apr 02 21:57:29.151336 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3853/7404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:28 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1306 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:30.168597 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:30.169232 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:30.176221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:30.176717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:30.177513 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:30.177965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:30.430748 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:30.438666 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49340e0e-ff4b-4e80-a690-c2170502e660 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1371 microversion: 2.1 time: 0.274061 Apr 02 21:57:30.439992 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3552/7405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:30 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:30.588579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-78c10b72-4842-4ebc-afcf-303d95c40c90 req-2eaca26e-9585-43fb-ba0c-4891e0547792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:30.600591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-78c10b72-4842-4ebc-afcf-303d95c40c90 req-2eaca26e-9585-43fb-ba0c-4891e0547792 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:30.601292 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-78c10b72-4842-4ebc-afcf-303d95c40c90 req-2eaca26e-9585-43fb-ba0c-4891e0547792 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:30.615810 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-78c10b72-4842-4ebc-afcf-303d95c40c90 req-2eaca26e-9585-43fb-ba0c-4891e0547792 service nova] Creating event network-changed:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 21:57:30.621463 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-78c10b72-4842-4ebc-afcf-303d95c40c90 req-2eaca26e-9585-43fb-ba0c-4891e0547792 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036682 Apr 02 21:57:30.622109 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3854/7406] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:57:31.456817 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:31.457449 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:31.464629 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:31.465102 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:31.465892 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:31.466345 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:31.677705 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:31.685729 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cc644d4d-8bd4-4b15-af47-5b08bd6f33a1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1371 microversion: 2.1 time: 0.233354 Apr 02 21:57:31.686326 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3553/7407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:31 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:32.706815 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:32.707991 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:32.714372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:32.714881 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:32.715679 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:32.716143 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:32.853778 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:32.861234 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8a75354a-369b-4301-a483-6310b240e96c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1371 microversion: 2.1 time: 0.161727 Apr 02 21:57:32.861816 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3855/7408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:32 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:33.878268 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:33.878885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:33.885692 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:33.886121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:33.886898 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:33.887571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:34.030633 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:34.038721 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3840ec64-d7b7-4a6d-a097-080f593a9c89 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1371 microversion: 2.1 time: 0.164614 Apr 02 21:57:34.039289 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3554/7409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:33 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:35.054769 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:35.055402 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:35.062208 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:35.062684 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:35.063477 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:35.064048 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:35.197168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:35.205038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4c9132e2-7497-4a7d-89c3-6254c797f4e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1371 microversion: 2.1 time: 0.153654 Apr 02 21:57:35.205619 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3856/7410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:35 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:35.818568 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3d5b9e97-3663-4ba1-9d32-564a644d1e7e req-2ea3234c-3e31-490f-b176-c4298d71fd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "name": "network-vif-plugged", "status": "completed", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:35.828795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3d5b9e97-3663-4ba1-9d32-564a644d1e7e req-2ea3234c-3e31-490f-b176-c4298d71fd93 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:35.829250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3d5b9e97-3663-4ba1-9d32-564a644d1e7e req-2ea3234c-3e31-490f-b176-c4298d71fd93 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:35.840488 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3d5b9e97-3663-4ba1-9d32-564a644d1e7e req-2ea3234c-3e31-490f-b176-c4298d71fd93 service nova] Creating event network-vif-plugged:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 21:57:35.845661 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3d5b9e97-3663-4ba1-9d32-564a644d1e7e req-2ea3234c-3e31-490f-b176-c4298d71fd93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031285 Apr 02 21:57:35.846276 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3555/7411] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:57:36.223534 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:36.224089 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:36.230930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:36.231420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:36.232191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:36.232674 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:36.365628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:36.373182 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-90be548b-312b-47c1-ae54-525f5250c42e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1371 microversion: 2.1 time: 0.155413 Apr 02 21:57:36.373765 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3857/7412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:36 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:37.390885 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:37.391591 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:37.398733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:37.398821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:37.399564 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:37.400013 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:37.539737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:37.547176 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-81caeb81-89cd-4398-a2c5-f86f2228fa52 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1555 microversion: 2.1 time: 0.161422 Apr 02 21:57:37.547785 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3556/7413] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:37 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:37.563396 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:57:37.564563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:57:37.571323 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:37.571796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:37.572617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:37.573092 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:37.711890 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:57:37.719624 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-47856f4d-ad74-468b-8ba5-cd37c594e215 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1555 microversion: 2.1 time: 0.160132 Apr 02 21:57:37.720214 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3858/7414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:57:37 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:57:39.734606 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b7f8a860-7d9d-4a71-8aed-057bf2518843 req-4bedaa7f-21e7-4dab-bab1-38377d50c0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:57:39.744745 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b7f8a860-7d9d-4a71-8aed-057bf2518843 req-4bedaa7f-21e7-4dab-bab1-38377d50c0cb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:57:39.745279 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b7f8a860-7d9d-4a71-8aed-057bf2518843 req-4bedaa7f-21e7-4dab-bab1-38377d50c0cb service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:57:39.763496 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b7f8a860-7d9d-4a71-8aed-057bf2518843 req-4bedaa7f-21e7-4dab-bab1-38377d50c0cb service nova] Creating event network-changed:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 21:57:39.772112 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b7f8a860-7d9d-4a71-8aed-057bf2518843 req-4bedaa7f-21e7-4dab-bab1-38377d50c0cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040939 Apr 02 21:57:39.773306 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3557/7415] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:59:37.121553 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:59:37.122125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:37.128802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:37.129278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:37.130061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:37.130519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:37.152322 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lazy-loading 'flavor' on Instance uuid 6e72dc18-fa7e-43df-a8c6-0728c086f081 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 21:59:37.409858 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-98c955c2-ddc5-4dc5-8171-af1b1011ee6c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081/action" status: 202 len: 0 microversion: 2.1 time: 0.293427 Apr 02 21:59:37.410500 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3859/7416] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 21:59:37 2022] POST /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 21:59:37.417081 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:59:37.417911 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 21:59:37.422130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:37.422869 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:37.429795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:37.430306 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:37.431042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:37.431496 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:37.568159 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:37.575769 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd9dbc24-d9de-4f9d-9ded-23e0a0a84859 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.160744 Apr 02 21:59:37.576345 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3558/7417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:37 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:38.595413 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:38.596128 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:38.602460 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:38.602925 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:38.603701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:38.604155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:38.739774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:38.747158 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b5c1884a-356c-4382-994f-a8ce2a050c9b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.157701 Apr 02 21:59:38.747739 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3860/7418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:38 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:39.763938 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:39.764646 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:39.773714 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:39.774172 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:39.774946 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:39.775393 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:39.791845 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43706. Apr 02 21:59:39.792611 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 43704. Apr 02 21:59:39.914716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:39.922174 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-27c07c10-ddef-46dc-bf0d-098c4994688a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.162181 Apr 02 21:59:39.922751 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3559/7419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:39 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:40.939328 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:40.939983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:40.946841 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:40.947310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:40.948086 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:40.948563 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:41.086612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:41.094135 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2cf89fbd-da79-4ed6-ac07-d4d78acfd1e9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.158853 Apr 02 21:59:41.094707 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3861/7420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:40 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:42.112538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:42.113200 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:42.120009 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:42.120491 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:42.121270 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:42.121719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:42.255389 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:42.262911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-1deed38b-6f48-4fa5-a94a-bdef8b2d7e25 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.155015 Apr 02 21:59:42.263487 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3560/7421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:42 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:43.281125 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:43.281752 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:43.288009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:43.288498 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:43.289286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:43.289741 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:43.422661 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:43.430797 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-07b19112-b4e2-48d7-88a6-f2e36d6d8cfa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.153989 Apr 02 21:59:43.431374 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3862/7422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:43 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:44.447335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:44.447987 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:44.456416 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:44.456905 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:44.457684 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:44.458130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:44.600391 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:44.607910 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-318177e7-461b-4a75-81b0-ac96c814a69a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.164611 Apr 02 21:59:44.608493 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3561/7423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:44 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:45.626239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:45.627394 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:45.634140 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:45.634605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:45.635382 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:45.635835 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:45.776489 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:45.784184 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b6e77e2d-c445-4973-9456-ae489723c620 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.161918 Apr 02 21:59:45.784793 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3863/7424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:45 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:46.801586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:46.802133 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:46.809131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:46.809598 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:46.810379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:46.810829 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:46.942713 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:46.950168 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-71ee8a0d-c808-44f9-808a-693a6ed4fb73 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.152645 Apr 02 21:59:46.950744 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3562/7425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:46 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:47.967254 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:47.967891 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:47.975265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:47.975739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:47.976574 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:47.977043 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:48.112014 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:48.119519 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0a517cc3-63a0-4e77-9dfd-588330a8da77 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1701 microversion: 2.1 time: 0.156339 Apr 02 21:59:48.120106 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3864/7426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:47 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:49.136921 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:49.137540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:49.144355 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:49.144845 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:49.145621 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:49.146063 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:49.280021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:49.287756 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c4a2a5f8-bdfd-4c89-80fc-8d6ba670ee12 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1701 microversion: 2.1 time: 0.154420 Apr 02 21:59:49.288333 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3563/7427] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:49 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:50.306865 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:50.307541 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:50.315494 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:50.315977 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:50.316846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:50.317310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:50.468638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:50.478427 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-0b5a705f-a302-483b-973c-c190bf3d5008 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.177495 Apr 02 21:59:50.479138 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3865/7428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:50 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:51.498115 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:51.499409 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:51.510796 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:51.511414 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:51.512320 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:51.512893 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:51.667746 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:51.677181 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-090489f7-2401-46d7-88c2-33525cef2ef3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.183021 Apr 02 21:59:51.678088 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3564/7429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:51 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:52.436754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2ac1b3a7-0794-4748-a632-75c6613e172a req-996692c2-8389-480c-8752-59c0746a6253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "name": "network-vif-plugged", "status": "completed", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 21:59:52.452197 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2ac1b3a7-0794-4748-a632-75c6613e172a req-996692c2-8389-480c-8752-59c0746a6253 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:52.452787 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2ac1b3a7-0794-4748-a632-75c6613e172a req-996692c2-8389-480c-8752-59c0746a6253 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:52.482855 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2ac1b3a7-0794-4748-a632-75c6613e172a req-996692c2-8389-480c-8752-59c0746a6253 service nova] Creating event network-vif-plugged:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 21:59:52.496442 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2ac1b3a7-0794-4748-a632-75c6613e172a req-996692c2-8389-480c-8752-59c0746a6253 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063656 Apr 02 21:59:52.497636 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3866/7430] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 21:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 21:59:52.693956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:52.694717 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:52.701403 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:52.701866 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:52.702653 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:52.703130 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:52.858738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:52.880267 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fa0125bd-0674-4427-aebc-99efd09dad09 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.190320 Apr 02 21:59:52.880904 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3565/7431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:52 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:53.590871 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:59:53.591740 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:59:53.704044 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:59:53.704244 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 21:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:59:53.901278 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:53.902009 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:53.910360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:53.910981 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:53.912363 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:53.912995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:54.078886 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:54.087715 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9130db64-f520-4a99-bf4c-60b80a66a244 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.193347 Apr 02 21:59:54.088392 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3867/7432] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:53 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:54.129017 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 21:59:54.129773 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 21:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 21:59:55.108029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:55.108029 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:55.113896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:55.114378 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:55.115164 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:55.115614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:55.288897 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:55.297824 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-14369663-4af9-43b4-84a3-c4b412f74a78 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.196579 Apr 02 21:59:55.299034 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3566/7433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:55 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:56.316222 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:56.316834 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:56.324497 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:56.324681 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:56.325859 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:56.326392 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:56.487705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:56.496038 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a2cfb674-0b73-4579-8f63-90c9b379444b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.184715 Apr 02 21:59:56.505676 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3868/7434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:56 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:57.513953 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:57.515418 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:57.522819 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:57.523586 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:57.524656 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:57.525108 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:57.675282 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:57.683089 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-879a8012-c3b9-4332-a2ca-257626351c1b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.173438 Apr 02 21:59:57.683761 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3567/7435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:57 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:58.700955 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:58.701591 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:58.709732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:58.710335 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:58.711147 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:58.711602 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:58.872848 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 21:59:58.883662 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ee695220-051b-44a3-8e48-4127e20ca70a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1696 microversion: 2.1 time: 0.186959 Apr 02 21:59:58.884780 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3869/7436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:58 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 21:59:59.900255 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 21:59:59.900902 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 21:59:59.908426 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:59.908930 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 21:59:59.909700 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 21:59:59.910137 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:00.122121 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:00.130382 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-059becb9-60ff-429d-bbb1-8d868ef023ba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1678 microversion: 2.1 time: 0.233958 Apr 02 22:00:00.130966 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3568/7437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 21:59:59 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:01.147300 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:01.147982 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:01.155337 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:01.155804 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:01.156607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:01.157065 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:01.290758 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:01.298904 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-be3725dc-3087-44f1-bfbe-a000a84c679d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1678 microversion: 2.1 time: 0.155574 Apr 02 22:00:01.299685 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3870/7438] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:01 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:02.319292 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:02.320005 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:02.329052 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:02.330042 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:02.330964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:02.331396 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:02.476142 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:02.483614 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f85ea48-f499-44ec-8924-197aced1fef1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1681 microversion: 2.1 time: 0.169836 Apr 02 22:00:02.484187 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3569/7439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:02 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:02.500434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:00:02.501593 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:02.508297 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:02.508800 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:02.509579 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:02.510031 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:02.646832 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-7375e300-b6a1-4b6f-a925-56cc13eb2ba6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081/action" status: 202 len: 0 microversion: 2.1 time: 0.150314 Apr 02 22:00:02.647467 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3871/7440] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 22:00:02 2022] POST /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 22:00:02.656221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:02.656891 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:02.662992 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:02.663588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:02.664366 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:02.664830 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:02.818311 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:02.825950 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-dc3858af-597e-43ce-a60d-bc8c582f082a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1689 microversion: 2.1 time: 0.174103 Apr 02 22:00:02.826529 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3570/7441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:02 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:03.844838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:03.845478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:03.851533 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:03.852003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:03.852809 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:03.853263 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:03.990836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:03.998209 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-61cd547f-c2b5-4438-a40a-fb405e014740 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.158316 Apr 02 22:00:03.998784 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3872/7442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:03 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:04.417688 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-74252d59-f05a-48ad-a009-73720c992e30 req-5f73daf7-5221-41e5-a829-1d989c6d2220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "name": "network-vif-unplugged", "status": "completed", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:00:04.427915 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-74252d59-f05a-48ad-a009-73720c992e30 req-5f73daf7-5221-41e5-a829-1d989c6d2220 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:04.428334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-74252d59-f05a-48ad-a009-73720c992e30 req-5f73daf7-5221-41e5-a829-1d989c6d2220 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:04.445725 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-74252d59-f05a-48ad-a009-73720c992e30 req-5f73daf7-5221-41e5-a829-1d989c6d2220 service nova] Creating event network-vif-unplugged:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 22:00:04.456949 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-74252d59-f05a-48ad-a009-73720c992e30 req-5f73daf7-5221-41e5-a829-1d989c6d2220 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042661 Apr 02 22:00:04.458209 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3571/7443] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 22:00:05.015411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:05.016108 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:05.023415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:05.023889 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:05.024721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:05.025184 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:05.166079 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:05.173856 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-8c893c60-e63e-4b41-a91d-37878cefce96 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.162336 Apr 02 22:00:05.174507 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3873/7444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:05 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:06.193555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:06.194972 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:06.201530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:06.202072 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:06.202945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:06.203466 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:06.368233 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:06.375929 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e500589e-9c25-4650-882f-bf8450e527fd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.188263 Apr 02 22:00:06.376543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3572/7445] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:06 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:07.395826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:07.397272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:07.428478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:07.428478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:07.428478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:07.428478 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:07.590314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:07.599669 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-11c7368b-d5b4-4a61-9cc5-e9a525cbc2f5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.209660 Apr 02 22:00:07.612157 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3874/7446] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:07 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:08.622958 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:08.623940 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:08.633945 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:08.634415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:08.635271 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:08.635734 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:08.786531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:08.795542 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-96a8c3e0-dd06-49b1-b8cf-848593cde8dd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.178918 Apr 02 22:00:08.796444 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3573/7447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:08 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:09.815447 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:09.816084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:09.823951 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:09.824423 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:09.825261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:09.825722 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:09.986764 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:09.994438 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b875d6df-a430-4700-acf2-145d56716b1e tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.183497 Apr 02 22:00:09.995354 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3875/7448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:09 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:11.012989 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:11.013876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:11.020986 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:11.026103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:11.026103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:11.026103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:11.172536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:11.180687 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a4a0f4d2-e9aa-4a1b-afb8-2da452953fa3 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.172089 Apr 02 22:00:11.181270 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3574/7449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:11 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:12.198680 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:12.199353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:12.207723 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:12.208713 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:12.210256 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:12.211076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:12.375581 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:12.384540 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ea800701-206b-4cdb-aa6d-f056fbb2d879 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.189942 Apr 02 22:00:12.386948 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3876/7450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:12 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:13.403379 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:13.404004 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:13.411334 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:13.411795 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:13.412596 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:13.413045 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:13.566919 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:13.574514 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-763135df-fc52-4042-9e52-d13a3f681b3a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.175285 Apr 02 22:00:13.575090 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3575/7451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:13 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:14.591626 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:14.592284 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:14.599819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:14.600299 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:14.601131 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:14.601590 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:14.795097 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:14.803505 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-20a0c5b1-808b-40b4-a3e3-6d8f09620e88 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.215819 Apr 02 22:00:14.804093 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3877/7452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:14 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:15.821224 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:15.821763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:15.828752 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:15.829207 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:15.830813 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:15.831538 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:16.015526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:16.024614 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-49606198-174a-47e8-bce9-2a50f3db7094 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1687 microversion: 2.1 time: 0.207160 Apr 02 22:00:16.025657 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3576/7453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:15 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1687 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:17.045155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:00:17.045793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:00:17.053896 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:17.054372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:17.055179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:17.055638 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:17.187280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:00:17.195225 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cc47795f-4c9e-4bc6-a731-2c11731d1dd7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1674 microversion: 2.1 time: 0.154049 Apr 02 22:00:17.195799 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3878/7454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:00:17 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:00:18.563267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-178d2c5c-60ce-494e-a767-15c8e168658d req-fa4f8224-7658-422f-ab0c-8a63f75f616b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "name": "network-vif-plugged", "status": "completed", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:00:18.573219 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-178d2c5c-60ce-494e-a767-15c8e168658d req-fa4f8224-7658-422f-ab0c-8a63f75f616b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:00:18.573683 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-178d2c5c-60ce-494e-a767-15c8e168658d req-fa4f8224-7658-422f-ab0c-8a63f75f616b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:00:18.587853 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-178d2c5c-60ce-494e-a767-15c8e168658d req-fa4f8224-7658-422f-ab0c-8a63f75f616b service nova] Creating event network-vif-plugged:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 22:00:18.592899 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-178d2c5c-60ce-494e-a767-15c8e168658d req-fa4f8224-7658-422f-ab0c-8a63f75f616b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Apr 02 22:00:18.593695 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3577/7455] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:01:33.570076 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:33.570701 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:33.577338 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:33.577882 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:33.579425 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:33.579952 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:33.607846 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 22:01:33.626877 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-34796b35-1319-4c02-b3f1-a31f6d7339b9 req-b091c5dc-6203-4f6c-9e35-77d2e32a261d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:33.635120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-34796b35-1319-4c02-b3f1-a31f6d7339b9 req-b091c5dc-6203-4f6c-9e35-77d2e32a261d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:33.635576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-34796b35-1319-4c02-b3f1-a31f6d7339b9 req-b091c5dc-6203-4f6c-9e35-77d2e32a261d service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:33.647317 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-34796b35-1319-4c02-b3f1-a31f6d7339b9 req-b091c5dc-6203-4f6c-9e35-77d2e32a261d service nova] Creating event network-changed:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 22:01:33.653410 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-34796b35-1319-4c02-b3f1-a31f6d7339b9 req-b091c5dc-6203-4f6c-9e35-77d2e32a261d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087061 Apr 02 22:01:33.654389 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3578/7456] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 22:01:33.702131 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4c39f1b2-6fda-445f-8617-a9b7c3d17bba tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 204 len: 0 microversion: 2.1 time: 0.138294 Apr 02 22:01:33.703084 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3879/7457] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 22:01:33 2022] DELETE /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 22:01:33.717895 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:33.718736 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:33.725785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:33.726330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:33.727209 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:33.727719 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:34.004628 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:34.012800 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-47e84d89-5c6f-4f30-81fc-03c18bd84b69 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1680 microversion: 2.1 time: 0.304358 Apr 02 22:01:34.023863 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3579/7458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:33 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:34.238878 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:01:34.239095 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:01:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:01:35.032061 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:35.032798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:35.041476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:35.041943 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:35.042718 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:35.043169 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:35.186918 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:35.194402 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c1262264-313e-46da-958f-d1f1c36a237b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1561 microversion: 2.1 time: 0.166702 Apr 02 22:01:35.194973 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3880/7459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:35 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:35.750097 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-e2d1144e-b046-43dd-a61d-a1b5ab3869c1 req-84dcd484-0df2-4770-b984-847563c28128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e72dc18-fa7e-43df-a8c6-0728c086f081", "name": "network-vif-deleted", "tag": "d501e2f4-2fbd-412a-a285-0dc5601f2529"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:35.759964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e2d1144e-b046-43dd-a61d-a1b5ab3869c1 req-84dcd484-0df2-4770-b984-847563c28128 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:35.760432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-e2d1144e-b046-43dd-a61d-a1b5ab3869c1 req-84dcd484-0df2-4770-b984-847563c28128 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:35.773440 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-e2d1144e-b046-43dd-a61d-a1b5ab3869c1 req-84dcd484-0df2-4770-b984-847563c28128 service nova] Creating event network-vif-deleted:d501e2f4-2fbd-412a-a285-0dc5601f2529 for instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 on nch2-master-1 Apr 02 22:01:35.778654 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-e2d1144e-b046-43dd-a61d-a1b5ab3869c1 req-84dcd484-0df2-4770-b984-847563c28128 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Apr 02 22:01:35.779273 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3580/7460] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:01:36.211770 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:36.212434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:36.219526 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:36.220004 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:36.220857 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:36.221314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:36.252155 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:36.252669 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:36.253144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lazy-loading 'fault' on Instance uuid 6e72dc18-fa7e-43df-a8c6-0728c086f081 {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 22:01:36.296503 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:36.303816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5cb0e769-6ce9-4531-b8e5-6324c056dbc5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 200 len: 1336 microversion: 2.1 time: 0.095998 Apr 02 22:01:36.304393 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3881/7461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:36 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:37.322241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:37.322942 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 6e72dc18-fa7e-43df-a8c6-0728c086f081] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:37.329128 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:37.329584 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:37.330346 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:37.330791 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:37.344222 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] HTTP exception thrown: Instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 could not be found. Apr 02 22:01:37.344896 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Returning 404 to user: Instance 6e72dc18-fa7e-43df-a8c6-0728c086f081 could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 22:01:37.345720 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4b63ea0b-568d-4d00-ac8b-4ac743af2843 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081" status: 404 len: 111 microversion: 2.1 time: 0.028613 Apr 02 22:01:37.346250 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3581/7462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:37 2022] GET /compute/v2.1/servers/6e72dc18-fa7e-43df-a8c6-0728c086f081 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 22:01:37.505016 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16b196da-93d6-4957-bfe2-afba67d0b27a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '.version_select at 0x7f54d453e550>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:37.530065 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16b196da-93d6-4957-bfe2-afba67d0b27a tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1731586302" status: 202 len: 0 microversion: 2.1 time: 0.028695 Apr 02 22:01:37.530601 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3882/7463] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 22:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1731586302 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 22:01:37.549433 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2bc29245-ab7b-4081-8763-88d648bdd7f7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'create', calling method: .version_select at 0x7f54d4da3dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1110524133"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:37.563177 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2bc29245-ab7b-4081-8763-88d648bdd7f7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:01:37.568335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2bc29245-ab7b-4081-8763-88d648bdd7f7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for user d67b2d6324ec46ca91756e3a19dac4dd and project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:01:37.760387 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2bc29245-ab7b-4081-8763-88d648bdd7f7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:01:37.765588 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-2bc29245-ab7b-4081-8763-88d648bdd7f7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for user d67b2d6324ec46ca91756e3a19dac4dd and project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'key_pairs'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:01:37.780643 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2bc29245-ab7b-4081-8763-88d648bdd7f7 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.235091 Apr 02 22:01:37.781241 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3582/7464] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 22:01:37 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:41.210931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1613635839", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1110524133", "security_groups": [{"name": "tempest-secgroup-smoke-220472363"}], "networks": [{"uuid": "736cf116-b58d-41e4-9c8d-0139b33e2970"}], "block_device_mapping_v2": [{"uuid": "a8432b20-c21d-485c-b932-14a2746f4034", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:41.321436 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.network.neutron [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] validate_networks() for [('736cf116-b58d-41e4-9c8d-0139b33e2970', None, None, None, None, None)] {{(pid=136518) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 22:01:41.687173 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Flavor limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 22:01:41.687649 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Image limits 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 22:01:41.688175 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Flavor pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 22:01:41.688640 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Image pref 0:0:0 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 22:01:41.689103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.virt.hardware [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136518) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 22:01:41.697773 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:41.698245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:41.699070 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:41.699535 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:41.717229 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:01:41.723200 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Getting quotas for user d67b2d6324ec46ca91756e3a19dac4dd and project 6e33cf82705649d680da9a6bb1ecf1fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:01:41.779774 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Going to run 1 instances... {{(pid=136518) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 22:01:41.781940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8432b20-c21d-485c-b932-14a2746f4034',volume_size=None,volume_type=None)] {{(pid=136518) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 22:01:41.902768 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4dea3423-72b8-44fb-807b-a19381c41b93 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697075 Apr 02 22:01:41.903426 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3883/7465] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 22:01:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 22:01:41.914810 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-8576dead-cad3-4413-9bf2-96d7d9b0adea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:41.915432 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-8576dead-cad3-4413-9bf2-96d7d9b0adea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:41.969243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-8576dead-cad3-4413-9bf2-96d7d9b0adea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:41.976551 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-8576dead-cad3-4413-9bf2-96d7d9b0adea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1089 microversion: 2.1 time: 0.067139 Apr 02 22:01:41.977130 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3583/7466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:41 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:42.995179 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:42.995820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:43.005100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:43.005586 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:43.006472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:43.006861 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:43.068606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:43.076343 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-c6b0f379-ac03-4e59-86f3-455fbb626976 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1205 microversion: 2.1 time: 0.085941 Apr 02 22:01:43.076940 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3884/7467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:42 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1205 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:44.094249 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:44.094881 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:44.103221 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:44.103806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:44.104785 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:44.105254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:44.311718 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:44.320942 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-4a9faae0-fb65-4852-8cbf-99b0d10833e0 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.230524 Apr 02 22:01:44.321573 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3584/7468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:44 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:44.379558 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-d5f3ccf7-a0d4-4f93-a81c-08523272efc1 req-95325bcb-a29c-4dad-ac3f-81432f1fb388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:44.394506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d5f3ccf7-a0d4-4f93-a81c-08523272efc1 req-95325bcb-a29c-4dad-ac3f-81432f1fb388 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:44.395261 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-d5f3ccf7-a0d4-4f93-a81c-08523272efc1 req-95325bcb-a29c-4dad-ac3f-81432f1fb388 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:44.408176 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-d5f3ccf7-a0d4-4f93-a81c-08523272efc1 req-95325bcb-a29c-4dad-ac3f-81432f1fb388 service nova] Creating event network-changed:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:01:44.413914 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-d5f3ccf7-a0d4-4f93-a81c-08523272efc1 req-95325bcb-a29c-4dad-ac3f-81432f1fb388 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038239 Apr 02 22:01:44.415089 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3885/7469] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 22:01:45.339300 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:45.339882 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:45.346976 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:45.347521 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:45.348305 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:45.348841 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:45.662371 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:45.670100 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f327b6c6-244e-4bda-9139-71b0e762feaf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.334843 Apr 02 22:01:45.670674 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3585/7470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:45 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:46.688272 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:46.689023 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:46.695944 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:46.696419 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:46.697239 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:46.697699 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:46.830664 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:46.838759 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-001a4209-a413-4ce3-8cf4-42da60e45f3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.155668 Apr 02 22:01:46.839346 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3886/7471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:46 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:47.855310 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:47.855832 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:47.862740 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:47.863228 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:47.864557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:47.865003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:48.002872 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:48.010961 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-159b4a30-280a-480e-8ec4-38f78800d552 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.159659 Apr 02 22:01:48.011543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3586/7472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:47 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:49.028501 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:49.029162 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:49.036530 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:49.037003 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:49.037790 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:49.038251 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:49.185151 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:49.193159 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5d538bf2-ea6f-491c-ab99-6fe67708a9b4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.169244 Apr 02 22:01:49.193766 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3887/7473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:49 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:50.210113 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:50.210763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:50.217498 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:50.217955 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:50.219567 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:50.220037 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:50.356641 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:50.364204 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f19432f9-5dde-451e-86d2-3e6432bcba75 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.158066 Apr 02 22:01:50.364819 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3587/7474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:50 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:51.085659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-773ca7bc-fba1-4f23-a0dd-b4050c990f86 req-a5b4d663-2e0a-4449-9e8e-455ba927aee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "name": "network-vif-plugged", "status": "completed", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:51.094969 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-773ca7bc-fba1-4f23-a0dd-b4050c990f86 req-a5b4d663-2e0a-4449-9e8e-455ba927aee7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:51.095444 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-773ca7bc-fba1-4f23-a0dd-b4050c990f86 req-a5b4d663-2e0a-4449-9e8e-455ba927aee7 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:51.106959 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-773ca7bc-fba1-4f23-a0dd-b4050c990f86 req-a5b4d663-2e0a-4449-9e8e-455ba927aee7 service nova] Creating event network-vif-plugged:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:01:51.112063 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-773ca7bc-fba1-4f23-a0dd-b4050c990f86 req-a5b4d663-2e0a-4449-9e8e-455ba927aee7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091359 Apr 02 22:01:51.112750 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3888/7475] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:01:51.381544 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:51.382103 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:51.388844 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:51.389297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:51.390065 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:51.390506 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:51.524634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:51.532464 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e24cb9a4-9c04-4ad5-8f5b-6c069fd394cc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1260 microversion: 2.1 time: 0.155371 Apr 02 22:01:51.533039 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3588/7476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:51 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:52.550584 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:52.551829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:52.558267 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:52.558732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:52.559506 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:52.559961 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:52.693851 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:52.701344 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2bb848ba-1c81-42bc-bcd2-54a95a3bb36d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1444 microversion: 2.1 time: 0.155878 Apr 02 22:01:52.701923 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3889/7477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:52 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:52.717679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:01:52.718243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:01:52.725520 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:52.725979 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:52.726760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:52.727217 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:52.858853 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:01:52.866939 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d453abfa-8b9b-4939-8a6d-8365f027a155 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1444 microversion: 2.1 time: 0.153174 Apr 02 22:01:52.867523 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3589/7478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:01:52 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:01:54.546490 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-78c49510-b5b1-4494-b414-875e38702ae4 req-a089482a-69ec-4cab-bc82-0992ecbda99e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:01:54.555237 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-78c49510-b5b1-4494-b414-875e38702ae4 req-a089482a-69ec-4cab-bc82-0992ecbda99e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:01:54.555700 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-78c49510-b5b1-4494-b414-875e38702ae4 req-a089482a-69ec-4cab-bc82-0992ecbda99e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:01:54.567516 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-78c49510-b5b1-4494-b414-875e38702ae4 req-a089482a-69ec-4cab-bc82-0992ecbda99e service nova] Creating event network-changed:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:01:54.572624 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-78c49510-b5b1-4494-b414-875e38702ae4 req-a089482a-69ec-4cab-bc82-0992ecbda99e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085453 Apr 02 22:01:54.573407 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3890/7479] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:04:01.687151 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 22:04:01.688089 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 22:04:01.745904 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:04:01.746540 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:01.752522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:01.752981 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:01.753763 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:01.754210 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:01.777154 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.objects.instance [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lazy-loading 'flavor' on Instance uuid 101fe249-230b-488e-b4d7-4e662f5ba442 {{(pid=136517) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 22:04:01.845626 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cdaa1cc6-f1b4-451d-a984-13f751820baf tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442/action" status: 202 len: 0 microversion: 2.1 time: 0.160282 Apr 02 22:04:01.846545 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3590/7480] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 22:04:01 2022] POST /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 22:04:01.852924 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 22:04:01.853930 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 22:04:01.858227 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:01.858935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:01.865724 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:01.866199 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:01.866984 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:01.867893 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:02.025207 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:02.033298 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-23afb8ec-f66c-452a-865b-0450b58e4210 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.182477 Apr 02 22:04:02.033896 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3891/7481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:01 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:03.054531 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:03.055244 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:03.063297 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:03.063761 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:03.064583 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:03.065031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:03.081998 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44260. Apr 02 22:04:03.082721 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44262. Apr 02 22:04:03.201934 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:03.209432 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-d705f6b9-3023-4de5-86c5-e3a992469b3b tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.160755 Apr 02 22:04:03.210007 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3591/7482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:03 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:04.226687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:04.227314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:04.236613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:04.237082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:04.237873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:04.238327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:04.244230 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44268. Apr 02 22:04:04.245007 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44266. Apr 02 22:04:04.383998 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:04.392942 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9a3f6cde-6964-4190-9b35-5ba51d6fd2f9 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.170217 Apr 02 22:04:04.393521 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3892/7483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:04 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:05.410565 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:05.411289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:05.420738 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:05.421234 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:05.423503 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:05.423950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:05.569319 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:05.577409 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e9979eaa-a0bd-43d8-8bf8-840e66947806 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.170767 Apr 02 22:04:05.577967 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3592/7484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:05 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:06.594311 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:06.594971 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:06.601819 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:06.602285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:06.603069 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:06.603519 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:06.734601 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:06.742099 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-1debf35d-c7b9-4c5f-9b4a-73d6c73091aa tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.151702 Apr 02 22:04:06.742679 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3893/7485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:06 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:07.759324 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:07.759894 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:07.767303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:07.767760 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:07.768554 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:07.769002 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:07.900863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:07.908534 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2b1aa87d-cfda-466e-88b1-4769b0b3ee31 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.153174 Apr 02 22:04:07.909101 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3593/7486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:07 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:08.926606 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:08.927240 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:08.934618 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:08.935093 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:08.935895 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:08.936376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:09.074705 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:09.082143 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-178bffd8-600e-42fe-a638-913651fdedcc tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.159514 Apr 02 22:04:09.082709 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3894/7487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:08 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:10.099044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:10.099707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:10.106842 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:10.107307 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:10.108089 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:10.108640 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:10.245467 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:10.252962 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6869a8e3-b7be-40e6-9790-8f39e71d5d2c tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.157781 Apr 02 22:04:10.253543 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3594/7488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:10 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:11.269847 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:11.270476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:11.277554 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:11.278548 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:11.279333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:11.279793 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:11.411567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:11.419629 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-5b5321bc-1347-491e-92d3-070a632ad5e5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.153742 Apr 02 22:04:11.420207 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3895/7489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:11 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:12.437831 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:12.438489 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:12.445571 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:12.446034 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:12.446827 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:12.447296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:12.658168 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:12.665637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-311a9c42-309e-4e63-a727-e14aac43da4d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.232477 Apr 02 22:04:12.666208 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3595/7490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:12 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:13.684487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:13.685122 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:13.691927 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:13.692398 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:13.693219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:13.693685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:13.829241 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:13.836733 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6ccbcef7-3716-474d-8b0f-499260ab801d tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.156747 Apr 02 22:04:13.837315 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3896/7491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:13 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:14.853027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:14.853649 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:14.860507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:14.860968 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:14.861741 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:14.862186 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:14.996330 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:15.004604 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9ed3b3cd-7146-4901-9769-68d3e0847ba4 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1569 microversion: 2.1 time: 0.155344 Apr 02 22:04:15.005188 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3596/7492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:14 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:15.022810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:04:15.023438 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:15.031132 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:15.031612 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:15.032408 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:15.032901 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:15.114643 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [83abd5d2-476e-4140-a209-bac59856a25e] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 22:04:16.122461 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [83abd5d2-476e-4140-a209-bac59856a25e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44294. Apr 02 22:04:16.125605 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-16de89fa-931d-4c72-b626-9b9e44ae6429 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "POST /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442/action" status: 202 len: 0 microversion: 2.1 time: 1.107882 Apr 02 22:04:16.126241 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3897/7493] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 22:04:15 2022] POST /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442/action => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 22:04:16.134401 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:16.135016 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:16.141994 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:16.142451 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:16.143222 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:16.143661 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:16.321821 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:16.329880 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5c997e1d-adb5-470d-a994-ac0752d6b0e6 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1517 microversion: 2.1 time: 0.199299 Apr 02 22:04:16.330463 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3597/7494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:16 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:17.348276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:17.348940 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:17.356828 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:17.357310 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:17.358111 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:17.358577 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:17.509411 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:17.517816 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6905c384-6eab-4175-a7c9-fcd4866a17bb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1519 microversion: 2.1 time: 0.174262 Apr 02 22:04:17.518411 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3898/7495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:17 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:18.537950 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:18.539003 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:18.548722 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:18.549185 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:18.550602 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:18.551139 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:18.769267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:18.777016 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-89c60ca6-c204-49a5-95e6-f10b8834f3ab tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1575 microversion: 2.1 time: 0.243410 Apr 02 22:04:18.777706 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3598/7496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:18 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:19.647242 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-2d07bf8a-fbaa-441a-a60b-4f672e184395 req-f5e16555-86ad-4ed2-8d1c-4581df11053a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "name": "network-vif-unplugged", "status": "completed", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:04:19.657327 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2d07bf8a-fbaa-441a-a60b-4f672e184395 req-f5e16555-86ad-4ed2-8d1c-4581df11053a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:19.657798 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-2d07bf8a-fbaa-441a-a60b-4f672e184395 req-f5e16555-86ad-4ed2-8d1c-4581df11053a service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:19.670642 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-2d07bf8a-fbaa-441a-a60b-4f672e184395 req-f5e16555-86ad-4ed2-8d1c-4581df11053a service nova] Creating event network-vif-unplugged:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:04:19.675765 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-2d07bf8a-fbaa-441a-a60b-4f672e184395 req-f5e16555-86ad-4ed2-8d1c-4581df11053a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032295 Apr 02 22:04:19.676382 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3899/7497] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:04:19.795135 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:19.795786 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:19.802665 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:19.803131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:19.803906 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:19.804351 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:19.940023 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:19.947519 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-a260e6a5-7027-42f1-97ca-ae6d8eebcfd5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1575 microversion: 2.1 time: 0.156319 Apr 02 22:04:19.948096 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3599/7498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:19 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:20.965084 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:20.966420 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:20.973691 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:20.974166 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:20.974948 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:20.975397 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:21.116368 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:21.124074 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3aa1a589-c475-4612-8ba0-5f292fb2ac11 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1575 microversion: 2.1 time: 0.163559 Apr 02 22:04:21.124692 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3900/7499] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:20 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:22.143122 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:04:22.143733 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:04:22.150507 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:22.150963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:22.151990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:22.152428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:22.285673 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:04:22.293204 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-7d373271-1501-46e8-acb7-dd539669cbbd tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1562 microversion: 2.1 time: 0.153990 Apr 02 22:04:22.293774 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3600/7500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:04:22 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:04:25.732139 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-3f9050ff-5619-48ad-a2e7-b8fe84bf101e req-fac55204-1f6b-47d3-a433-3d74274a59a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "name": "network-vif-plugged", "status": "completed", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:04:25.741260 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3f9050ff-5619-48ad-a2e7-b8fe84bf101e req-fac55204-1f6b-47d3-a433-3d74274a59a1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:04:25.741712 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-3f9050ff-5619-48ad-a2e7-b8fe84bf101e req-fac55204-1f6b-47d3-a433-3d74274a59a1 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:04:25.752808 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-3f9050ff-5619-48ad-a2e7-b8fe84bf101e req-fac55204-1f6b-47d3-a433-3d74274a59a1 service nova] Creating event network-vif-plugged:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:04:25.757821 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-3f9050ff-5619-48ad-a2e7-b8fe84bf101e req-fac55204-1f6b-47d3-a433-3d74274a59a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029459 Apr 02 22:04:25.758444 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3901/7501] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:04:53.608538 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:04:53.609192 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:04:54.140437 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:04:54.140892 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:04:54.249131 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:04:54.249324 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:06:06.929199 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 22:06:06.930260 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:06.930769 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:06.931196 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 02 22:06:06.935903 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-1cec924e-0224-48a9-8edc-61e145021ff0 req-63e9427f-1425-4c73-9c0a-6ca3c8465218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:06.938243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:06.938706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:06.939577 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:06.940021 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:06.946099 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1cec924e-0224-48a9-8edc-61e145021ff0 req-63e9427f-1425-4c73-9c0a-6ca3c8465218 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:06.947052 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-1cec924e-0224-48a9-8edc-61e145021ff0 req-63e9427f-1425-4c73-9c0a-6ca3c8465218 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:06.957611 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-1cec924e-0224-48a9-8edc-61e145021ff0 req-63e9427f-1425-4c73-9c0a-6ca3c8465218 service nova] Creating event network-changed:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:06:06.962996 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-1cec924e-0224-48a9-8edc-61e145021ff0 req-63e9427f-1425-4c73-9c0a-6ca3c8465218 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035665 Apr 02 22:06:06.964088 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3902/7502] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 22:06:06.966091 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Going to try to terminate instance {{(pid=136517) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 22:06:07.056162 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "DELETE /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 204 len: 0 microversion: 2.1 time: 0.131043 Apr 02 22:06:07.056840 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3601/7503] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 22:06:06 2022] DELETE /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 22:06:07.067853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:07.068685 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:07.075384 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:07.076204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:07.077276 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:07.078159 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:07.301472 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:07.309845 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-02b224ce-0ff8-414e-8556-fadc141a75ea tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1568 microversion: 2.1 time: 0.248083 Apr 02 22:06:07.317776 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3903/7504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:07 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:08.328619 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:08.329254 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:08.336386 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:08.336874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:08.337654 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:08.338106 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:08.521420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:08.529392 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-2db00926-f7fb-4ccc-a2bb-6468a0cdf917 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1450 microversion: 2.1 time: 0.205897 Apr 02 22:06:08.529980 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3602/7505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:08 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:09.547333 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:09.548628 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:09.561702 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:09.563315 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:09.564154 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:09.564641 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:09.571615 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7bddcac-044b-404b-b1d4-bd644ba220ec] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44408. Apr 02 22:06:09.575528 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] [225caef5-4bec-43ce-abc0-5002c56a86ef] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 44410. Apr 02 22:06:09.725280 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd67b2d6324ec46ca91756e3a19dac4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e33cf82705649d680da9a6bb1ecf1fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:09.733593 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-af0218ff-b503-4ae4-88c1-084756a04acb tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 200 len: 1450 microversion: 2.1 time: 0.189731 Apr 02 22:06:09.742331 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3904/7506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:09 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 1450 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:09.760039 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-ecf330b2-4314-4b78-9029-be196e755062 req-9a844bdc-e2d9-45f1-b5f2-9ac9823c2926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "101fe249-230b-488e-b4d7-4e662f5ba442", "name": "network-vif-deleted", "tag": "b8af4d15-7e2c-43db-a985-f307cf3fe1fb"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:09.770576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ecf330b2-4314-4b78-9029-be196e755062 req-9a844bdc-e2d9-45f1-b5f2-9ac9823c2926 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:09.771046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-ecf330b2-4314-4b78-9029-be196e755062 req-9a844bdc-e2d9-45f1-b5f2-9ac9823c2926 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:09.782997 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-ecf330b2-4314-4b78-9029-be196e755062 req-9a844bdc-e2d9-45f1-b5f2-9ac9823c2926 service nova] Creating event network-vif-deleted:b8af4d15-7e2c-43db-a985-f307cf3fe1fb for instance 101fe249-230b-488e-b4d7-4e662f5ba442 on nch2-master-1 Apr 02 22:06:09.788146 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-ecf330b2-4314-4b78-9029-be196e755062 req-9a844bdc-e2d9-45f1-b5f2-9ac9823c2926 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Apr 02 22:06:09.788802 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3603/7507] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:06:10.749941 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:10.750570 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] [instance: 101fe249-230b-488e-b4d7-4e662f5ba442] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:10.757346 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:10.757820 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:10.758613 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:10.759066 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:10.772822 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.wsgi [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] HTTP exception thrown: Instance 101fe249-230b-488e-b4d7-4e662f5ba442 could not be found. Apr 02 22:06:10.773445 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Returning 404 to user: Instance 101fe249-230b-488e-b4d7-4e662f5ba442 could not be found. {{(pid=136518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 22:06:10.774286 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-96f528d3-cc28-4a02-a22c-94619bc906c5 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442" status: 404 len: 111 microversion: 2.1 time: 0.028294 Apr 02 22:06:10.774808 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3905/7508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:10 2022] GET /compute/v2.1/servers/101fe249-230b-488e-b4d7-4e662f5ba442 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 22:06:10.930363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-0b20dab3-4d9f-4af2-844b-821c97b5b5b1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] Calling method '.version_select at 0x7f54c78e15e0>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:10.956706 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-0b20dab3-4d9f-4af2-844b-821c97b5b5b1 tempest-TestShelveInstance-232604610 tempest-TestShelveInstance-232604610-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1110524133" status: 202 len: 0 microversion: 2.1 time: 0.031438 Apr 02 22:06:10.960599 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3604/7509] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 22:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1110524133 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 22:06:28.749659 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-bc56d32e-ec91-49c2-9856-65d87349dfc5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Action: 'create', calling method: .version_select at 0x7f54d45bdc10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-692673035"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:28.767434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bc56d32e-ec91-49c2-9856-65d87349dfc5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:06:28.774148 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bc56d32e-ec91-49c2-9856-65d87349dfc5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for user 57d4061c7eef439ba5fd20abb4c4c447 and project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:06:29.227487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bc56d32e-ec91-49c2-9856-65d87349dfc5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:06:29.232362 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.quota [None req-bc56d32e-ec91-49c2-9856-65d87349dfc5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for user 57d4061c7eef439ba5fd20abb4c4c447 and project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'key_pairs'} {{(pid=136518) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:06:29.246583 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-bc56d32e-ec91-49c2-9856-65d87349dfc5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.713577 Apr 02 22:06:29.247180 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3906/7510] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Apr 2 22:06:28 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:30.151202 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1768066058", "imageRef": "9e007d99-9b87-492c-9398-c1bd6aff27cb", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-692673035", "security_groups": [{"name": "tempest-secgroup-smoke-2048179443"}], "networks": [{"uuid": "70d3c8a8-cce5-4dfb-9dd5-95e4c4210931"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:30.271148 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] validate_networks() for [('70d3c8a8-cce5-4dfb-9dd5-95e4c4210931', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 22:06:30.764473 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 22:06:30.764949 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 22:06:30.765439 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 22:06:30.766465 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 22:06:30.766954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 22:06:30.775805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:30.776267 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:30.777127 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:30.777851 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:30.797818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:06:30.803066 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for user 57d4061c7eef439ba5fd20abb4c4c447 and project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:06:30.816582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 22:06:30.819047 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e007d99-9b87-492c-9398-c1bd6aff27cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 22:06:30.868813 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-055ed885-007d-4f23-822e-efa9eb8d708b tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.721767 Apr 02 22:06:30.869804 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3605/7511] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 22:06:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 22:06:30.882738 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-86a19c66-c78e-43e7-9176-261065b34ad5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:30.883721 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-86a19c66-c78e-43e7-9176-261065b34ad5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:30.939205 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-86a19c66-c78e-43e7-9176-261065b34ad5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:30.946573 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-86a19c66-c78e-43e7-9176-261065b34ad5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1248 microversion: 2.1 time: 0.071067 Apr 02 22:06:30.947267 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3907/7512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:30 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 22:06:31.967381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:31.967381 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:31.972721 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:31.974843 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:31.975868 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:31.976561 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:32.069963 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:32.079645 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-6f693dc5-0b6a-4c80-81b5-eded942acb68 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1308 microversion: 2.1 time: 0.120117 Apr 02 22:06:32.080812 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3606/7513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:31 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:33.096762 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:33.097415 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:33.104746 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:33.105216 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:33.106024 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:33.106476 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:33.272543 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:33.280741 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ae38e6f9-5554-4543-9687-22727522b191 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1374 microversion: 2.1 time: 0.187828 Apr 02 22:06:33.281316 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3908/7514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:33 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:33.511697 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-085d6bfd-7609-4528-8443-a8c23afb9a62 req-1537fa71-e65b-48e2-9ac5-08e0903df2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:33.520027 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-085d6bfd-7609-4528-8443-a8c23afb9a62 req-1537fa71-e65b-48e2-9ac5-08e0903df2bf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:33.520716 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-085d6bfd-7609-4528-8443-a8c23afb9a62 req-1537fa71-e65b-48e2-9ac5-08e0903df2bf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:33.534609 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-085d6bfd-7609-4528-8443-a8c23afb9a62 req-1537fa71-e65b-48e2-9ac5-08e0903df2bf service nova] Creating event network-changed:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:06:33.539956 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-085d6bfd-7609-4528-8443-a8c23afb9a62 req-1537fa71-e65b-48e2-9ac5-08e0903df2bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122255 Apr 02 22:06:33.540983 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3607/7515] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:06:34.298605 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:34.299136 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:34.305992 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:34.306456 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:34.307401 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:34.307863 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:34.456791 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:34.464924 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-165bdb7a-20f9-428c-8ba5-d8e9e53b7e06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1374 microversion: 2.1 time: 0.171573 Apr 02 22:06:34.465801 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3909/7516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:34 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:35.484587 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:35.485309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:35.492681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:35.493146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:35.493937 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:35.494420 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:35.630637 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:35.638177 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-cb1de496-9f3d-447f-8147-2ea7ab461158 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1374 microversion: 2.1 time: 0.159625 Apr 02 22:06:35.638759 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3608/7517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:35 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:36.655617 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:36.656245 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:36.663470 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:36.663930 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:36.664763 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:36.665219 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:36.803168 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:36.810820 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-19dccda5-6d72-40d5-aa01-8574f96d023e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1374 microversion: 2.1 time: 0.159490 Apr 02 22:06:36.811408 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3910/7518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:36 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:37.827753 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:37.828910 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:37.835613 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:37.836075 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:37.836884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:37.837335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:37.974309 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:37.981687 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-afeaa36b-1152-46b9-9925-06bbf7c292a9 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1374 microversion: 2.1 time: 0.157811 Apr 02 22:06:37.982258 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3609/7519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:37 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:38.273021 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-c2e71164-a0ab-4515-9399-e668883ebeb9 req-5784a4f7-6a50-467d-a91a-0a5d4f74df2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "name": "network-vif-plugged", "status": "completed", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:38.285033 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c2e71164-a0ab-4515-9399-e668883ebeb9 req-5784a4f7-6a50-467d-a91a-0a5d4f74df2b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:38.285856 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-c2e71164-a0ab-4515-9399-e668883ebeb9 req-5784a4f7-6a50-467d-a91a-0a5d4f74df2b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:38.297212 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-c2e71164-a0ab-4515-9399-e668883ebeb9 req-5784a4f7-6a50-467d-a91a-0a5d4f74df2b service nova] Creating event network-vif-plugged:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:06:38.302234 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-c2e71164-a0ab-4515-9399-e668883ebeb9 req-5784a4f7-6a50-467d-a91a-0a5d4f74df2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Apr 02 22:06:38.302999 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3911/7520] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:06:38.998834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:38.999460 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:39.006367 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:39.006826 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:39.007599 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:39.008044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:39.143452 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:39.151537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-9d5221fb-62eb-42f0-a57c-5deebc51138d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1374 microversion: 2.1 time: 0.156605 Apr 02 22:06:39.152127 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3610/7521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:38 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:40.171376 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:40.172650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:40.179149 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:40.179621 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:40.180404 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:40.180888 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:40.319926 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:40.327524 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ddeb3bda-3fd3-4bc0-8d91-41015ac9deab tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1559 microversion: 2.1 time: 0.161811 Apr 02 22:06:40.328135 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3912/7522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:40 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:40.343515 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:06:40.344708 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:06:40.351573 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:40.352031 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:40.352863 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:40.353312 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:40.487707 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:06:40.495150 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-09aa22d4-01a9-4e43-a836-7d899ac07823 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1559 microversion: 2.1 time: 0.155503 Apr 02 22:06:40.495725 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3611/7523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:06:40 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:06:42.150153 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-09e032e9-b15f-4226-af1d-bb35ac14eba5 req-6ee3d6d5-c6e4-482b-949d-53c71002a655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:06:42.159695 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-09e032e9-b15f-4226-af1d-bb35ac14eba5 req-6ee3d6d5-c6e4-482b-949d-53c71002a655 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:06:42.160937 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-09e032e9-b15f-4226-af1d-bb35ac14eba5 req-6ee3d6d5-c6e4-482b-949d-53c71002a655 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:06:42.175125 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-09e032e9-b15f-4226-af1d-bb35ac14eba5 req-6ee3d6d5-c6e4-482b-949d-53c71002a655 service nova] Creating event network-changed:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:06:42.180974 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-09e032e9-b15f-4226-af1d-bb35ac14eba5 req-6ee3d6d5-c6e4-482b-949d-53c71002a655 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Apr 02 22:06:42.182269 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3913/7524] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:08:39.628807 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1549818183"}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:08:39.629951 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:39.635990 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:39.636447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:39.637243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:39.637681 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:39.905938 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-febdea52-1066-4511-8f1f-733fbba69a06 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "POST /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf/action" status: 202 len: 0 microversion: 2.1 time: 0.282107 Apr 02 22:08:39.906596 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3612/7525] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 22:08:39 2022] POST /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 22:08:44.979949 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-bf31aa3a-4c73-412e-b293-2e515d46cbb8 req-cf6314fb-e843-463c-b20c-503b11ecf14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "name": "network-vif-plugged", "status": "completed", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:08:45.005779 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bf31aa3a-4c73-412e-b293-2e515d46cbb8 req-cf6314fb-e843-463c-b20c-503b11ecf14f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:45.006524 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-bf31aa3a-4c73-412e-b293-2e515d46cbb8 req-cf6314fb-e843-463c-b20c-503b11ecf14f service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:45.019677 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-bf31aa3a-4c73-412e-b293-2e515d46cbb8 req-cf6314fb-e843-463c-b20c-503b11ecf14f service nova] Creating event network-vif-plugged:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:08:45.025369 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-bf31aa3a-4c73-412e-b293-2e515d46cbb8 req-cf6314fb-e843-463c-b20c-503b11ecf14f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120358 Apr 02 22:08:45.029440 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3914/7526] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:08:53.427634 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1422518518", "imageRef": "65a09c55-7bf5-4aa6-9c92-e6b1c3080c5b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-692673035", "security_groups": [{"name": "tempest-secgroup-smoke-2048179443"}], "networks": [{"uuid": "70d3c8a8-cce5-4dfb-9dd5-95e4c4210931"}]}} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:08:53.544296 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.network.neutron [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] validate_networks() for [('70d3c8a8-cce5-4dfb-9dd5-95e4c4210931', None, None, None, None, None)] {{(pid=136517) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 02 22:08:53.908576 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Flavor limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 02 22:08:53.909010 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Image limits 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 02 22:08:53.909536 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Flavor pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 02 22:08:53.909956 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Image pref 0:0:0 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 02 22:08:53.910377 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.virt.hardware [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136517) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 02 22:08:53.919522 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:53.919983 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:53.920846 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:53.921365 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:53.938020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 02 22:08:53.943775 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.quota [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Getting quotas for user 57d4061c7eef439ba5fd20abb4c4c447 and project 4b882d9c90ca4758aab82bb7f2db9dc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136517) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 02 22:08:53.956020 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Going to run 1 instances... {{(pid=136517) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 02 22:08:53.959169 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65a09c55-7bf5-4aa6-9c92-e6b1c3080c5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136517) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 02 22:08:54.004680 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-f88f680a-bac2-43f6-a881-a5f3500c291e tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.582380 Apr 02 22:08:54.005333 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3613/7527] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Apr 2 22:08:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 02 22:08:54.017210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-703e5f22-9d7b-4758-92f1-91aae029b87a tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:08:54.017935 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-703e5f22-9d7b-4758-92f1-91aae029b87a tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:54.072650 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-703e5f22-9d7b-4758-92f1-91aae029b87a tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:08:54.079542 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-703e5f22-9d7b-4758-92f1-91aae029b87a tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1248 microversion: 2.1 time: 0.067801 Apr 02 22:08:54.080123 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3915/7528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:08:54 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1248 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:08:55.098484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:08:55.099131 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:55.107050 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:55.107525 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:55.108298 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:55.109278 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:55.194756 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:08:55.202708 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-bd637172-6bdb-401c-889f-985aa25965ce tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1308 microversion: 2.1 time: 0.109693 Apr 02 22:08:55.203359 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3614/7529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:08:55 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:08:56.223124 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:08:56.223824 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:56.233812 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:56.234294 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:56.235100 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:56.235567 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:56.418103 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:08:56.427444 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ef2d5443-8377-4002-854f-8602fd727119 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.210018 Apr 02 22:08:56.439183 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3916/7530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:08:56 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:08:56.915965 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-92426b93-0b15-43a3-aa36-0dabc06806fb req-5c724898-d00a-4d40-aa51-6a2a80c1b98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "name": "network-vif-unplugged", "status": "completed", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:08:56.933404 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-92426b93-0b15-43a3-aa36-0dabc06806fb req-5c724898-d00a-4d40-aa51-6a2a80c1b98e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:56.933954 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-92426b93-0b15-43a3-aa36-0dabc06806fb req-5c724898-d00a-4d40-aa51-6a2a80c1b98e service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:56.950403 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-92426b93-0b15-43a3-aa36-0dabc06806fb req-5c724898-d00a-4d40-aa51-6a2a80c1b98e service nova] Creating event network-vif-unplugged:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:08:56.956911 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-92426b93-0b15-43a3-aa36-0dabc06806fb req-5c724898-d00a-4d40-aa51-6a2a80c1b98e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044008 Apr 02 22:08:56.957542 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3615/7531] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:08:57.446629 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:08:57.447274 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:57.454651 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:57.455434 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:57.456442 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:57.457557 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:57.611210 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:08:57.620787 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-867a8b91-d66e-47de-8f50-1071ac48b0e6 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.177977 Apr 02 22:08:57.621586 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3917/7532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:08:57 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 02 22:08:58.642737 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:08:58.643492 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:58.650614 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:58.651070 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:58.651876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:58.652314 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:58.803582 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:08:58.811606 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-ec8b839e-b75f-43f7-b3f8-8619122ec2f4 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.176023 Apr 02 22:08:58.812555 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3616/7533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:08:58 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:08:59.829916 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:08:59.831374 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:08:59.839286 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:59.839836 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:59.840739 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:08:59.841265 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:08:59.992372 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:00.000964 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-ab7673ce-ed02-432a-88e2-9100c165b3a7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.176107 Apr 02 22:09:00.010556 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3918/7534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:08:59 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:01.061303 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:01.062431 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:01.075380 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:01.076230 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:01.081557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:01.081557 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:01.248447 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:01.257734 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-c3437ea6-18d0-4754-bf39-4d4b748dfdf7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.235862 Apr 02 22:09:01.269327 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3617/7535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:01 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:02.274195 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:02.274838 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:02.282191 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:02.282665 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:02.283458 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:02.283919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:02.424357 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:02.434168 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-b02952ad-9f8e-4a4b-a391-8d6883c3418f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.163670 Apr 02 22:09:02.435222 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3919/7536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:02 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:03.451943 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:03.452625 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:03.458792 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:03.459250 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:03.460024 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:03.460485 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:03.593510 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:03.601337 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e256ea84-e9e8-42e5-94b2-f4f91c3597ee tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.153489 Apr 02 22:09:03.601915 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3618/7537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:03 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:04.310314 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [req-0975b848-4015-450d-a869-a51870874d95 req-d787cc03-cfd8-4a81-bb91-b27228110686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:09:04.322913 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0975b848-4015-450d-a869-a51870874d95 req-d787cc03-cfd8-4a81-bb91-b27228110686 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:04.324487 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [req-0975b848-4015-450d-a869-a51870874d95 req-d787cc03-cfd8-4a81-bb91-b27228110686 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:04.339435 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.compute.server_external_events [req-0975b848-4015-450d-a869-a51870874d95 req-d787cc03-cfd8-4a81-bb91-b27228110686 service nova] Creating event network-changed:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:09:04.344911 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [req-0975b848-4015-450d-a869-a51870874d95 req-d787cc03-cfd8-4a81-bb91-b27228110686 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042368 Apr 02 22:09:04.345783 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3920/7538] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:09:04.618805 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:04.619430 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:04.626080 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:04.626550 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:04.627335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:04.627788 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:04.846484 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:04.855637 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5fe67f3a-84f1-4811-9312-d523c8f0c7e5 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.240651 Apr 02 22:09:04.860499 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3619/7539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:04 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:05.874831 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:05.875471 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:05.881810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:05.882285 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:05.883075 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:05.883540 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:06.039468 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:06.047423 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-28ea9df7-11ae-47a1-9c7c-956f00ce4654 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.177770 Apr 02 22:09:06.048547 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3921/7540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:05 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:07.064555 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:07.065313 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:07.073337 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:07.073852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:07.074663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:07.075076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:07.211798 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:07.220210 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-b9007ddb-7498-4ea6-9e51-aa813dda8d22 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.159434 Apr 02 22:09:07.220845 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3620/7541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:07 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:08.237678 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:08.238931 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:08.245729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:08.246204 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:08.246995 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:08.247457 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:08.380802 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:08.388237 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-2cd62182-1b99-4a1f-ac65-9d83137c7f58 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.154560 Apr 02 22:09:08.388848 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3922/7542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:08 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:09.003179 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3e23b280-5bff-4317-a9a4-e1f76c4ea269 req-1cf175fe-d151-4321-aa50-81d6a4093d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "name": "network-vif-plugged", "status": "completed", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:09:09.013864 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3e23b280-5bff-4317-a9a4-e1f76c4ea269 req-1cf175fe-d151-4321-aa50-81d6a4093d72 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:09.014316 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3e23b280-5bff-4317-a9a4-e1f76c4ea269 req-1cf175fe-d151-4321-aa50-81d6a4093d72 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:09.025723 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3e23b280-5bff-4317-a9a4-e1f76c4ea269 req-1cf175fe-d151-4321-aa50-81d6a4093d72 service nova] Creating event network-vif-plugged:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:09:09.031123 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3e23b280-5bff-4317-a9a4-e1f76c4ea269 req-1cf175fe-d151-4321-aa50-81d6a4093d72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031685 Apr 02 22:09:09.031738 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3621/7543] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:09:09.410359 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:09.410950 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:09.417729 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:09.418203 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:09.418988 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:09.419446 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:09.563610 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:09.571064 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-3b62d33f-5c87-4622-bac2-d69b9c57747f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1374 microversion: 2.1 time: 0.165236 Apr 02 22:09:09.571641 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3923/7544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:09 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:10.588679 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:10.589294 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:10.595569 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:10.596028 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:10.596834 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:10.597280 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:10.729241 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:10.736657 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-5f683abe-8c96-4fe4-bcfa-ab6317ae6461 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1559 microversion: 2.1 time: 0.153281 Apr 02 22:09:10.737229 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3622/7545] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:10 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:10.754163 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:09:10.755443 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:09:10.762082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:10.762560 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:10.763350 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:10.763813 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:10.900754 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:09:10.908485 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-9eb0724a-a93d-4ea7-8f38-9de35701e490 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1559 microversion: 2.1 time: 0.158852 Apr 02 22:09:10.909088 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3924/7546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:09:10 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:09:12.601610 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-9b3b432b-93e0-4fd5-a0ce-68ad6ce27b2a req-2ed02702-dca7-4a20-8165-37297986a356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:09:12.609437 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9b3b432b-93e0-4fd5-a0ce-68ad6ce27b2a req-2ed02702-dca7-4a20-8165-37297986a356 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:09:12.609884 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-9b3b432b-93e0-4fd5-a0ce-68ad6ce27b2a req-2ed02702-dca7-4a20-8165-37297986a356 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:09:12.620788 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-9b3b432b-93e0-4fd5-a0ce-68ad6ce27b2a req-2ed02702-dca7-4a20-8165-37297986a356 service nova] Creating event network-changed:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:09:12.625713 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-9b3b432b-93e0-4fd5-a0ce-68ad6ce27b2a req-2ed02702-dca7-4a20-8165-37297986a356 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090683 Apr 02 22:09:12.626313 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3623/7547] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:09:53.720244 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:09:53.720930 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:09:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:10:51.533687 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1870450399"}} {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:10:51.534751 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:10:51.541360 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:10:51.541826 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:10:51.542603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:10:51.543056 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:10:51.819936 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-a8865afb-8e58-460b-8a7c-675f2ba2ddd3 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "POST /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be/action" status: 202 len: 0 microversion: 2.1 time: 0.291512 Apr 02 22:10:51.820604 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3925/7548] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Apr 2 22:10:51 2022] POST /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 02 22:10:57.535935 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-3cfa4d68-152b-4eec-8e2e-37d96f0d75f0 req-68226446-a6ee-4e06-b469-e98efa41c458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "name": "network-vif-plugged", "status": "completed", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:10:57.552806 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3cfa4d68-152b-4eec-8e2e-37d96f0d75f0 req-68226446-a6ee-4e06-b469-e98efa41c458 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:10:57.553620 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-3cfa4d68-152b-4eec-8e2e-37d96f0d75f0 req-68226446-a6ee-4e06-b469-e98efa41c458 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:10:57.567213 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-3cfa4d68-152b-4eec-8e2e-37d96f0d75f0 req-68226446-a6ee-4e06-b469-e98efa41c458 service nova] Creating event network-vif-plugged:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:10:57.576010 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-3cfa4d68-152b-4eec-8e2e-37d96f0d75f0 req-68226446-a6ee-4e06-b469-e98efa41c458 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046989 Apr 02 22:10:57.577432 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3624/7549] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:11:05.935929 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:05.936573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:05.942082 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-78af6a4f-7e06-437f-9e3f-4c662e32db6a req-fdedc9ab-7c86-48d5-a938-88d70e096619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:11:05.946728 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 22:11:05.947632 ncdv-master-1 devstack@n-api.service[136517]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 02 22:11:05.956336 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:05.956639 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-78af6a4f-7e06-437f-9e3f-4c662e32db6a req-fdedc9ab-7c86-48d5-a938-88d70e096619 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:05.956965 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:05.957076 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-78af6a4f-7e06-437f-9e3f-4c662e32db6a req-fdedc9ab-7c86-48d5-a938-88d70e096619 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:05.957756 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:05.958236 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:05.968056 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-78af6a4f-7e06-437f-9e3f-4c662e32db6a req-fdedc9ab-7c86-48d5-a938-88d70e096619 service nova] Creating event network-changed:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:11:05.973262 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-78af6a4f-7e06-437f-9e3f-4c662e32db6a req-fdedc9ab-7c86-48d5-a938-88d70e096619 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Apr 02 22:11:05.973959 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3625/7550] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:11:05.989810 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 22:11:06.072705 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e32ca0e2-cc57-4604-b70a-192ffd8f2871 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 204 len: 0 microversion: 2.1 time: 0.140798 Apr 02 22:11:06.076537 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3926/7551] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 22:11:05 2022] DELETE /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 02 22:11:06.083340 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:06.084046 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:06.090870 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:06.091669 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:06.092648 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:06.093243 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:06.342044 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:11:06.350987 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e775040d-b643-4f61-9771-76370fcef68f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1683 microversion: 2.1 time: 0.272689 Apr 02 22:11:06.351581 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3626/7552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:06 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1683 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:11:07.370067 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:07.370829 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:07.377983 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:07.378461 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:07.379266 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:07.379732 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:07.485818 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-1feedb3a-0382-4f0a-b313-e18cf258cdc7 req-e700b38e-5772-48a8-ace1-652266645b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "name": "network-vif-unplugged", "status": "completed", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:11:07.498281 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1feedb3a-0382-4f0a-b313-e18cf258cdc7 req-e700b38e-5772-48a8-ace1-652266645b2b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:07.498790 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-1feedb3a-0382-4f0a-b313-e18cf258cdc7 req-e700b38e-5772-48a8-ace1-652266645b2b service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:07.514005 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ff73574-839f-476c-bccc-fa9f98efa9c6] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45184. Apr 02 22:11:07.515976 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-1feedb3a-0382-4f0a-b313-e18cf258cdc7 req-e700b38e-5772-48a8-ace1-652266645b2b service nova] Creating event network-vif-unplugged:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:11:07.519837 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ceed419-d874-4d0f-b0cc-9424eda6b5b9] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45182. Apr 02 22:11:07.521779 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-1feedb3a-0382-4f0a-b313-e18cf258cdc7 req-e700b38e-5772-48a8-ace1-652266645b2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039952 Apr 02 22:11:07.522688 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3627/7553] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:11:07.593873 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:11:07.601468 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-47678644-fd02-4a74-93ff-b780614924c2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1565 microversion: 2.1 time: 0.236290 Apr 02 22:11:07.602069 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3927/7554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:07 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1565 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:11:08.409183 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-b62dc37f-2be8-48b5-bed6-e846b8a741fe req-bb17a226-1873-4731-9a2d-80e035a4b1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcfc21e-945e-42c4-87ab-83076101a1be", "name": "network-vif-deleted", "tag": "63b6a5ad-1023-4b8f-955a-089bfdde0cbe"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:11:08.418852 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b62dc37f-2be8-48b5-bed6-e846b8a741fe req-bb17a226-1873-4731-9a2d-80e035a4b1dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:08.419335 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-b62dc37f-2be8-48b5-bed6-e846b8a741fe req-bb17a226-1873-4731-9a2d-80e035a4b1dc service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:08.434511 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-b62dc37f-2be8-48b5-bed6-e846b8a741fe req-bb17a226-1873-4731-9a2d-80e035a4b1dc service nova] Creating event network-vif-deleted:63b6a5ad-1023-4b8f-955a-089bfdde0cbe for instance 9fcfc21e-945e-42c4-87ab-83076101a1be on nch2-master-1 Apr 02 22:11:08.441118 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-b62dc37f-2be8-48b5-bed6-e846b8a741fe req-bb17a226-1873-4731-9a2d-80e035a4b1dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036265 Apr 02 22:11:08.441733 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3628/7555] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:11:08.619499 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:08.620051 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:08.626885 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:08.627355 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:08.628138 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:08.628631 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:08.659603 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:08.660082 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:08.660573 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lazy-loading 'fault' on Instance uuid 9fcfc21e-945e-42c4-87ab-83076101a1be {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 22:11:08.706997 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:11:08.715075 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-cf3d8aa3-8408-49bb-81c1-fdfeced26b0d tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 200 len: 1338 microversion: 2.1 time: 0.100179 Apr 02 22:11:08.715971 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3928/7556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:08 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:11:09.734258 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:09.734876 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 9fcfc21e-945e-42c4-87ab-83076101a1be] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:09.741088 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:09.741526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:09.742289 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:09.742728 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:09.755773 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] HTTP exception thrown: Instance 9fcfc21e-945e-42c4-87ab-83076101a1be could not be found. Apr 02 22:11:09.756370 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Returning 404 to user: Instance 9fcfc21e-945e-42c4-87ab-83076101a1be could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 22:11:09.757363 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3c78c9f2-32bd-4971-85b3-f802661903a2 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be" status: 404 len: 111 microversion: 2.1 time: 0.028456 Apr 02 22:11:09.758379 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3629/7557] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:09 2022] GET /compute/v2.1/servers/9fcfc21e-945e-42c4-87ab-83076101a1be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 22:11:11.123283 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:11.123796 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:11.124428 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-27110000-7ed8-420d-a807-3266cb864746 req-939f897a-76dc-42fb-8a92-c3fad8b46e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:11:11.130144 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:11.130853 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:11.131728 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:11.132407 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:11.133663 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27110000-7ed8-420d-a807-3266cb864746 req-939f897a-76dc-42fb-8a92-c3fad8b46e92 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:11.134120 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-27110000-7ed8-420d-a807-3266cb864746 req-939f897a-76dc-42fb-8a92-c3fad8b46e92 service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:11.145537 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-27110000-7ed8-420d-a807-3266cb864746 req-939f897a-76dc-42fb-8a92-c3fad8b46e92 service nova] Creating event network-changed:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:11:11.151362 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-27110000-7ed8-420d-a807-3266cb864746 req-939f897a-76dc-42fb-8a92-c3fad8b46e92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030573 Apr 02 22:11:11.152118 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3630/7558] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 02 22:11:11.158531 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Going to try to terminate instance {{(pid=136518) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 02 22:11:11.258781 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-05c71e5e-5798-43b5-bc9d-3b268f4def84 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "DELETE /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 204 len: 0 microversion: 2.1 time: 0.139553 Apr 02 22:11:11.260013 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3929/7559] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Apr 2 22:11:11 2022] DELETE /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 02 22:11:11.268530 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:11.269246 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:11.276059 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:11.276546 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:11.277363 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:11.277812 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:11.585126 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.policy [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136517) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:11:11.592927 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-e597fbcf-03ac-47ee-812c-957cc24d7f5f tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1684 microversion: 2.1 time: 0.328625 Apr 02 22:11:11.593452 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3631/7560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:11 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1684 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:11:12.610782 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:12.611607 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:12.618353 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:12.618818 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:12.619594 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:12.620045 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:12.754432 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:11:12.762417 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-6cde93ed-66dd-4f5e-9d63-83f460e7cef7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1565 microversion: 2.1 time: 0.156225 Apr 02 22:11:12.762994 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3930/7561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:12 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:11:13.605964 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [req-a30b5391-875c-4a01-a630-170f42d1306e req-d0383432-081f-43b9-aef8-3197998ccbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196e58e5-7c68-4c4c-bc41-2434197e05cf", "name": "network-vif-deleted", "tag": "07bb58c5-a419-41ce-a042-9037ab913e1e"}]} {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 02 22:11:13.615415 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a30b5391-875c-4a01-a630-170f42d1306e req-d0383432-081f-43b9-aef8-3197998ccbaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:13.615874 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [req-a30b5391-875c-4a01-a630-170f42d1306e req-d0383432-081f-43b9-aef8-3197998ccbaf service nova] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:13.627233 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.compute.server_external_events [req-a30b5391-875c-4a01-a630-170f42d1306e req-d0383432-081f-43b9-aef8-3197998ccbaf service nova] Creating event network-vif-deleted:07bb58c5-a419-41ce-a042-9037ab913e1e for instance 196e58e5-7c68-4c4c-bc41-2434197e05cf on nch2-master-1 Apr 02 22:11:13.632470 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [req-a30b5391-875c-4a01-a630-170f42d1306e req-d0383432-081f-43b9-aef8-3197998ccbaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030742 Apr 02 22:11:13.633085 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3632/7562] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Apr 2 22:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 02 22:11:13.780585 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:13.781167 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.compute.api [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136518) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:13.787919 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:13.788387 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:13.789220 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:13.789675 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:13.818658 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:13.819050 ncdv-master-1 devstack@n-api.service[136518]: DEBUG oslo_concurrency.lockutils [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:13.819511 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.objects.instance [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lazy-loading 'fault' on Instance uuid 196e58e5-7c68-4c4c-bc41-2434197e05cf {{(pid=136518) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 02 22:11:13.859788 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.policy [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4061c7eef439ba5fd20abb4c4c447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b882d9c90ca4758aab82bb7f2db9dc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136518) authorize /opt/stack/nova/nova/policy.py:199}} Apr 02 22:11:13.867377 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-4736fe91-87a8-488c-82ef-2169d13e46d7 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 200 len: 1338 microversion: 2.1 time: 0.091337 Apr 02 22:11:13.867955 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3931/7563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:13 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 1338 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 02 22:11:14.885978 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '>' {{(pid=136517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:14.886706 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.compute.api [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [instance: 196e58e5-7c68-4c4c-bc41-2434197e05cf] Fetching instance by UUID {{(pid=136517) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 02 22:11:14.893146 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:14.893667 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:14.894480 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 02 22:11:14.894926 ncdv-master-1 devstack@n-api.service[136517]: DEBUG oslo_concurrency.lockutils [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Lock "7db0541f-0b31-4938-8529-5d83d9e68243" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 02 22:11:14.908938 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.wsgi [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] HTTP exception thrown: Instance 196e58e5-7c68-4c4c-bc41-2434197e05cf could not be found. Apr 02 22:11:14.909526 ncdv-master-1 devstack@n-api.service[136517]: DEBUG nova.api.openstack.wsgi [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Returning 404 to user: Instance 196e58e5-7c68-4c4c-bc41-2434197e05cf could not be found. {{(pid=136517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 02 22:11:14.910387 ncdv-master-1 devstack@n-api.service[136517]: INFO nova.api.openstack.requestlog [None req-3bf708a5-d4bb-4e5f-b79f-5312cb4da350 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf" status: 404 len: 111 microversion: 2.1 time: 0.029550 Apr 02 22:11:14.910922 ncdv-master-1 devstack@n-api.service[136517]: [pid: 136517|app: 0|req: 3633/7564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Apr 2 22:11:14 2022] GET /compute/v2.1/servers/196e58e5-7c68-4c4c-bc41-2434197e05cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 02 22:11:15.070273 ncdv-master-1 devstack@n-api.service[136518]: DEBUG nova.api.openstack.wsgi [None req-e7bb8374-9899-4108-b429-eefa055bc945 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] Calling method '.version_select at 0x7f54c7d91a60>' {{(pid=136518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 02 22:11:15.074896 ncdv-master-1 devstack@n-api.service[136518]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e7bb8374-9899-4108-b429-eefa055bc945 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [e7208968-360f-4762-b58a-1a7ff2bd0155] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 02 22:11:16.088178 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [None req-e7bb8374-9899-4108-b429-eefa055bc945 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] [e7208968-360f-4762-b58a-1a7ff2bd0155] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 45254. Apr 02 22:11:16.105524 ncdv-master-1 devstack@n-api.service[136518]: INFO nova.api.openstack.requestlog [None req-e7bb8374-9899-4108-b429-eefa055bc945 tempest-TestSnapshotPattern-120210652 tempest-TestSnapshotPattern-120210652-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-692673035" status: 202 len: 0 microversion: 2.1 time: 1.039069 Apr 02 22:11:16.106130 ncdv-master-1 devstack@n-api.service[136518]: [pid: 136518|app: 0|req: 3932/7565] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Apr 2 22:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-692673035 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 02 22:11:34.152740 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:11:34.153591 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:11:34.261211 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:11:34.261380 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:13:13.729855 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:13:13.730423 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:13:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:13:39.016385 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:13:39.016979 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:14:54.160811 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:14:54.161490 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:14:54.268543 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:14:54.268742 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:16:33.626886 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:16:33.627497 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:16:33.737748 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:16:33.737933 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:16:50.145968 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:16:50.146669 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:16:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:16:59.024687 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:16:59.025260 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:16:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:18:14.169181 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:18:14.169858 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:18:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:18:14.276245 ncdv-master-1 devstack@n-api.service[136517]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:18:14.276412 ncdv-master-1 devstack@n-api.service[136517]: Sat Apr 2 22:18:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:19:53.636230 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:19:53.636869 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 02 22:19:53.745434 ncdv-master-1 devstack@n-api.service[136518]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 02 22:19:53.745664 ncdv-master-1 devstack@n-api.service[136518]: Sat Apr 2 22:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!